2023-10-06T04:26:00.476 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T04:26:00.476 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} --owner scheduled_yuriw@teuthology --name yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi --verbose --archive /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412285 -- /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412285/orig.config.yaml 2023-10-06T04:26:00.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T04:26:00.614 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412285 branch: wip-yuri3-testing-2023-10-05-0943-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} email: yweinste@redhat.com first_in_suite: false job_id: '7412285' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri3-testing-2023-10-05-0943-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2023-10-05-0943-quincy sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4002 sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri3-testing-2023-10-05-0943-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 targets: smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJsRpR60QY6/djFjGFx1U1QUBPfvDNOFoTsg8aYq7v/ox/m17tCw0bAhX2Xt+g7F/+kKgoscICYAM24k9irbb+U= smithi179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDzZEoCEQEHA5sl0fCfjXNw2SJAIjF9UHBJtEiPDjyFy3v9wiesRUT0oqBTmLJUlZOM/ExDMn/Vpt8k2DNXW11o= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - check-counter: counters: mgr: - min: 4 name: finisher-volumes.complete_latency.avgcount - expected_val: 0 name: finisher-volumes.queue_len - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestPerModuleFinsherThread teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:54:57 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T04:26:00.615 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa; will attempt to use it 2023-10-06T04:26:00.615 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa/tasks 2023-10-06T04:26:00.615 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T04:26:00.617 INFO:teuthology.task.internal:Checking packages... 2023-10-06T04:26:00.639 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564' 2023-10-06T04:26:00.639 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T04:26:00.640 INFO:teuthology.packaging:ref: None 2023-10-06T04:26:00.640 INFO:teuthology.packaging:tag: None 2023-10-06T04:26:00.640 INFO:teuthology.packaging:branch: wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T04:26:00.640 INFO:teuthology.packaging:sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:26:00.640 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T04:26:00.785 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1274.g68e53a4a 2023-10-06T04:26:00.785 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T04:26:00.791 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T04:26:00.791 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T04:26:00.805 INFO:teuthology.task.internal:Saving configuration 2023-10-06T04:26:00.822 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T04:26:00.830 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T04:26:00.856 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412285', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:21:03.894112', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJsRpR60QY6/djFjGFx1U1QUBPfvDNOFoTsg8aYq7v/ox/m17tCw0bAhX2Xt+g7F/+kKgoscICYAM24k9irbb+U='} 2023-10-06T04:26:00.879 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412285', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:21:03.892699', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDzZEoCEQEHA5sl0fCfjXNw2SJAIjF9UHBJtEiPDjyFy3v9wiesRUT0oqBTmLJUlZOM/ExDMn/Vpt8k2DNXW11o='} 2023-10-06T04:26:00.879 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T04:26:00.885 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T04:26:00.885 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T04:26:00.886 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T04:26:00.964 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7465256b80>, signals=[15]) 2023-10-06T04:26:00.965 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T04:26:00.972 INFO:teuthology.task.internal:Opening connections... 2023-10-06T04:26:00.973 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2023-10-06T04:26:00.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:26:01.047 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2023-10-06T04:26:01.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:26:01.113 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T04:26:01.120 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2023-10-06T04:26:01.137 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2023-10-06T04:26:01.137 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-10-06T04:26:01.197 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T04:26:01.197 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T04:26:01.197 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel" 2023-10-06T04:26:01.197 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora" 2023-10-06T04:26:01.197 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.4" 2023-10-06T04:26:01.197 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8" 2023-10-06T04:26:01.197 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T04:26:01.197 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-10-06T04:26:01.197 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T04:26:01.197 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T04:26:01.198 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T04:26:01.198 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T04:26:01.198 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:26:01.198 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T04:26:01.198 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T04:26:01.198 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T04:26:01.198 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T04:26:01.199 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-10-06T04:26:01.220 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2023-10-06T04:26:01.237 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2023-10-06T04:26:01.237 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-10-06T04:26:01.293 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T04:26:01.293 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T04:26:01.293 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel" 2023-10-06T04:26:01.293 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora" 2023-10-06T04:26:01.293 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.4" 2023-10-06T04:26:01.293 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-10-06T04:26:01.294 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T04:26:01.294 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-10-06T04:26:01.294 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T04:26:01.294 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T04:26:01.294 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T04:26:01.294 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T04:26:01.294 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:26:01.294 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T04:26:01.294 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T04:26:01.294 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T04:26:01.294 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T04:26:01.295 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-10-06T04:26:01.312 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T04:26:01.322 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T04:26:01.327 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T04:26:01.327 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2023-10-06T04:26:01.330 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2023-10-06T04:26:01.350 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T04:26:01.357 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T04:26:01.357 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2023-10-06T04:26:01.390 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2023-10-06T04:26:01.405 INFO:teuthology.orchestra.run.smithi112.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T04:26:01.407 INFO:teuthology.orchestra.run.smithi179.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T04:26:01.408 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T04:26:01.456 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T04:26:01.470 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-06T04:26:01.471 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-06T04:26:01.471 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-06T04:26:01.471 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T04:26:01.472 DEBUG:teuthology.orchestra.run.smithi179:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T04:26:01.486 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:26:01.487 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2023-10-06T04:26:01.488 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:26:01.488 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2023-10-06T04:26:01.543 INFO:teuthology.orchestra.run.smithi179.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T04:26:01.544 INFO:teuthology.task.kernel:Running kernel on smithi179: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T04:26:01.544 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum install -y kernel 2023-10-06T04:26:01.547 INFO:teuthology.orchestra.run.smithi112.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T04:26:01.547 INFO:teuthology.task.kernel:Running kernel on smithi112: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T04:26:01.547 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum install -y kernel 2023-10-06T04:26:02.939 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2023-10-06T04:26:02.940 INFO:teuthology.orchestra.run.smithi112.stdout:Unable to read consumer identity 2023-10-06T04:26:02.975 INFO:teuthology.orchestra.run.smithi179.stdout:Updating Subscription Management repositories. 2023-10-06T04:26:02.976 INFO:teuthology.orchestra.run.smithi179.stdout:Unable to read consumer identity 2023-10-06T04:26:04.269 INFO:teuthology.orchestra.run.smithi112.stdout:Copr repo for python3-asyncssh owned by ceph 34 kB/s | 3.5 kB 00:00 2023-10-06T04:26:04.410 INFO:teuthology.orchestra.run.smithi179.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-06T04:26:04.769 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 34 MB/s | 16 MB 00:00 2023-10-06T04:26:05.908 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-10-06T04:26:08.229 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-10-06T04:26:08.978 INFO:teuthology.orchestra.run.smithi112.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T04:26:08.979 INFO:teuthology.orchestra.run.smithi112.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T04:26:08.979 INFO:teuthology.orchestra.run.smithi112.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T04:26:09.136 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2023-10-06T04:26:09.137 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2023-10-06T04:26:09.137 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2023-10-06T04:26:09.235 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-10-06T04:26:09.249 DEBUG:teuthology.orchestra.run.smithi112:> echo no | sudo yum reinstall kernel || true 2023-10-06T04:26:09.592 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2023-10-06T04:26:09.592 INFO:teuthology.orchestra.run.smithi112.stdout:Unable to read consumer identity 2023-10-06T04:26:09.880 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:01 ago on Fri 06 Oct 2023 04:26:08 AM UTC. 2023-10-06T04:26:09.985 INFO:teuthology.orchestra.run.smithi179.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T04:26:09.985 INFO:teuthology.orchestra.run.smithi179.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T04:26:09.985 INFO:teuthology.orchestra.run.smithi179.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T04:26:10.004 INFO:teuthology.orchestra.run.smithi112.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T04:26:10.004 INFO:teuthology.orchestra.run.smithi112.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:26:10.005 INFO:teuthology.orchestra.run.smithi112.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:26:10.031 INFO:teuthology.orchestra.run.smithi112.stderr:Error: No packages marked for reinstall. 2023-10-06T04:26:10.080 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum reinstall -y kernel || true 2023-10-06T04:26:10.138 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2023-10-06T04:26:10.139 INFO:teuthology.orchestra.run.smithi179.stdout:Nothing to do. 2023-10-06T04:26:10.140 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2023-10-06T04:26:10.242 DEBUG:teuthology.orchestra.run.smithi179:> echo no | sudo yum reinstall kernel || true 2023-10-06T04:26:10.423 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2023-10-06T04:26:10.424 INFO:teuthology.orchestra.run.smithi112.stdout:Unable to read consumer identity 2023-10-06T04:26:10.586 INFO:teuthology.orchestra.run.smithi179.stdout:Updating Subscription Management repositories. 2023-10-06T04:26:10.586 INFO:teuthology.orchestra.run.smithi179.stdout:Unable to read consumer identity 2023-10-06T04:26:10.706 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 04:26:08 AM UTC. 2023-10-06T04:26:10.870 INFO:teuthology.orchestra.run.smithi112.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T04:26:10.870 INFO:teuthology.orchestra.run.smithi112.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:26:10.871 INFO:teuthology.orchestra.run.smithi112.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:26:10.873 INFO:teuthology.orchestra.run.smithi179.stdout:Last metadata expiration check: 0:00:01 ago on Fri 06 Oct 2023 04:26:09 AM UTC. 2023-10-06T04:26:10.881 INFO:teuthology.orchestra.run.smithi112.stderr:Error: No packages marked for reinstall. 2023-10-06T04:26:10.936 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T04:26:11.010 INFO:teuthology.orchestra.run.smithi179.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T04:26:11.010 INFO:teuthology.orchestra.run.smithi179.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:26:11.010 INFO:teuthology.orchestra.run.smithi179.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:26:11.034 INFO:teuthology.orchestra.run.smithi179.stderr:Error: No packages marked for reinstall. 2023-10-06T04:26:11.061 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:26:11.061 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:26:11.061 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:26:11.061 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T04:26:11.061 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T04:26:11.061 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-06T04:26:11.061 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi112.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T04:26:11.062 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T04:26:11.083 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum reinstall -y kernel || true 2023-10-06T04:26:11.188 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:26:11.189 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:26:11.189 DEBUG:teuthology.orchestra.run.smithi112:> sudo rpm -qi grub2-tools 2023-10-06T04:26:11.215 INFO:teuthology.orchestra.run.smithi112.stdout:Name : grub2-tools 2023-10-06T04:26:11.215 INFO:teuthology.orchestra.run.smithi112.stdout:Epoch : 1 2023-10-06T04:26:11.215 INFO:teuthology.orchestra.run.smithi112.stdout:Version : 2.02 2023-10-06T04:26:11.216 INFO:teuthology.orchestra.run.smithi112.stdout:Release : 99.el8_4.1 2023-10-06T04:26:11.216 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: x86_64 2023-10-06T04:26:11.216 INFO:teuthology.orchestra.run.smithi112.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T04:26:11.216 INFO:teuthology.orchestra.run.smithi112.stdout:Group : System Environment/Base 2023-10-06T04:26:11.216 INFO:teuthology.orchestra.run.smithi112.stdout:Size : 9264631 2023-10-06T04:26:11.216 INFO:teuthology.orchestra.run.smithi112.stdout:License : GPLv3+ 2023-10-06T04:26:11.216 INFO:teuthology.orchestra.run.smithi112.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T04:26:11.216 INFO:teuthology.orchestra.run.smithi112.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T04:26:11.216 INFO:teuthology.orchestra.run.smithi112.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T04:26:11.216 INFO:teuthology.orchestra.run.smithi112.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T04:26:11.216 INFO:teuthology.orchestra.run.smithi112.stdout:Relocations : (not relocatable) 2023-10-06T04:26:11.216 INFO:teuthology.orchestra.run.smithi112.stdout:Packager : Red Hat, Inc. 2023-10-06T04:26:11.217 INFO:teuthology.orchestra.run.smithi112.stdout:Vendor : Red Hat, Inc. 2023-10-06T04:26:11.217 INFO:teuthology.orchestra.run.smithi112.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T04:26:11.217 INFO:teuthology.orchestra.run.smithi112.stdout:Summary : Support tools for GRUB. 2023-10-06T04:26:11.217 INFO:teuthology.orchestra.run.smithi112.stdout:Description : 2023-10-06T04:26:11.217 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:26:11.217 INFO:teuthology.orchestra.run.smithi112.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T04:26:11.217 INFO:teuthology.orchestra.run.smithi112.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T04:26:11.217 INFO:teuthology.orchestra.run.smithi112.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T04:26:11.217 INFO:teuthology.orchestra.run.smithi112.stdout:hardware devices. 2023-10-06T04:26:11.217 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:26:11.217 INFO:teuthology.orchestra.run.smithi112.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T04:26:11.218 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T04:26:11.218 INFO:teuthology.task.kernel:Updating grub on smithi112 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:26:11.218 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T04:26:11.425 INFO:teuthology.orchestra.run.smithi179.stdout:Updating Subscription Management repositories. 2023-10-06T04:26:11.425 INFO:teuthology.orchestra.run.smithi179.stdout:Unable to read consumer identity 2023-10-06T04:26:11.716 INFO:teuthology.orchestra.run.smithi179.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 04:26:09 AM UTC. 2023-10-06T04:26:11.843 INFO:teuthology.orchestra.run.smithi179.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T04:26:11.843 INFO:teuthology.orchestra.run.smithi179.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:26:11.843 INFO:teuthology.orchestra.run.smithi179.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:26:11.858 INFO:teuthology.orchestra.run.smithi179.stderr:Error: No packages marked for reinstall. 2023-10-06T04:26:11.908 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T04:26:12.032 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:26:12.032 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:26:12.032 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:26:12.032 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T04:26:12.032 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T04:26:12.033 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-06T04:26:12.033 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi179.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T04:26:12.033 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T04:26:12.158 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:26:12.158 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:26:12.158 DEBUG:teuthology.orchestra.run.smithi179:> sudo rpm -qi grub2-tools 2023-10-06T04:26:12.185 INFO:teuthology.orchestra.run.smithi179.stdout:Name : grub2-tools 2023-10-06T04:26:12.185 INFO:teuthology.orchestra.run.smithi179.stdout:Epoch : 1 2023-10-06T04:26:12.185 INFO:teuthology.orchestra.run.smithi179.stdout:Version : 2.02 2023-10-06T04:26:12.185 INFO:teuthology.orchestra.run.smithi179.stdout:Release : 99.el8_4.1 2023-10-06T04:26:12.186 INFO:teuthology.orchestra.run.smithi179.stdout:Architecture: x86_64 2023-10-06T04:26:12.186 INFO:teuthology.orchestra.run.smithi179.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T04:26:12.186 INFO:teuthology.orchestra.run.smithi179.stdout:Group : System Environment/Base 2023-10-06T04:26:12.186 INFO:teuthology.orchestra.run.smithi179.stdout:Size : 9264631 2023-10-06T04:26:12.186 INFO:teuthology.orchestra.run.smithi179.stdout:License : GPLv3+ 2023-10-06T04:26:12.186 INFO:teuthology.orchestra.run.smithi179.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T04:26:12.186 INFO:teuthology.orchestra.run.smithi179.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T04:26:12.186 INFO:teuthology.orchestra.run.smithi179.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T04:26:12.186 INFO:teuthology.orchestra.run.smithi179.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T04:26:12.186 INFO:teuthology.orchestra.run.smithi179.stdout:Relocations : (not relocatable) 2023-10-06T04:26:12.187 INFO:teuthology.orchestra.run.smithi179.stdout:Packager : Red Hat, Inc. 2023-10-06T04:26:12.187 INFO:teuthology.orchestra.run.smithi179.stdout:Vendor : Red Hat, Inc. 2023-10-06T04:26:12.187 INFO:teuthology.orchestra.run.smithi179.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T04:26:12.187 INFO:teuthology.orchestra.run.smithi179.stdout:Summary : Support tools for GRUB. 2023-10-06T04:26:12.187 INFO:teuthology.orchestra.run.smithi179.stdout:Description : 2023-10-06T04:26:12.187 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:26:12.187 INFO:teuthology.orchestra.run.smithi179.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T04:26:12.187 INFO:teuthology.orchestra.run.smithi179.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T04:26:12.187 INFO:teuthology.orchestra.run.smithi179.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T04:26:12.187 INFO:teuthology.orchestra.run.smithi179.stdout:hardware devices. 2023-10-06T04:26:12.187 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:26:12.188 INFO:teuthology.orchestra.run.smithi179.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T04:26:12.188 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T04:26:12.189 INFO:teuthology.task.kernel:Updating grub on smithi179 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:26:12.189 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T04:26:12.645 INFO:teuthology.orchestra.run.smithi112.stderr:Generating grub configuration file ... 2023-10-06T04:26:13.469 INFO:teuthology.orchestra.run.smithi179.stderr:Generating grub configuration file ... 2023-10-06T04:26:15.154 INFO:teuthology.orchestra.run.smithi112.stderr:done 2023-10-06T04:26:15.156 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2023-10-06T04:26:15.170 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.QcVFzHVOHl 2023-10-06T04:26:15.171 DEBUG:teuthology.orchestra.run.smithi112:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QcVFzHVOHl 2023-10-06T04:26:15.240 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.QcVFzHVOHl 2023-10-06T04:26:15.405 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.QcVFzHVOHl is 6KB 2023-10-06T04:26:15.455 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.QcVFzHVOHl 2023-10-06T04:26:15.469 DEBUG:teuthology.orchestra.run.smithi112:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T04:26:15.539 INFO:teuthology.orchestra.run.smithi112.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T04:26:15.539 INFO:teuthology.orchestra.run.smithi112.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T04:26:15.539 INFO:teuthology.orchestra.run.smithi112.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T04:26:15.539 INFO:teuthology.orchestra.run.smithi112.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T04:26:15.540 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:26:15.724 INFO:teuthology.orchestra.run.smithi179.stderr:done 2023-10-06T04:26:15.726 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2023-10-06T04:26:15.733 DEBUG:teuthology.orchestra.run.smithi112:> sudo shutdown -r now 2023-10-06T04:26:15.746 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.cMqHWnEzxd 2023-10-06T04:26:15.747 DEBUG:teuthology.orchestra.run.smithi179:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.cMqHWnEzxd 2023-10-06T04:26:15.821 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.cMqHWnEzxd 2023-10-06T04:26:15.977 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.cMqHWnEzxd is 6KB 2023-10-06T04:26:16.025 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.cMqHWnEzxd 2023-10-06T04:26:16.039 DEBUG:teuthology.orchestra.run.smithi179:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T04:26:16.115 INFO:teuthology.orchestra.run.smithi179.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T04:26:16.115 INFO:teuthology.orchestra.run.smithi179.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T04:26:16.115 INFO:teuthology.orchestra.run.smithi179.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T04:26:16.115 INFO:teuthology.orchestra.run.smithi179.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T04:26:16.116 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:26:16.281 DEBUG:teuthology.orchestra.run.smithi179:> sudo shutdown -r now 2023-10-06T04:26:45.762 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-06T04:26:45.763 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-10-06T04:26:45.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:26:46.284 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-06T04:26:46.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-06T04:26:46.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:27:04.190 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-10-06T04:27:04.698 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-06T04:27:13.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-10-06T04:27:13.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:27:13.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-06T04:27:13.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:27:16.250 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-10-06T04:27:16.766 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-06T04:27:28.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-10-06T04:27:28.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:27:28.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-06T04:27:28.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:28:00.201 DEBUG:teuthology.orchestra.run.smithi112:> true 2023-10-06T04:28:00.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-10-06T04:28:00.517 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T04:28:00.517 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2023-10-06T04:28:00.537 INFO:teuthology.orchestra.run.smithi112.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T04:28:00.538 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:28:00.538 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T04:28:00.538 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T04:28:00.611 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-10-06T04:28:00.863 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-06T04:28:00.863 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T04:28:00.864 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2023-10-06T04:28:00.892 INFO:teuthology.orchestra.run.smithi179.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T04:28:00.893 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:28:00.893 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T04:28:00.893 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T04:28:01.540 DEBUG:teuthology.parallel:result is None 2023-10-06T04:28:01.893 DEBUG:teuthology.parallel:result is None 2023-10-06T04:28:01.894 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T04:28:01.901 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T04:28:01.902 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T04:28:01.949 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T04:28:02.237 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T04:28:02.245 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T04:28:02.254 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T04:28:02.255 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T04:28:02.292 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T04:28:02.549 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T04:28:02.557 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T04:28:02.557 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T04:28:02.624 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T04:28:03.295 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:28:03.305 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:28:03.469 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:28:03.504 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:28:03.527 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T04:28:03.535 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T04:28:03.536 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T04:28:03.574 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T04:28:03.872 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T04:28:03.882 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T04:28:03.882 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T04:28:03.884 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T04:28:04.166 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:28:04.211 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:28:04.254 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:28:04.353 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:28:04.392 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:28:04.392 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T04:28:04.484 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:28:04.580 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:28:04.625 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:28:04.665 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:28:04.707 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:28:04.707 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T04:28:04.772 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2023-10-06T04:28:04.774 DEBUG:teuthology.orchestra.run.smithi179:> sudo service rsyslog restart 2023-10-06T04:28:04.848 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:28:04.972 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:28:05.352 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T04:28:05.361 INFO:teuthology.task.internal:Starting timer... 2023-10-06T04:28:05.362 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T04:28:05.379 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T04:28:05.396 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T04:28:05.396 DEBUG:teuthology.orchestra.run.smithi112:> sudo service auditd rotate 2023-10-06T04:28:05.455 INFO:teuthology.orchestra.run.smithi112.stdout:Rotating logs: [ OK ] 2023-10-06T04:28:05.457 DEBUG:teuthology.orchestra.run.smithi179:> sudo service auditd rotate 2023-10-06T04:28:05.544 INFO:teuthology.orchestra.run.smithi179.stdout:Rotating logs: [ OK ] 2023-10-06T04:28:05.546 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T04:28:05.546 DEBUG:teuthology.orchestra.run.smithi112:> /usr/sbin/getenforce 2023-10-06T04:28:05.565 INFO:teuthology.orchestra.run.smithi112.stdout:Permissive 2023-10-06T04:28:05.566 DEBUG:teuthology.orchestra.run.smithi179:> /usr/sbin/getenforce 2023-10-06T04:28:05.646 INFO:teuthology.orchestra.run.smithi179.stdout:Permissive 2023-10-06T04:28:05.646 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi112.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi179.front.sepia.ceph.com': 'permissive'} 2023-10-06T04:28:05.646 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:28:05.671 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:28:05.672 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:28:05.700 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:28:05.700 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T04:28:05.701 DEBUG:teuthology.orchestra.run.smithi112:> sudo /usr/sbin/setenforce permissive 2023-10-06T04:28:05.746 DEBUG:teuthology.orchestra.run.smithi179:> sudo /usr/sbin/setenforce permissive 2023-10-06T04:28:05.770 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T04:28:05.783 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-06T04:28:05.784 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T04:28:05.803 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T04:28:05.804 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi112.front.sepia.ceph.com,smithi179.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T04:36:24.216 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi112.front.sepia.ceph.com'), Remote(name='ubuntu@smithi179.front.sepia.ceph.com')] 2023-10-06T04:36:24.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-10-06T04:36:24.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:36:24.290 DEBUG:teuthology.orchestra.run.smithi112:> true 2023-10-06T04:36:24.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-10-06T04:36:24.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-06T04:36:24.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:36:24.382 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-10-06T04:36:24.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-06T04:36:24.446 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T04:36:24.458 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T04:36:24.458 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T04:36:24.458 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:36:24.461 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T04:36:24.461 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:36:24.489 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T04:36:24.503 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T04:36:24.514 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T04:36:24.528 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T04:36:24.537 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: ntpd: command not found 2023-10-06T04:36:24.547 INFO:teuthology.orchestra.run.smithi112.stdout:506 Cannot talk to daemon 2023-10-06T04:36:24.561 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T04:36:24.562 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: ntpd: command not found 2023-10-06T04:36:24.572 INFO:teuthology.orchestra.run.smithi179.stdout:506 Cannot talk to daemon 2023-10-06T04:36:24.575 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T04:36:24.586 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T04:36:24.600 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T04:36:24.642 INFO:teuthology.orchestra.run.smithi112.stderr:bash: ntpq: command not found 2023-10-06T04:36:24.644 INFO:teuthology.orchestra.run.smithi112.stdout:210 Number of sources = 4 2023-10-06T04:36:24.644 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:36:24.644 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2023-10-06T04:36:24.645 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:36:24.645 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:36:24.645 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:36:24.645 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:36:24.668 INFO:teuthology.orchestra.run.smithi179.stderr:bash: ntpq: command not found 2023-10-06T04:36:24.671 INFO:teuthology.orchestra.run.smithi179.stdout:210 Number of sources = 4 2023-10-06T04:36:24.671 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:36:24.671 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2023-10-06T04:36:24.671 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:36:24.671 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:36:24.671 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:36:24.671 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:36:24.672 INFO:teuthology.run_tasks:Running task install... 2023-10-06T04:36:24.680 DEBUG:teuthology.task.install:project ceph 2023-10-06T04:36:24.680 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}} 2023-10-06T04:36:24.680 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'} 2023-10-06T04:36:24.681 INFO:teuthology.task.install:Using flavor: default 2023-10-06T04:36:24.687 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T04:36:24.687 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T04:36:24.687 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'tag': None, 'wait_for_package': False} 2023-10-06T04:36:24.688 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:36:24.689 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'tag': None, 'wait_for_package': False} 2023-10-06T04:36:24.690 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:36:24.841 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/ 2023-10-06T04:36:24.842 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1274.g68e53a4a 2023-10-06T04:36:24.853 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/ 2023-10-06T04:36:24.853 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1274.g68e53a4a 2023-10-06T04:36:25.011 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T04:36:25.011 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:36:25.011 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T04:36:25.020 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T04:36:25.021 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:36:25.021 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T04:36:25.036 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T04:36:25.036 DEBUG:teuthology.orchestra.run.smithi112:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T04:36:25.046 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T04:36:25.047 DEBUG:teuthology.orchestra.run.smithi179:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T04:36:25.101 DEBUG:teuthology.orchestra.run.smithi112:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T04:36:25.112 DEBUG:teuthology.orchestra.run.smithi179:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T04:36:25.175 DEBUG:teuthology.orchestra.run.smithi112:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T04:36:25.187 DEBUG:teuthology.orchestra.run.smithi179:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T04:36:25.238 INFO:teuthology.orchestra.run.smithi112.stdout:check_obsoletes = 1 2023-10-06T04:36:25.239 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum clean all 2023-10-06T04:36:25.251 INFO:teuthology.orchestra.run.smithi179.stdout:check_obsoletes = 1 2023-10-06T04:36:25.252 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum clean all 2023-10-06T04:36:25.630 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2023-10-06T04:36:25.644 INFO:teuthology.orchestra.run.smithi179.stdout:Updating Subscription Management repositories. 2023-10-06T04:36:26.006 INFO:teuthology.orchestra.run.smithi179.stdout:44 files removed 2023-10-06T04:36:26.013 INFO:teuthology.orchestra.run.smithi112.stdout:44 files removed 2023-10-06T04:36:26.056 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T04:36:26.063 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T04:36:26.406 INFO:teuthology.orchestra.run.smithi179.stdout:Updating Subscription Management repositories. 2023-10-06T04:36:26.413 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2023-10-06T04:36:27.219 INFO:teuthology.orchestra.run.smithi179.stdout:ceph packages for x86_64 251 kB/s | 78 kB 00:00 2023-10-06T04:36:27.269 INFO:teuthology.orchestra.run.smithi112.stdout:ceph packages for x86_64 210 kB/s | 78 kB 00:00 2023-10-06T04:36:27.550 INFO:teuthology.orchestra.run.smithi112.stdout:ceph noarch packages 38 kB/s | 9.2 kB 00:00 2023-10-06T04:36:27.565 INFO:teuthology.orchestra.run.smithi179.stdout:ceph noarch packages 30 kB/s | 9.2 kB 00:00 2023-10-06T04:36:27.841 INFO:teuthology.orchestra.run.smithi179.stdout:ceph source packages 5.9 kB/s | 1.4 kB 00:00 2023-10-06T04:36:27.885 INFO:teuthology.orchestra.run.smithi112.stdout:ceph source packages 4.7 kB/s | 1.4 kB 00:00 2023-10-06T04:36:27.952 INFO:teuthology.orchestra.run.smithi179.stdout:Copr repo for python3-asyncssh owned by ceph 42 kB/s | 3.5 kB 00:00 2023-10-06T04:36:27.991 INFO:teuthology.orchestra.run.smithi112.stdout:Copr repo for python3-asyncssh owned by ceph 44 kB/s | 3.5 kB 00:00 2023-10-06T04:36:28.600 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 27 MB/s | 16 MB 00:00 2023-10-06T04:36:29.073 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-10-06T04:36:31.926 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-10-06T04:36:32.310 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 109 MB/s | 33 MB 00:00 2023-10-06T04:36:32.315 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 4.7 MB/s | 24 kB 00:00 2023-10-06T04:36:32.713 INFO:teuthology.orchestra.run.smithi179.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 121 MB/s | 38 MB 00:00 2023-10-06T04:36:37.675 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 66 MB/s | 38 MB 00:00 2023-10-06T04:36:38.303 INFO:teuthology.orchestra.run.smithi179.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 80 MB/s | 33 MB 00:00 2023-10-06T04:36:46.160 INFO:teuthology.orchestra.run.smithi179.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:36:46.160 INFO:teuthology.orchestra.run.smithi179.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:36:46.171 INFO:teuthology.orchestra.run.smithi179.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T04:36:46.172 INFO:teuthology.orchestra.run.smithi179.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T04:36:46.173 INFO:teuthology.orchestra.run.smithi179.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T04:36:46.174 INFO:teuthology.orchestra.run.smithi179.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T04:36:46.175 INFO:teuthology.orchestra.run.smithi179.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T04:36:46.178 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T04:36:46.178 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T04:36:46.287 INFO:teuthology.orchestra.run.smithi112.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:36:46.287 INFO:teuthology.orchestra.run.smithi112.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:36:46.298 INFO:teuthology.orchestra.run.smithi112.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T04:36:46.299 INFO:teuthology.orchestra.run.smithi112.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T04:36:46.300 INFO:teuthology.orchestra.run.smithi112.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T04:36:46.300 INFO:teuthology.orchestra.run.smithi112.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T04:36:46.302 INFO:teuthology.orchestra.run.smithi112.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T04:36:46.304 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T04:36:46.305 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T04:36:46.666 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2023-10-06T04:36:46.677 INFO:teuthology.orchestra.run.smithi179.stdout:====================================================================================================================== 2023-10-06T04:36:46.677 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2023-10-06T04:36:46.677 INFO:teuthology.orchestra.run.smithi179.stdout:====================================================================================================================== 2023-10-06T04:36:46.677 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2023-10-06T04:36:46.677 INFO:teuthology.orchestra.run.smithi179.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T04:36:46.677 INFO:teuthology.orchestra.run.smithi179.stdout: ceph x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 6.4 k 2023-10-06T04:36:46.678 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.2 M 2023-10-06T04:36:46.678 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 877 k 2023-10-06T04:36:46.678 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 162 k 2023-10-06T04:36:46.678 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 1.6 M 2023-10-06T04:36:46.678 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 121 k 2023-10-06T04:36:46.678 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 1.7 M 2023-10-06T04:36:46.678 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 7.4 M 2023-10-06T04:36:46.678 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 47 k 2023-10-06T04:36:46.678 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T04:36:46.678 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 52 M 2023-10-06T04:36:46.679 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 267 k 2023-10-06T04:36:46.679 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 80 k 2023-10-06T04:36:46.679 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 255 k 2023-10-06T04:36:46.679 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 18 k 2023-10-06T04:36:46.679 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T04:36:46.679 INFO:teuthology.orchestra.run.smithi179.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T04:36:46.679 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T04:36:46.679 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 25 k 2023-10-06T04:36:46.679 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 797 k 2023-10-06T04:36:46.679 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 130 k 2023-10-06T04:36:46.679 INFO:teuthology.orchestra.run.smithi179.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T04:36:46.680 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T04:36:46.680 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T04:36:46.680 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 190 k 2023-10-06T04:36:46.680 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 371 k 2023-10-06T04:36:46.680 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 358 k 2023-10-06T04:36:46.680 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 107 k 2023-10-06T04:36:46.680 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 91 k 2023-10-06T04:36:46.680 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T04:36:46.680 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 173 k 2023-10-06T04:36:46.680 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T04:36:46.680 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrading: 2023-10-06T04:36:46.681 INFO:teuthology.orchestra.run.smithi179.stdout: librados2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.4 M 2023-10-06T04:36:46.681 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T04:36:46.681 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2023-10-06T04:36:46.681 INFO:teuthology.orchestra.run.smithi179.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T04:36:46.681 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 23 M 2023-10-06T04:36:46.681 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 23 k 2023-10-06T04:36:46.681 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 2.3 M 2023-10-06T04:36:46.681 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 238 k 2023-10-06T04:36:46.681 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.9 M 2023-10-06T04:36:46.681 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T04:36:46.681 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 14 k 2023-10-06T04:36:46.681 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 24 k 2023-10-06T04:36:46.682 INFO:teuthology.orchestra.run.smithi179.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T04:36:46.682 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T04:36:46.682 INFO:teuthology.orchestra.run.smithi179.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T04:36:46.682 INFO:teuthology.orchestra.run.smithi179.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T04:36:46.682 INFO:teuthology.orchestra.run.smithi179.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T04:36:46.682 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 175 k 2023-10-06T04:36:46.682 INFO:teuthology.orchestra.run.smithi179.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T04:36:46.682 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T04:36:46.682 INFO:teuthology.orchestra.run.smithi179.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T04:36:46.682 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T04:36:46.682 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T04:36:46.683 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 506 k 2023-10-06T04:36:46.683 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T04:36:46.683 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.6 M 2023-10-06T04:36:46.683 INFO:teuthology.orchestra.run.smithi179.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T04:36:46.683 INFO:teuthology.orchestra.run.smithi179.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T04:36:46.683 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T04:36:46.683 INFO:teuthology.orchestra.run.smithi179.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T04:36:46.683 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T04:36:46.683 INFO:teuthology.orchestra.run.smithi179.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T04:36:46.683 INFO:teuthology.orchestra.run.smithi179.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T04:36:46.683 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T04:36:46.684 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T04:36:46.684 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T04:36:46.684 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T04:36:46.684 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T04:36:46.684 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T04:36:46.684 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T04:36:46.684 INFO:teuthology.orchestra.run.smithi179.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T04:36:46.684 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T04:36:46.684 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 45 k 2023-10-06T04:36:46.684 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 115 k 2023-10-06T04:36:46.684 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T04:36:46.684 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T04:36:46.685 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T04:36:46.685 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T04:36:46.685 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T04:36:46.685 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T04:36:46.685 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T04:36:46.685 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T04:36:46.685 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T04:36:46.685 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T04:36:46.685 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T04:36:46.685 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T04:36:46.685 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T04:36:46.686 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T04:36:46.686 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T04:36:46.686 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T04:36:46.686 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T04:36:46.686 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T04:36:46.686 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T04:36:46.686 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T04:36:46.686 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T04:36:46.686 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T04:36:46.686 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T04:36:46.686 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T04:36:46.687 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T04:36:46.687 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T04:36:46.687 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T04:36:46.687 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T04:36:46.687 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T04:36:46.687 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T04:36:46.687 INFO:teuthology.orchestra.run.smithi179.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T04:36:46.687 INFO:teuthology.orchestra.run.smithi179.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T04:36:46.688 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T04:36:46.688 INFO:teuthology.orchestra.run.smithi179.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T04:36:46.688 INFO:teuthology.orchestra.run.smithi179.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T04:36:46.688 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T04:36:46.688 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T04:36:46.688 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T04:36:46.688 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T04:36:46.688 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T04:36:46.688 INFO:teuthology.orchestra.run.smithi179.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T04:36:46.688 INFO:teuthology.orchestra.run.smithi179.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T04:36:46.688 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T04:36:46.689 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T04:36:46.689 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:36:46.689 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2023-10-06T04:36:46.689 INFO:teuthology.orchestra.run.smithi179.stdout:====================================================================================================================== 2023-10-06T04:36:46.689 INFO:teuthology.orchestra.run.smithi179.stdout:Install 118 Packages 2023-10-06T04:36:46.689 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrade 2 Packages 2023-10-06T04:36:46.689 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:36:46.690 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 201 M 2023-10-06T04:36:46.690 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2023-10-06T04:36:46.790 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2023-10-06T04:36:46.801 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================================================== 2023-10-06T04:36:46.801 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2023-10-06T04:36:46.801 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================================================== 2023-10-06T04:36:46.801 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2023-10-06T04:36:46.802 INFO:teuthology.orchestra.run.smithi112.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T04:36:46.802 INFO:teuthology.orchestra.run.smithi112.stdout: ceph x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 6.4 k 2023-10-06T04:36:46.802 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.2 M 2023-10-06T04:36:46.802 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 877 k 2023-10-06T04:36:46.802 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 162 k 2023-10-06T04:36:46.802 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 1.6 M 2023-10-06T04:36:46.802 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 121 k 2023-10-06T04:36:46.802 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 1.7 M 2023-10-06T04:36:46.802 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 7.4 M 2023-10-06T04:36:46.802 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 47 k 2023-10-06T04:36:46.802 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T04:36:46.803 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 52 M 2023-10-06T04:36:46.803 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 267 k 2023-10-06T04:36:46.803 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 80 k 2023-10-06T04:36:46.803 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 255 k 2023-10-06T04:36:46.803 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 18 k 2023-10-06T04:36:46.803 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T04:36:46.803 INFO:teuthology.orchestra.run.smithi112.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T04:36:46.803 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T04:36:46.803 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 25 k 2023-10-06T04:36:46.803 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 797 k 2023-10-06T04:36:46.803 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 130 k 2023-10-06T04:36:46.804 INFO:teuthology.orchestra.run.smithi112.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T04:36:46.804 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T04:36:46.804 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T04:36:46.804 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 190 k 2023-10-06T04:36:46.804 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 371 k 2023-10-06T04:36:46.804 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 358 k 2023-10-06T04:36:46.804 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 107 k 2023-10-06T04:36:46.804 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 91 k 2023-10-06T04:36:46.804 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T04:36:46.804 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 173 k 2023-10-06T04:36:46.804 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T04:36:46.805 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2023-10-06T04:36:46.805 INFO:teuthology.orchestra.run.smithi112.stdout: librados2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.4 M 2023-10-06T04:36:46.805 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T04:36:46.805 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2023-10-06T04:36:46.805 INFO:teuthology.orchestra.run.smithi112.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T04:36:46.805 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 23 M 2023-10-06T04:36:46.805 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 23 k 2023-10-06T04:36:46.805 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 2.3 M 2023-10-06T04:36:46.805 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 238 k 2023-10-06T04:36:46.805 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.9 M 2023-10-06T04:36:46.806 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T04:36:46.806 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 14 k 2023-10-06T04:36:46.806 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 24 k 2023-10-06T04:36:46.806 INFO:teuthology.orchestra.run.smithi112.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T04:36:46.806 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T04:36:46.806 INFO:teuthology.orchestra.run.smithi112.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T04:36:46.806 INFO:teuthology.orchestra.run.smithi112.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T04:36:46.806 INFO:teuthology.orchestra.run.smithi112.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T04:36:46.806 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 175 k 2023-10-06T04:36:46.807 INFO:teuthology.orchestra.run.smithi112.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T04:36:46.807 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T04:36:46.807 INFO:teuthology.orchestra.run.smithi112.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T04:36:46.807 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T04:36:46.807 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T04:36:46.807 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 506 k 2023-10-06T04:36:46.807 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T04:36:46.807 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.6 M 2023-10-06T04:36:46.807 INFO:teuthology.orchestra.run.smithi112.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T04:36:46.807 INFO:teuthology.orchestra.run.smithi112.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T04:36:46.807 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T04:36:46.808 INFO:teuthology.orchestra.run.smithi112.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T04:36:46.808 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T04:36:46.808 INFO:teuthology.orchestra.run.smithi112.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T04:36:46.808 INFO:teuthology.orchestra.run.smithi112.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T04:36:46.808 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T04:36:46.808 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T04:36:46.808 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T04:36:46.808 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T04:36:46.808 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T04:36:46.808 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T04:36:46.809 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T04:36:46.809 INFO:teuthology.orchestra.run.smithi112.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T04:36:46.809 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T04:36:46.809 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 45 k 2023-10-06T04:36:46.809 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 115 k 2023-10-06T04:36:46.809 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T04:36:46.809 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T04:36:46.809 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T04:36:46.809 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T04:36:46.809 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T04:36:46.809 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T04:36:46.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T04:36:46.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T04:36:46.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T04:36:46.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T04:36:46.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T04:36:46.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T04:36:46.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T04:36:46.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T04:36:46.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T04:36:46.810 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T04:36:46.811 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T04:36:46.811 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T04:36:46.811 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T04:36:46.811 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T04:36:46.811 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T04:36:46.811 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T04:36:46.811 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T04:36:46.811 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T04:36:46.811 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T04:36:46.811 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T04:36:46.811 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T04:36:46.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T04:36:46.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T04:36:46.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T04:36:46.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T04:36:46.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T04:36:46.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T04:36:46.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T04:36:46.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T04:36:46.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T04:36:46.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T04:36:46.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T04:36:46.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T04:36:46.813 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T04:36:46.813 INFO:teuthology.orchestra.run.smithi112.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T04:36:46.813 INFO:teuthology.orchestra.run.smithi112.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T04:36:46.813 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T04:36:46.813 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T04:36:46.813 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:36:46.813 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2023-10-06T04:36:46.813 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================================================== 2023-10-06T04:36:46.813 INFO:teuthology.orchestra.run.smithi112.stdout:Install 118 Packages 2023-10-06T04:36:46.813 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 2 Packages 2023-10-06T04:36:46.813 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:36:46.814 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 201 M 2023-10-06T04:36:46.814 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2023-10-06T04:36:46.998 INFO:teuthology.orchestra.run.smithi179.stdout:(1/120): ceph-17.2.6-1274.g68e53a4a.el8.x86_64. 40 kB/s | 6.4 kB 00:00 2023-10-06T04:36:47.114 INFO:teuthology.orchestra.run.smithi112.stdout:(1/120): ceph-17.2.6-1274.g68e53a4a.el8.x86_64. 43 kB/s | 6.4 kB 00:00 2023-10-06T04:36:47.301 INFO:teuthology.orchestra.run.smithi179.stdout:(2/120): ceph-fuse-17.2.6-1274.g68e53a4a.el8.x8 2.8 MB/s | 877 kB 00:00 2023-10-06T04:36:47.353 INFO:teuthology.orchestra.run.smithi179.stdout:(3/120): ceph-immutable-object-cache-17.2.6-127 3.1 MB/s | 162 kB 00:00 2023-10-06T04:36:47.452 INFO:teuthology.orchestra.run.smithi112.stdout:(2/120): ceph-fuse-17.2.6-1274.g68e53a4a.el8.x8 2.5 MB/s | 877 kB 00:00 2023-10-06T04:36:47.510 INFO:teuthology.orchestra.run.smithi112.stdout:(3/120): ceph-immutable-object-cache-17.2.6-127 2.7 MB/s | 162 kB 00:00 2023-10-06T04:36:47.931 INFO:teuthology.orchestra.run.smithi179.stdout:(4/120): ceph-mds-17.2.6-1274.g68e53a4a.el8.x86 4.0 MB/s | 2.3 MB 00:00 2023-10-06T04:36:48.130 INFO:teuthology.orchestra.run.smithi179.stdout:(5/120): ceph-base-17.2.6-1274.g68e53a4a.el8.x8 4.0 MB/s | 5.2 MB 00:01 2023-10-06T04:36:48.160 INFO:teuthology.orchestra.run.smithi112.stdout:(4/120): ceph-mds-17.2.6-1274.g68e53a4a.el8.x86 3.5 MB/s | 2.3 MB 00:00 2023-10-06T04:36:48.418 INFO:teuthology.orchestra.run.smithi179.stdout:(6/120): ceph-mgr-17.2.6-1274.g68e53a4a.el8.x86 3.2 MB/s | 1.6 MB 00:00 2023-10-06T04:36:48.454 INFO:teuthology.orchestra.run.smithi112.stdout:(5/120): ceph-base-17.2.6-1274.g68e53a4a.el8.x8 3.5 MB/s | 5.2 MB 00:01 2023-10-06T04:36:48.587 INFO:teuthology.orchestra.run.smithi112.stdout:(6/120): ceph-mgr-17.2.6-1274.g68e53a4a.el8.x86 3.7 MB/s | 1.6 MB 00:00 2023-10-06T04:36:48.816 INFO:teuthology.orchestra.run.smithi179.stdout:(7/120): ceph-mon-17.2.6-1274.g68e53a4a.el8.x86 5.7 MB/s | 3.9 MB 00:00 2023-10-06T04:36:49.966 INFO:teuthology.orchestra.run.smithi112.stdout:(7/120): ceph-mon-17.2.6-1274.g68e53a4a.el8.x86 2.6 MB/s | 3.9 MB 00:01 2023-10-06T04:36:50.987 INFO:teuthology.orchestra.run.smithi179.stdout:(8/120): ceph-radosgw-17.2.6-1274.g68e53a4a.el8 7.7 MB/s | 17 MB 00:02 2023-10-06T04:36:51.012 INFO:teuthology.orchestra.run.smithi112.stdout:(8/120): ceph-common-17.2.6-1274.g68e53a4a.el8. 5.8 MB/s | 23 MB 00:04 2023-10-06T04:36:51.033 INFO:teuthology.orchestra.run.smithi179.stdout:(9/120): ceph-selinux-17.2.6-1274.g68e53a4a.el8 537 kB/s | 24 kB 00:00 2023-10-06T04:36:51.046 INFO:teuthology.orchestra.run.smithi112.stdout:(9/120): ceph-selinux-17.2.6-1274.g68e53a4a.el8 724 kB/s | 24 kB 00:00 2023-10-06T04:36:51.465 INFO:teuthology.orchestra.run.smithi179.stdout:(10/120): ceph-common-17.2.6-1274.g68e53a4a.el8 5.1 MB/s | 23 MB 00:04 2023-10-06T04:36:51.496 INFO:teuthology.orchestra.run.smithi112.stdout:(10/120): ceph-osd-17.2.6-1274.g68e53a4a.el8.x8 5.7 MB/s | 17 MB 00:02 2023-10-06T04:36:51.520 INFO:teuthology.orchestra.run.smithi179.stdout:(11/120): cephfs-mirror-17.2.6-1274.g68e53a4a.e 4.5 MB/s | 255 kB 00:00 2023-10-06T04:36:51.567 INFO:teuthology.orchestra.run.smithi112.stdout:(11/120): cephfs-mirror-17.2.6-1274.g68e53a4a.e 3.5 MB/s | 255 kB 00:00 2023-10-06T04:36:51.586 INFO:teuthology.orchestra.run.smithi179.stdout:(12/120): libcephfs-devel-17.2.6-1274.g68e53a4a 379 kB/s | 25 kB 00:00 2023-10-06T04:36:51.624 INFO:teuthology.orchestra.run.smithi112.stdout:(12/120): libcephfs-devel-17.2.6-1274.g68e53a4a 441 kB/s | 25 kB 00:00 2023-10-06T04:36:51.780 INFO:teuthology.orchestra.run.smithi179.stdout:(13/120): libcephfs2-17.2.6-1274.g68e53a4a.el8. 4.0 MB/s | 797 kB 00:00 2023-10-06T04:36:51.826 INFO:teuthology.orchestra.run.smithi112.stdout:(13/120): libcephfs2-17.2.6-1274.g68e53a4a.el8. 3.9 MB/s | 797 kB 00:00 2023-10-06T04:36:51.859 INFO:teuthology.orchestra.run.smithi179.stdout:(14/120): libcephsqlite-17.2.6-1274.g68e53a4a.e 2.2 MB/s | 175 kB 00:00 2023-10-06T04:36:51.902 INFO:teuthology.orchestra.run.smithi112.stdout:(14/120): libcephsqlite-17.2.6-1274.g68e53a4a.e 2.3 MB/s | 175 kB 00:00 2023-10-06T04:36:51.936 INFO:teuthology.orchestra.run.smithi179.stdout:(15/120): librados-devel-17.2.6-1274.g68e53a4a. 1.6 MB/s | 130 kB 00:00 2023-10-06T04:36:51.981 INFO:teuthology.orchestra.run.smithi112.stdout:(15/120): librados-devel-17.2.6-1274.g68e53a4a. 1.6 MB/s | 130 kB 00:00 2023-10-06T04:36:52.077 INFO:teuthology.orchestra.run.smithi112.stdout:(16/120): libradosstriper1-17.2.6-1274.g68e53a4 5.2 MB/s | 506 kB 00:00 2023-10-06T04:36:52.100 INFO:teuthology.orchestra.run.smithi179.stdout:(16/120): libradosstriper1-17.2.6-1274.g68e53a4 3.0 MB/s | 506 kB 00:00 2023-10-06T04:36:53.002 INFO:teuthology.orchestra.run.smithi112.stdout:(17/120): librgw2-17.2.6-1274.g68e53a4a.el8.x86 6.0 MB/s | 5.6 MB 00:00 2023-10-06T04:36:53.071 INFO:teuthology.orchestra.run.smithi112.stdout:(18/120): python3-ceph-argparse-17.2.6-1274.g68 648 kB/s | 45 kB 00:00 2023-10-06T04:36:53.143 INFO:teuthology.orchestra.run.smithi112.stdout:(19/120): python3-ceph-common-17.2.6-1274.g68e5 1.6 MB/s | 115 kB 00:00 2023-10-06T04:36:53.219 INFO:teuthology.orchestra.run.smithi112.stdout:(20/120): python3-cephfs-17.2.6-1274.g68e53a4a. 2.4 MB/s | 190 kB 00:00 2023-10-06T04:36:53.303 INFO:teuthology.orchestra.run.smithi112.stdout:(21/120): python3-rados-17.2.6-1274.g68e53a4a.e 4.4 MB/s | 371 kB 00:00 2023-10-06T04:36:53.386 INFO:teuthology.orchestra.run.smithi112.stdout:(22/120): python3-rbd-17.2.6-1274.g68e53a4a.el8 4.2 MB/s | 358 kB 00:00 2023-10-06T04:36:53.449 INFO:teuthology.orchestra.run.smithi112.stdout:(23/120): python3-rgw-17.2.6-1274.g68e53a4a.el8 1.7 MB/s | 107 kB 00:00 2023-10-06T04:36:53.486 INFO:teuthology.orchestra.run.smithi112.stdout:(24/120): rbd-fuse-17.2.6-1274.g68e53a4a.el8.x8 2.4 MB/s | 91 kB 00:00 2023-10-06T04:36:53.521 INFO:teuthology.orchestra.run.smithi179.stdout:(17/120): ceph-osd-17.2.6-1274.g68e53a4a.el8.x8 3.3 MB/s | 17 MB 00:05 2023-10-06T04:36:53.537 INFO:teuthology.orchestra.run.smithi179.stdout:(18/120): librgw2-17.2.6-1274.g68e53a4a.el8.x86 3.9 MB/s | 5.6 MB 00:01 2023-10-06T04:36:53.583 INFO:teuthology.orchestra.run.smithi179.stdout:(19/120): python3-ceph-argparse-17.2.6-1274.g68 723 kB/s | 45 kB 00:00 2023-10-06T04:36:53.613 INFO:teuthology.orchestra.run.smithi179.stdout:(20/120): python3-ceph-common-17.2.6-1274.g68e5 1.5 MB/s | 115 kB 00:00 2023-10-06T04:36:53.660 INFO:teuthology.orchestra.run.smithi179.stdout:(21/120): python3-cephfs-17.2.6-1274.g68e53a4a. 2.4 MB/s | 190 kB 00:00 2023-10-06T04:36:53.753 INFO:teuthology.orchestra.run.smithi179.stdout:(22/120): python3-rbd-17.2.6-1274.g68e53a4a.el8 3.8 MB/s | 358 kB 00:00 2023-10-06T04:36:53.771 INFO:teuthology.orchestra.run.smithi179.stdout:(23/120): python3-rados-17.2.6-1274.g68e53a4a.e 2.3 MB/s | 371 kB 00:00 2023-10-06T04:36:53.821 INFO:teuthology.orchestra.run.smithi179.stdout:(24/120): python3-rgw-17.2.6-1274.g68e53a4a.el8 1.5 MB/s | 107 kB 00:00 2023-10-06T04:36:53.843 INFO:teuthology.orchestra.run.smithi179.stdout:(25/120): rbd-fuse-17.2.6-1274.g68e53a4a.el8.x8 1.2 MB/s | 91 kB 00:00 2023-10-06T04:36:53.930 INFO:teuthology.orchestra.run.smithi179.stdout:(26/120): rbd-nbd-17.2.6-1274.g68e53a4a.el8.x86 1.9 MB/s | 173 kB 00:00 2023-10-06T04:36:53.976 INFO:teuthology.orchestra.run.smithi112.stdout:(25/120): rbd-mirror-17.2.6-1274.g68e53a4a.el8. 7.1 MB/s | 3.5 MB 00:00 2023-10-06T04:36:53.990 INFO:teuthology.orchestra.run.smithi179.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1274.g 386 kB/s | 23 kB 00:00 2023-10-06T04:36:54.045 INFO:teuthology.orchestra.run.smithi112.stdout:(26/120): rbd-nbd-17.2.6-1274.g68e53a4a.el8.x86 2.4 MB/s | 173 kB 00:00 2023-10-06T04:36:54.061 INFO:teuthology.orchestra.run.smithi179.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1274.g68e53a4 1.7 MB/s | 121 kB 00:00 2023-10-06T04:36:54.119 INFO:teuthology.orchestra.run.smithi112.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1274.g 312 kB/s | 23 kB 00:00 2023-10-06T04:36:54.215 INFO:teuthology.orchestra.run.smithi112.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1274.g68e53a4 1.2 MB/s | 121 kB 00:00 2023-10-06T04:36:54.485 INFO:teuthology.orchestra.run.smithi112.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1274.g68e53 6.3 MB/s | 1.7 MB 00:00 2023-10-06T04:36:54.558 INFO:teuthology.orchestra.run.smithi179.stdout:(29/120): rbd-mirror-17.2.6-1274.g68e53a4a.el8. 4.7 MB/s | 3.5 MB 00:00 2023-10-06T04:36:54.576 INFO:teuthology.orchestra.run.smithi179.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1274.g68e53 3.3 MB/s | 1.7 MB 00:00 2023-10-06T04:36:54.667 INFO:teuthology.orchestra.run.smithi179.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1274.g68 2.6 MB/s | 238 kB 00:00 2023-10-06T04:36:54.749 INFO:teuthology.orchestra.run.smithi179.stdout:(32/120): ceph-mgr-rook-17.2.6-1274.g68e53a4a.e 580 kB/s | 47 kB 00:00 2023-10-06T04:36:54.830 INFO:teuthology.orchestra.run.smithi179.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1274.g6 178 kB/s | 14 kB 00:00 2023-10-06T04:36:54.921 INFO:teuthology.orchestra.run.smithi179.stdout:(34/120): ceph-volume-17.2.6-1274.g68e53a4a.el8 2.9 MB/s | 267 kB 00:00 2023-10-06T04:36:55.006 INFO:teuthology.orchestra.run.smithi179.stdout:(35/120): cephadm-17.2.6-1274.g68e53a4a.el8.noa 953 kB/s | 80 kB 00:00 2023-10-06T04:36:55.088 INFO:teuthology.orchestra.run.smithi179.stdout:(36/120): cephfs-top-17.2.6-1274.g68e53a4a.el8. 219 kB/s | 18 kB 00:00 2023-10-06T04:36:55.447 INFO:teuthology.orchestra.run.smithi179.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 852 kB/s | 306 kB 00:00 2023-10-06T04:36:55.502 INFO:teuthology.orchestra.run.smithi179.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 1.1 MB/s | 59 kB 00:00 2023-10-06T04:36:55.558 INFO:teuthology.orchestra.run.smithi179.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2023-10-06T04:36:55.575 INFO:teuthology.orchestra.run.smithi112.stdout:(30/120): ceph-mgr-diskprediction-local-17.2.6- 6.8 MB/s | 7.4 MB 00:01 2023-10-06T04:36:55.645 INFO:teuthology.orchestra.run.smithi112.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1274.g68 3.3 MB/s | 238 kB 00:00 2023-10-06T04:36:55.659 INFO:teuthology.orchestra.run.smithi179.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 4.6 MB/s | 476 kB 00:00 2023-10-06T04:36:55.710 INFO:teuthology.orchestra.run.smithi179.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 859 kB/s | 44 kB 00:00 2023-10-06T04:36:55.710 INFO:teuthology.orchestra.run.smithi112.stdout:(32/120): ceph-mgr-rook-17.2.6-1274.g68e53a4a.e 733 kB/s | 47 kB 00:00 2023-10-06T04:36:55.767 INFO:teuthology.orchestra.run.smithi179.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 3.2 MB/s | 185 kB 00:00 2023-10-06T04:36:55.773 INFO:teuthology.orchestra.run.smithi112.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1274.g6 232 kB/s | 14 kB 00:00 2023-10-06T04:36:55.816 INFO:teuthology.orchestra.run.smithi179.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 679 kB/s | 33 kB 00:00 2023-10-06T04:36:55.844 INFO:teuthology.orchestra.run.smithi112.stdout:(34/120): ceph-volume-17.2.6-1274.g68e53a4a.el8 3.7 MB/s | 267 kB 00:00 2023-10-06T04:36:55.865 INFO:teuthology.orchestra.run.smithi179.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 333 kB/s | 16 kB 00:00 2023-10-06T04:36:55.910 INFO:teuthology.orchestra.run.smithi112.stdout:(35/120): cephadm-17.2.6-1274.g68e53a4a.el8.noa 1.2 MB/s | 80 kB 00:00 2023-10-06T04:36:55.951 INFO:teuthology.orchestra.run.smithi112.stdout:(36/120): cephfs-top-17.2.6-1274.g68e53a4a.el8. 433 kB/s | 18 kB 00:00 2023-10-06T04:36:56.082 INFO:teuthology.orchestra.run.smithi112.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 2.3 MB/s | 306 kB 00:00 2023-10-06T04:36:56.104 INFO:teuthology.orchestra.run.smithi112.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 2.7 MB/s | 59 kB 00:00 2023-10-06T04:36:56.126 INFO:teuthology.orchestra.run.smithi112.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 3.3 MB/s | 75 kB 00:00 2023-10-06T04:36:56.170 INFO:teuthology.orchestra.run.smithi112.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 10 MB/s | 476 kB 00:00 2023-10-06T04:36:56.190 INFO:teuthology.orchestra.run.smithi112.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.2 MB/s | 44 kB 00:00 2023-10-06T04:36:56.213 INFO:teuthology.orchestra.run.smithi112.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 8.1 MB/s | 185 kB 00:00 2023-10-06T04:36:56.233 INFO:teuthology.orchestra.run.smithi112.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 1.6 MB/s | 33 kB 00:00 2023-10-06T04:36:56.253 INFO:teuthology.orchestra.run.smithi112.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 839 kB/s | 16 kB 00:00 2023-10-06T04:36:56.275 INFO:teuthology.orchestra.run.smithi112.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 7.6 MB/s | 173 kB 00:00 2023-10-06T04:36:56.302 INFO:teuthology.orchestra.run.smithi112.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 14 MB/s | 384 kB 00:00 2023-10-06T04:36:56.322 INFO:teuthology.orchestra.run.smithi112.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 4.0 MB/s | 81 kB 00:00 2023-10-06T04:36:56.341 INFO:teuthology.orchestra.run.smithi112.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 571 kB/s | 11 kB 00:00 2023-10-06T04:36:56.346 INFO:teuthology.orchestra.run.smithi179.stdout:(45/120): ceph-test-17.2.6-1274.g68e53a4a.el8.x 9.7 MB/s | 52 MB 00:05 2023-10-06T04:36:56.346 INFO:teuthology.orchestra.run.smithi179.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 358 kB/s | 173 kB 00:00 2023-10-06T04:36:56.361 INFO:teuthology.orchestra.run.smithi112.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 912 kB/s | 18 kB 00:00 2023-10-06T04:36:56.369 INFO:teuthology.orchestra.run.smithi179.stdout:(47/120): ceph-mgr-diskprediction-local-17.2.6- 4.1 MB/s | 7.4 MB 00:01 2023-10-06T04:36:56.405 INFO:teuthology.orchestra.run.smithi112.stdout:(50/120): python3-kubernetes-11.0.0-6.el8.noarc 26 MB/s | 1.2 MB 00:00 2023-10-06T04:36:56.411 INFO:teuthology.orchestra.run.smithi179.stdout:(48/120): python3-cherrypy-18.4.0-1.el8.noarch. 5.9 MB/s | 384 kB 00:00 2023-10-06T04:36:56.425 INFO:teuthology.orchestra.run.smithi112.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 2.5 MB/s | 49 kB 00:00 2023-10-06T04:36:56.444 INFO:teuthology.orchestra.run.smithi112.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 3.0 MB/s | 59 kB 00:00 2023-10-06T04:36:56.460 INFO:teuthology.orchestra.run.smithi179.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 359 kB/s | 18 kB 00:00 2023-10-06T04:36:56.464 INFO:teuthology.orchestra.run.smithi112.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 3.0 MB/s | 60 kB 00:00 2023-10-06T04:36:56.486 INFO:teuthology.orchestra.run.smithi112.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 13 MB/s | 283 kB 00:00 2023-10-06T04:36:56.505 INFO:teuthology.orchestra.run.smithi112.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 812 kB/s | 16 kB 00:00 2023-10-06T04:36:56.524 INFO:teuthology.orchestra.run.smithi112.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.7 MB/s | 34 kB 00:00 2023-10-06T04:36:56.532 INFO:teuthology.orchestra.run.smithi179.stdout:(50/120): python3-jaraco-6.2-6.el8.noarch.rpm 68 kB/s | 11 kB 00:00 2023-10-06T04:36:56.545 INFO:teuthology.orchestra.run.smithi112.stdout:(57/120): python3-routes-2.4.1-12.el8.noarch.rp 9.2 MB/s | 196 kB 00:00 2023-10-06T04:36:56.559 INFO:teuthology.orchestra.run.smithi179.stdout:(51/120): python3-kubernetes-11.0.0-6.el8.noarc 12 MB/s | 1.2 MB 00:00 2023-10-06T04:36:56.565 INFO:teuthology.orchestra.run.smithi112.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 3.2 MB/s | 64 kB 00:00 2023-10-06T04:36:56.585 INFO:teuthology.orchestra.run.smithi112.stdout:(59/120): python3-simplegeneric-0.8.1-17.el8.no 968 kB/s | 19 kB 00:00 2023-10-06T04:36:56.604 INFO:teuthology.orchestra.run.smithi112.stdout:(60/120): python3-singledispatch-3.4.0.3-18.el8 1.2 MB/s | 24 kB 00:00 2023-10-06T04:36:56.609 INFO:teuthology.orchestra.run.smithi179.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-10-06T04:36:56.618 INFO:teuthology.orchestra.run.smithi179.stdout:(53/120): python3-google-auth-1.1.1-10.el8.noar 301 kB/s | 81 kB 00:00 2023-10-06T04:36:56.623 INFO:teuthology.orchestra.run.smithi112.stdout:(61/120): python3-tempora-1.14.1-5.el8.noarch.r 1.5 MB/s | 29 kB 00:00 2023-10-06T04:36:56.643 INFO:teuthology.orchestra.run.smithi112.stdout:(62/120): python3-trustme-0.6.0-4.el8.noarch.rp 1.4 MB/s | 27 kB 00:00 2023-10-06T04:36:56.647 INFO:teuthology.orchestra.run.smithi179.stdout:(54/120): python3-logutils-0.3.5-11.el8.noarch. 424 kB/s | 49 kB 00:00 2023-10-06T04:36:56.660 INFO:teuthology.orchestra.run.smithi179.stdout:(55/120): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-10-06T04:36:56.664 INFO:teuthology.orchestra.run.smithi112.stdout:(63/120): python3-waitress-1.4.3-1.el8.noarch.r 12 MB/s | 255 kB 00:00 2023-10-06T04:36:56.685 INFO:teuthology.orchestra.run.smithi112.stdout:(64/120): python3-webob-1.8.5-1.el8.1.noarch.rp 12 MB/s | 251 kB 00:00 2023-10-06T04:36:56.702 INFO:teuthology.orchestra.run.smithi179.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 284 kB/s | 16 kB 00:00 2023-10-06T04:36:56.705 INFO:teuthology.orchestra.run.smithi112.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 3.1 MB/s | 61 kB 00:00 2023-10-06T04:36:56.709 INFO:teuthology.orchestra.run.smithi179.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 686 kB/s | 34 kB 00:00 2023-10-06T04:36:56.725 INFO:teuthology.orchestra.run.smithi112.stdout:(66/120): python3-webtest-2.0.33-1.el8.noarch.r 4.2 MB/s | 85 kB 00:00 2023-10-06T04:36:56.744 INFO:teuthology.orchestra.run.smithi112.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 1.2 MB/s | 23 kB 00:00 2023-10-06T04:36:56.761 INFO:teuthology.orchestra.run.smithi179.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 1.2 MB/s | 64 kB 00:00 2023-10-06T04:36:56.770 INFO:teuthology.orchestra.run.smithi179.stdout:(59/120): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2023-10-06T04:36:56.791 INFO:teuthology.orchestra.run.smithi112.stdout:(68/120): thrift-0.13.0-2.el8.x86_64.rpm 37 MB/s | 1.7 MB 00:00 2023-10-06T04:36:56.795 INFO:teuthology.orchestra.run.smithi112.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 18 MB/s | 70 kB 00:00 2023-10-06T04:36:56.811 INFO:teuthology.orchestra.run.smithi179.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 382 kB/s | 19 kB 00:00 2023-10-06T04:36:56.820 INFO:teuthology.orchestra.run.smithi179.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 477 kB/s | 24 kB 00:00 2023-10-06T04:36:56.844 INFO:teuthology.orchestra.run.smithi179.stdout:(62/120): python3-routes-2.4.1-12.el8.noarch.rp 1.4 MB/s | 196 kB 00:00 2023-10-06T04:36:56.860 INFO:teuthology.orchestra.run.smithi179.stdout:(63/120): python3-tempora-1.14.1-5.el8.noarch.r 597 kB/s | 29 kB 00:00 2023-10-06T04:36:56.872 INFO:teuthology.orchestra.run.smithi179.stdout:(64/120): python3-trustme-0.6.0-4.el8.noarch.rp 540 kB/s | 27 kB 00:00 2023-10-06T04:36:56.906 INFO:teuthology.orchestra.run.smithi112.stdout:(70/120): ceph-radosgw-17.2.6-1274.g68e53a4a.el 2.4 MB/s | 17 MB 00:06 2023-10-06T04:36:56.916 INFO:teuthology.orchestra.run.smithi179.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 4.4 MB/s | 251 kB 00:00 2023-10-06T04:36:56.926 INFO:teuthology.orchestra.run.smithi179.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 1.1 MB/s | 61 kB 00:00 2023-10-06T04:36:56.942 INFO:teuthology.orchestra.run.smithi179.stdout:(67/120): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-10-06T04:36:56.967 INFO:teuthology.orchestra.run.smithi179.stdout:(68/120): python3-webtest-2.0.33-1.el8.noarch.r 1.6 MB/s | 85 kB 00:00 2023-10-06T04:36:56.971 INFO:teuthology.orchestra.run.smithi179.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 16 MB/s | 70 kB 00:00 2023-10-06T04:36:56.976 INFO:teuthology.orchestra.run.smithi179.stdout:(70/120): python3-zc-lockfile-2.0-2.el8.noarch. 457 kB/s | 23 kB 00:00 2023-10-06T04:36:57.071 INFO:teuthology.orchestra.run.smithi112.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 277 kB/s | 44 kB 00:00 2023-10-06T04:36:57.116 INFO:teuthology.orchestra.run.smithi179.stdout:(71/120): thrift-0.13.0-2.el8.x86_64.rpm 10 MB/s | 1.7 MB 00:00 2023-10-06T04:36:57.120 INFO:teuthology.orchestra.run.smithi179.stdout:(72/120): python3-jwt-1.6.1-2.el8.noarch.rpm 297 kB/s | 43 kB 00:00 2023-10-06T04:36:57.121 INFO:teuthology.orchestra.run.smithi179.stdout:(73/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 125 kB/s | 19 kB 00:00 2023-10-06T04:36:57.184 INFO:teuthology.orchestra.run.smithi179.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.4 MB/s | 220 kB 00:00 2023-10-06T04:36:57.189 INFO:teuthology.orchestra.run.smithi179.stdout:(75/120): python3-oauthlib-2.1.0-1.el8.noarch.r 2.1 MB/s | 155 kB 00:00 2023-10-06T04:36:57.232 INFO:teuthology.orchestra.run.smithi179.stdout:(76/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 431 kB/s | 48 kB 00:00 2023-10-06T04:36:57.304 INFO:teuthology.orchestra.run.smithi179.stdout:(77/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2023-10-06T04:36:57.316 INFO:teuthology.orchestra.run.smithi179.stdout:(78/120): python3-requests-oauthlib-1.0.0-1.el8 335 kB/s | 43 kB 00:00 2023-10-06T04:36:57.329 INFO:teuthology.orchestra.run.smithi112.stdout:(72/120): python3-scipy-1.0.0-20.module+el8.1.0 27 MB/s | 15 MB 00:00 2023-10-06T04:36:57.330 INFO:teuthology.orchestra.run.smithi112.stdout:(73/120): python3-jsonpatch-1.21-2.el8.noarch.r 102 kB/s | 27 kB 00:00 2023-10-06T04:36:57.387 INFO:teuthology.orchestra.run.smithi179.stdout:(79/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 214 kB/s | 18 kB 00:00 2023-10-06T04:36:57.398 INFO:teuthology.orchestra.run.smithi179.stdout:(80/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 14 MB/s | 2.3 MB 00:00 2023-10-06T04:36:57.427 INFO:teuthology.orchestra.run.smithi179.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 2.0 MB/s | 83 kB 00:00 2023-10-06T04:36:57.434 INFO:teuthology.orchestra.run.smithi179.stdout:(82/120): pcre2-devel-10.32-2.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2023-10-06T04:36:57.452 INFO:teuthology.orchestra.run.smithi112.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 2.6 MB/s | 320 kB 00:00 2023-10-06T04:36:57.452 INFO:teuthology.orchestra.run.smithi179.stdout:(83/120): elfutils-libelf-devel-0.182-3.el8.x86 1.1 MB/s | 59 kB 00:00 2023-10-06T04:36:57.482 INFO:teuthology.orchestra.run.smithi112.stdout:(75/120): jq-1.5-12.el8.x86_64.rpm 1.0 MB/s | 161 kB 00:00 2023-10-06T04:36:57.516 INFO:teuthology.orchestra.run.smithi179.stdout:(84/120): libquadmath-8.4.1-1.el8.x86_64.rpm 1.9 MB/s | 169 kB 00:00 2023-10-06T04:36:57.518 INFO:teuthology.orchestra.run.smithi179.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 1.3 MB/s | 86 kB 00:00 2023-10-06T04:36:57.564 INFO:teuthology.orchestra.run.smithi179.stdout:(86/120): libcom_err-devel-1.45.6-1.el8.x86_64. 294 kB/s | 38 kB 00:00 2023-10-06T04:36:57.579 INFO:teuthology.orchestra.run.smithi112.stdout:(76/120): python3-babel-2.5.1-5.el8.noarch.rpm 50 MB/s | 4.8 MB 00:00 2023-10-06T04:36:57.588 INFO:teuthology.orchestra.run.smithi112.stdout:(77/120): python3-werkzeug-0.12.2-4.el8.noarch. 3.3 MB/s | 457 kB 00:00 2023-10-06T04:36:57.623 INFO:teuthology.orchestra.run.smithi179.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 446 kB/s | 47 kB 00:00 2023-10-06T04:36:57.625 INFO:teuthology.orchestra.run.smithi179.stdout:(88/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 528 kB/s | 58 kB 00:00 2023-10-06T04:36:57.631 INFO:teuthology.orchestra.run.smithi179.stdout:(89/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 8.2 MB/s | 559 kB 00:00 2023-10-06T04:36:57.638 INFO:teuthology.orchestra.run.smithi112.stdout:(78/120): python3-markupsafe-0.23-19.el8.x86_64 665 kB/s | 39 kB 00:00 2023-10-06T04:36:57.672 INFO:teuthology.orchestra.run.smithi179.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-10-06T04:36:57.688 INFO:teuthology.orchestra.run.smithi112.stdout:(79/120): bison-3.0.4-10.el8.x86_64.rpm 6.7 MB/s | 688 kB 00:00 2023-10-06T04:36:57.689 INFO:teuthology.orchestra.run.smithi179.stdout:(91/120): libgfortran-8.4.1-1.el8.x86_64.rpm 9.5 MB/s | 639 kB 00:00 2023-10-06T04:36:57.700 INFO:teuthology.orchestra.run.smithi112.stdout:(80/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.1 MB/s | 259 kB 00:00 2023-10-06T04:36:57.734 INFO:teuthology.orchestra.run.smithi179.stdout:(92/120): libselinux-devel-2.9-5.el8.x86_64.rpm 1.9 MB/s | 200 kB 00:00 2023-10-06T04:36:57.741 INFO:teuthology.orchestra.run.smithi112.stdout:(81/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 4.2 MB/s | 225 kB 00:00 2023-10-06T04:36:57.755 INFO:teuthology.orchestra.run.smithi112.stdout:(82/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.2 MB/s | 126 kB 00:00 2023-10-06T04:36:57.766 INFO:teuthology.orchestra.run.smithi179.stdout:(93/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 1.0 MB/s | 97 kB 00:00 2023-10-06T04:36:57.824 INFO:teuthology.orchestra.run.smithi112.stdout:(83/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 45 MB/s | 3.7 MB 00:00 2023-10-06T04:36:57.839 INFO:teuthology.orchestra.run.smithi112.stdout:(84/120): oniguruma-6.8.2-2.el8.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2023-10-06T04:36:57.916 INFO:teuthology.orchestra.run.smithi112.stdout:(85/120): python3-jinja2-2.10.1-2.el8_0.noarch. 5.7 MB/s | 538 kB 00:00 2023-10-06T04:36:57.956 INFO:teuthology.orchestra.run.smithi179.stdout:(94/120): python3-scipy-1.0.0-20.module+el8.1.0 54 MB/s | 15 MB 00:00 2023-10-06T04:36:57.957 INFO:teuthology.orchestra.run.smithi179.stdout:(95/120): python3-jsonpatch-1.21-2.el8.noarch.r 139 kB/s | 27 kB 00:00 2023-10-06T04:36:57.958 INFO:teuthology.orchestra.run.smithi179.stdout:(96/120): python3-prettytable-0.7.2-14.el8.noar 197 kB/s | 44 kB 00:00 2023-10-06T04:36:57.973 INFO:teuthology.orchestra.run.smithi112.stdout:(86/120): socat-1.7.3.3-2.el8.x86_64.rpm 2.2 MB/s | 302 kB 00:00 2023-10-06T04:36:58.028 INFO:teuthology.orchestra.run.smithi179.stdout:(97/120): jq-1.5-12.el8.x86_64.rpm 2.2 MB/s | 161 kB 00:00 2023-10-06T04:36:58.033 INFO:teuthology.orchestra.run.smithi179.stdout:(98/120): flex-2.6.1-9.el8.x86_64.rpm 4.1 MB/s | 320 kB 00:00 2023-10-06T04:36:58.043 INFO:teuthology.orchestra.run.smithi112.stdout:(87/120): python3-mako-1.0.6-13.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-10-06T04:36:58.096 INFO:teuthology.orchestra.run.smithi179.stdout:(99/120): python3-werkzeug-0.12.2-4.el8.noarch. 3.3 MB/s | 457 kB 00:00 2023-10-06T04:36:58.140 INFO:teuthology.orchestra.run.smithi112.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 657 kB/s | 110 kB 00:00 2023-10-06T04:36:58.152 INFO:teuthology.orchestra.run.smithi179.stdout:(100/120): python3-markupsafe-0.23-19.el8.x86_6 329 kB/s | 39 kB 00:00 2023-10-06T04:36:58.222 INFO:teuthology.orchestra.run.smithi179.stdout:(101/120): python3-babel-2.5.1-5.el8.noarch.rpm 25 MB/s | 4.8 MB 00:00 2023-10-06T04:36:58.239 INFO:teuthology.orchestra.run.smithi179.stdout:(102/120): bison-3.0.4-10.el8.x86_64.rpm 4.7 MB/s | 688 kB 00:00 2023-10-06T04:36:58.265 INFO:teuthology.orchestra.run.smithi179.stdout:(103/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.2 MB/s | 259 kB 00:00 2023-10-06T04:36:58.285 INFO:teuthology.orchestra.run.smithi179.stdout:(104/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 3.5 MB/s | 225 kB 00:00 2023-10-06T04:36:58.361 INFO:teuthology.orchestra.run.smithi179.stdout:(105/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.0 MB/s | 126 kB 00:00 2023-10-06T04:36:58.368 INFO:teuthology.orchestra.run.smithi179.stdout:(106/120): oniguruma-6.8.2-2.el8.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2023-10-06T04:36:58.486 INFO:teuthology.orchestra.run.smithi179.stdout:(107/120): python3-jinja2-2.10.1-2.el8_0.noarch 4.2 MB/s | 538 kB 00:00 2023-10-06T04:36:58.541 INFO:teuthology.orchestra.run.smithi179.stdout:(108/120): python3-numpy-1.14.3-9.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2023-10-06T04:36:58.545 INFO:teuthology.orchestra.run.smithi179.stdout:(109/120): socat-1.7.3.3-2.el8.x86_64.rpm 1.7 MB/s | 302 kB 00:00 2023-10-06T04:36:58.573 INFO:teuthology.orchestra.run.smithi112.stdout:(89/120): ceph-test-17.2.6-1274.g68e53a4a.el8.x 6.9 MB/s | 52 MB 00:07 2023-10-06T04:36:58.575 INFO:teuthology.orchestra.run.smithi112.stdout:(90/120): python3-jsonpointer-1.10-11.el8.noarc 46 kB/s | 20 kB 00:00 2023-10-06T04:36:58.579 INFO:teuthology.orchestra.run.smithi112.stdout:(91/120): librdkafka-0.11.4-1.el8.x86_64.rpm 659 kB/s | 353 kB 00:00 2023-10-06T04:36:58.589 INFO:teuthology.orchestra.run.smithi179.stdout:(110/120): python3-mako-1.0.6-13.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2023-10-06T04:36:58.676 INFO:teuthology.orchestra.run.smithi112.stdout:(92/120): python3-pytz-2017.2-9.el8.noarch.rpm 537 kB/s | 54 kB 00:00 2023-10-06T04:36:58.683 INFO:teuthology.orchestra.run.smithi112.stdout:(93/120): libtool-2.4.6-25.el8.x86_64.rpm 6.4 MB/s | 709 kB 00:00 2023-10-06T04:36:58.692 INFO:teuthology.orchestra.run.smithi179.stdout:(111/120): python3-pyasn1-modules-0.3.7-6.el8.n 732 kB/s | 110 kB 00:00 2023-10-06T04:36:58.737 INFO:teuthology.orchestra.run.smithi112.stdout:(94/120): openblas-threads-0.3.12-1.el8.x86_64. 30 MB/s | 4.7 MB 00:00 2023-10-06T04:36:58.754 INFO:teuthology.orchestra.run.smithi179.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 122 kB/s | 20 kB 00:00 2023-10-06T04:36:58.771 INFO:teuthology.orchestra.run.smithi179.stdout:(113/120): librdkafka-0.11.4-1.el8.x86_64.rpm 1.5 MB/s | 353 kB 00:00 2023-10-06T04:36:58.831 INFO:teuthology.orchestra.run.smithi112.stdout:(95/120): openblas-0.3.12-1.el8.x86_64.rpm 30 MB/s | 4.6 MB 00:00 2023-10-06T04:36:58.839 INFO:teuthology.orchestra.run.smithi112.stdout:(96/120): automake-1.16.1-7.el8.noarch.rpm 4.5 MB/s | 713 kB 00:00 2023-10-06T04:36:58.858 INFO:teuthology.orchestra.run.smithi179.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 4.2 MB/s | 709 kB 00:00 2023-10-06T04:36:58.884 INFO:teuthology.orchestra.run.smithi112.stdout:(97/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 127 kB/s | 19 kB 00:00 2023-10-06T04:36:58.926 INFO:teuthology.orchestra.run.smithi112.stdout:(98/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2023-10-06T04:36:58.941 INFO:teuthology.orchestra.run.smithi179.stdout:(115/120): python3-pytz-2017.2-9.el8.noarch.rpm 290 kB/s | 54 kB 00:00 2023-10-06T04:36:58.946 INFO:teuthology.orchestra.run.smithi112.stdout:(99/120): python3-jwt-1.6.1-2.el8.noarch.rpm 371 kB/s | 43 kB 00:00 2023-10-06T04:36:58.951 INFO:teuthology.orchestra.run.smithi112.stdout:(100/120): python3-oauthlib-2.1.0-1.el8.noarch. 1.4 MB/s | 155 kB 00:00 2023-10-06T04:36:58.970 INFO:teuthology.orchestra.run.smithi179.stdout:(116/120): openblas-threads-0.3.12-1.el8.x86_64 24 MB/s | 4.7 MB 00:00 2023-10-06T04:36:59.006 INFO:teuthology.orchestra.run.smithi112.stdout:(101/120): keyutils-libs-devel-1.5.10-6.el8.x86 599 kB/s | 48 kB 00:00 2023-10-06T04:36:59.039 INFO:teuthology.orchestra.run.smithi179.stdout:(117/120): automake-1.16.1-7.el8.noarch.rpm 7.1 MB/s | 713 kB 00:00 2023-10-06T04:36:59.067 INFO:teuthology.orchestra.run.smithi112.stdout:(102/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2023-10-06T04:36:59.082 INFO:teuthology.orchestra.run.smithi112.stdout:(103/120): python3-requests-oauthlib-1.0.0-1.el 325 kB/s | 43 kB 00:00 2023-10-06T04:36:59.096 INFO:teuthology.orchestra.run.smithi179.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 19 MB/s | 4.6 MB 00:00 2023-10-06T04:36:59.140 INFO:teuthology.orchestra.run.smithi112.stdout:(104/120): openssl-devel-1.1.1g-15.el8_3.x86_64 17 MB/s | 2.3 MB 00:00 2023-10-06T04:36:59.141 INFO:teuthology.orchestra.run.smithi112.stdout:(105/120): libverto-devel-0.3.0-5.el8.x86_64.rp 242 kB/s | 18 kB 00:00 2023-10-06T04:36:59.189 INFO:teuthology.orchestra.run.smithi112.stdout:(106/120): pcre2-devel-10.32-2.el8.x86_64.rpm 5.5 MB/s | 605 kB 00:00 2023-10-06T04:36:59.257 INFO:teuthology.orchestra.run.smithi112.stdout:(107/120): elfutils-libelf-devel-0.182-3.el8.x8 506 kB/s | 59 kB 00:00 2023-10-06T04:36:59.278 INFO:teuthology.orchestra.run.smithi112.stdout:(108/120): fuse-2.9.7-12.el8.x86_64.rpm 598 kB/s | 83 kB 00:00 2023-10-06T04:36:59.376 INFO:teuthology.orchestra.run.smithi112.stdout:(109/120): libsepol-devel-2.9-2.el8.x86_64.rpm 887 kB/s | 86 kB 00:00 2023-10-06T04:36:59.378 INFO:teuthology.orchestra.run.smithi112.stdout:(110/120): libquadmath-8.4.1-1.el8.x86_64.rpm 899 kB/s | 169 kB 00:00 2023-10-06T04:36:59.409 INFO:teuthology.orchestra.run.smithi112.stdout:(111/120): libcom_err-devel-1.45.6-1.el8.x86_64 252 kB/s | 38 kB 00:00 2023-10-06T04:36:59.425 INFO:teuthology.orchestra.run.smithi179.stdout:(119/120): librbd1-17.2.6-1274.g68e53a4a.el8.x8 9.2 MB/s | 3.5 MB 00:00 2023-10-06T04:36:59.466 INFO:teuthology.orchestra.run.smithi112.stdout:(112/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 536 kB/s | 47 kB 00:00 2023-10-06T04:36:59.476 INFO:teuthology.orchestra.run.smithi179.stdout:(120/120): librados2-17.2.6-1274.g68e53a4a.el8. 6.7 MB/s | 3.4 MB 00:00 2023-10-06T04:36:59.481 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2023-10-06T04:36:59.481 INFO:teuthology.orchestra.run.smithi179.stdout:Total 16 MB/s | 201 MB 00:12 2023-10-06T04:36:59.524 INFO:teuthology.orchestra.run.smithi112.stdout:(113/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 390 kB/s | 58 kB 00:00 2023-10-06T04:36:59.528 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2023-10-06T04:36:59.540 INFO:teuthology.orchestra.run.smithi112.stdout:(114/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 4.2 MB/s | 559 kB 00:00 2023-10-06T04:36:59.549 INFO:teuthology.orchestra.run.smithi112.stdout:(115/120): libgfortran-8.4.1-1.el8.x86_64.rpm 7.5 MB/s | 639 kB 00:00 2023-10-06T04:36:59.571 INFO:teuthology.orchestra.run.smithi112.stdout:(116/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 1.4 MB/s | 70 kB 00:00 2023-10-06T04:36:59.584 INFO:teuthology.orchestra.run.smithi112.stdout:(117/120): libuuid-devel-2.32.1-27.el8.x86_64.r 2.7 MB/s | 97 kB 00:00 2023-10-06T04:36:59.620 INFO:teuthology.orchestra.run.smithi112.stdout:(118/120): libselinux-devel-2.9-5.el8.x86_64.rp 2.4 MB/s | 200 kB 00:00 2023-10-06T04:36:59.641 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2023-10-06T04:36:59.641 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2023-10-06T04:36:59.973 INFO:teuthology.orchestra.run.smithi112.stdout:(119/120): librados2-17.2.6-1274.g68e53a4a.el8. 8.5 MB/s | 3.4 MB 00:00 2023-10-06T04:37:00.380 INFO:teuthology.orchestra.run.smithi112.stdout:(120/120): librbd1-17.2.6-1274.g68e53a4a.el8.x8 4.5 MB/s | 3.5 MB 00:00 2023-10-06T04:37:00.384 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2023-10-06T04:37:00.384 INFO:teuthology.orchestra.run.smithi112.stdout:Total 15 MB/s | 201 MB 00:13 2023-10-06T04:37:00.436 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2023-10-06T04:37:00.552 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2023-10-06T04:37:00.552 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2023-10-06T04:37:01.398 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2023-10-06T04:37:01.403 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2023-10-06T04:37:02.310 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2023-10-06T04:37:02.314 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2023-10-06T04:37:06.424 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2023-10-06T04:37:06.698 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T04:37:06.902 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T04:37:06.902 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2023-10-06T04:37:07.022 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T04:37:07.081 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T04:37:07.218 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T04:37:07.295 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-06T04:37:07.479 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T04:37:07.609 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T04:37:07.611 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T04:37:07.826 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/122 2023-10-06T04:37:07.828 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T04:37:08.209 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T04:37:08.209 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/122 2023-10-06T04:37:08.429 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T04:37:08.435 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T04:37:08.827 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T04:37:08.993 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T04:37:09.054 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:37:09.182 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:37:09.226 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:37:09.309 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:37:09.403 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:37:09.493 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:37:09.523 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:37:09.834 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/122 2023-10-06T04:37:09.856 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-06T04:37:10.509 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T04:37:10.586 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T04:37:10.703 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:37:10.734 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:37:10.809 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:37:10.850 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:37:11.099 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T04:37:11.114 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T04:37:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T04:37:11.283 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T04:37:11.517 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:37:11.537 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:37:11.616 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:37:11.784 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T04:37:11.817 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:37:11.845 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T04:37:11.978 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T04:37:12.046 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T04:37:12.047 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-06T04:37:12.187 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-06T04:37:12.317 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-06T04:37:12.378 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T04:37:12.516 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-06T04:37:12.519 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T04:37:12.685 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-06T04:37:12.720 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T04:37:12.834 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T04:37:12.989 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T04:37:13.159 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T04:37:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T04:37:13.436 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T04:37:13.716 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T04:37:13.934 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T04:37:13.964 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T04:37:14.169 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T04:37:14.476 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T04:37:14.800 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T04:37:14.876 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T04:37:15.148 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-06T04:37:15.343 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-06T04:37:15.507 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-06T04:37:15.536 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T04:37:15.775 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-06T04:37:15.804 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-06T04:37:16.054 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-06T04:37:16.079 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-06T04:37:16.297 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T04:37:16.314 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T04:37:16.465 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 26/122 2023-10-06T04:37:16.509 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 26/122 2023-10-06T04:37:16.628 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 27/122 2023-10-06T04:37:16.638 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 27/122 2023-10-06T04:37:16.885 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 28/122 2023-10-06T04:37:16.909 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 28/122 2023-10-06T04:37:17.124 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-06T04:37:17.418 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-06T04:37:17.658 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T04:37:18.114 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-06T04:37:18.432 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-06T04:37:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-06T04:37:19.008 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-06T04:37:19.286 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-06T04:37:19.527 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T04:37:19.752 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T04:37:20.084 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-06T04:37:21.161 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-06T04:37:21.508 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-06T04:37:21.605 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T04:37:21.762 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-06T04:37:21.998 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T04:37:22.014 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-06T04:37:22.219 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T04:37:22.232 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T04:37:22.426 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 38/122 2023-10-06T04:37:22.472 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T04:37:22.610 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 39/122 2023-10-06T04:37:22.678 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 38/122 2023-10-06T04:37:22.893 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 40/122 2023-10-06T04:37:22.898 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 39/122 2023-10-06T04:37:23.082 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 40/122 2023-10-06T04:37:23.124 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-06T04:37:23.293 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-06T04:37:23.316 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-06T04:37:23.465 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-06T04:37:23.520 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-06T04:37:23.661 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-06T04:37:23.728 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-06T04:37:23.821 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-06T04:37:23.908 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T04:37:23.965 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-06T04:37:23.985 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T04:37:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-06T04:37:24.191 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-06T04:37:24.304 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-06T04:37:24.350 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-06T04:37:24.531 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-06T04:37:24.624 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-06T04:37:24.713 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-06T04:37:24.888 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-06T04:37:24.923 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-06T04:37:25.085 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-06T04:37:25.159 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-06T04:37:25.236 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-06T04:37:25.423 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-06T04:37:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-06T04:37:25.593 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-06T04:37:25.709 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-06T04:37:25.859 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-06T04:37:25.887 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-06T04:37:26.022 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-06T04:37:26.213 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-06T04:37:26.213 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-06T04:37:26.377 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T04:37:26.485 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-06T04:37:26.495 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T04:37:26.660 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-06T04:37:26.719 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-06T04:37:26.820 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-06T04:37:26.882 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T04:37:27.010 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T04:37:27.070 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T04:37:27.173 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T04:37:27.329 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T04:37:27.457 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T04:37:27.557 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T04:37:27.685 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T04:37:27.755 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T04:37:27.917 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T04:37:27.937 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T04:37:28.065 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T04:37:28.084 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T04:37:28.221 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T04:37:28.282 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T04:37:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T04:37:28.485 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T04:37:28.640 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T04:37:28.692 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T04:37:28.855 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T04:37:28.910 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T04:37:29.076 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T04:37:29.105 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T04:37:29.302 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T04:37:29.310 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T04:37:29.527 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T04:37:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T04:37:29.779 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T04:37:29.831 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T04:37:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T04:37:30.111 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T04:37:30.328 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T04:37:30.398 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T04:37:30.567 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T04:37:30.606 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T04:37:30.774 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T04:37:30.889 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T04:37:31.000 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T04:37:32.044 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T04:37:32.179 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T04:37:32.371 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T04:37:32.540 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T04:37:32.642 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T04:37:32.819 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T04:37:32.990 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T04:37:33.158 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T04:37:33.231 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T04:37:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T04:37:33.591 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T04:37:33.774 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T04:37:33.817 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T04:37:34.008 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T04:37:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T04:37:34.218 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T04:37:34.231 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T04:37:34.442 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T04:37:39.195 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:37:39.422 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:37:39.559 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:37:39.833 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:37:40.006 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:37:40.422 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:37:40.686 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T04:37:40.786 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T04:37:40.933 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T04:37:41.031 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T04:37:41.131 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T04:37:41.280 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T04:37:58.541 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T04:37:58.541 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /sys 2023-10-06T04:37:58.541 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /proc 2023-10-06T04:37:58.541 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /dev 2023-10-06T04:37:58.541 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /run 2023-10-06T04:37:58.541 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /mnt 2023-10-06T04:37:58.541 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /var/tmp 2023-10-06T04:37:58.541 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /home 2023-10-06T04:37:58.542 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /tmp 2023-10-06T04:37:58.542 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /dev 2023-10-06T04:37:58.542 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:37:58.910 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T04:37:58.910 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /sys 2023-10-06T04:37:58.910 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /proc 2023-10-06T04:37:58.910 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /dev 2023-10-06T04:37:58.910 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /run 2023-10-06T04:37:58.910 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /mnt 2023-10-06T04:37:58.910 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /var/tmp 2023-10-06T04:37:58.911 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /home 2023-10-06T04:37:58.911 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /tmp 2023-10-06T04:37:58.911 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /dev 2023-10-06T04:37:58.911 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:37:58.922 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T04:37:59.295 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T04:38:00.408 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T04:38:00.617 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T04:38:00.786 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T04:38:00.839 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T04:38:00.986 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T04:38:00.997 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T04:38:01.208 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T04:38:01.369 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T04:38:01.394 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T04:38:01.539 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T04:38:01.556 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T04:38:01.768 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T04:38:01.961 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T04:38:01.978 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T04:38:04.455 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T04:38:04.636 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T04:38:04.720 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T04:38:04.803 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 95/122 2023-10-06T04:38:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T04:38:04.985 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 96/122 2023-10-06T04:38:05.058 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 95/122 2023-10-06T04:38:05.163 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T04:38:05.255 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 96/122 2023-10-06T04:38:05.379 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T04:38:05.410 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T04:38:05.608 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T04:38:05.627 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T04:38:05.826 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T04:38:06.578 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T04:38:06.754 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T04:38:06.796 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T04:38:06.853 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T04:38:06.968 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T04:38:07.068 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T04:38:07.247 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 100/122 2023-10-06T04:38:07.400 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T04:38:07.437 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T04:38:07.465 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 100/122 2023-10-06T04:38:07.629 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T04:38:07.641 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T04:38:07.652 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T04:38:07.689 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T04:38:07.834 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T04:38:07.846 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T04:38:09.228 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 103/122 2023-10-06T04:38:09.437 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 103/122 2023-10-06T04:38:09.458 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T04:38:09.588 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T04:38:09.668 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T04:38:09.746 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T04:38:09.758 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T04:38:09.789 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T04:38:09.918 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T04:38:09.970 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T04:38:09.979 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T04:38:10.160 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T04:38:10.327 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T04:38:10.509 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T04:38:10.512 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T04:38:10.693 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T04:38:15.433 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T04:38:15.673 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T04:38:15.778 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 108/122 2023-10-06T04:38:15.928 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T04:38:16.630 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 108/122 2023-10-06T04:38:16.641 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T04:38:17.011 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-06T04:38:17.015 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-06T04:38:17.202 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 111/122 2023-10-06T04:38:17.208 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 110/122 2023-10-06T04:38:17.423 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-06T04:38:17.483 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-06T04:38:17.599 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 113/122 2023-10-06T04:38:17.641 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T04:38:17.653 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T04:38:17.783 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T04:38:17.821 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 113/122 2023-10-06T04:38:17.936 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 115/122 2023-10-06T04:38:17.971 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T04:38:18.128 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 116/122 2023-10-06T04:38:18.141 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 115/122 2023-10-06T04:38:18.296 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 117/122 2023-10-06T04:38:18.383 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 116/122 2023-10-06T04:38:18.519 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-06T04:38:18.660 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 117/122 2023-10-06T04:38:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T04:38:18.804 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T04:38:18.849 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T04:38:18.917 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T04:38:19.011 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T04:38:19.021 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T04:38:19.021 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T04:38:19.116 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T04:38:19.125 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T04:38:19.239 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T04:38:19.239 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:38:19.285 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-06T04:38:19.285 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T04:38:19.494 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T04:38:19.494 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:38:20.104 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:38:20.104 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 1/122 2023-10-06T04:38:20.104 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2/122 2023-10-06T04:38:20.104 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 3/122 2023-10-06T04:38:20.104 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/122 2023-10-06T04:38:20.104 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 5/122 2023-10-06T04:38:20.104 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:38:20.105 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:38:20.105 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/122 2023-10-06T04:38:20.105 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/122 2023-10-06T04:38:20.105 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:38:20.105 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 11/122 2023-10-06T04:38:20.105 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 12/122 2023-10-06T04:38:20.105 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:38:20.105 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 14/122 2023-10-06T04:38:20.105 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 15/122 2023-10-06T04:38:20.105 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 16/122 2023-10-06T04:38:20.105 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 17/122 2023-10-06T04:38:20.105 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/122 2023-10-06T04:38:20.106 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 19/122 2023-10-06T04:38:20.106 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 20/122 2023-10-06T04:38:20.106 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 21/122 2023-10-06T04:38:20.106 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 22/122 2023-10-06T04:38:20.106 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 23/122 2023-10-06T04:38:20.106 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 24/122 2023-10-06T04:38:20.106 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 25/122 2023-10-06T04:38:20.106 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 26/122 2023-10-06T04:38:20.106 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 27/122 2023-10-06T04:38:20.106 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 28/122 2023-10-06T04:38:20.106 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 29/122 2023-10-06T04:38:20.107 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 30/122 2023-10-06T04:38:20.107 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 31/122 2023-10-06T04:38:20.107 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 32/122 2023-10-06T04:38:20.107 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 33/122 2023-10-06T04:38:20.107 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 34/122 2023-10-06T04:38:20.107 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 35/122 2023-10-06T04:38:20.107 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 36/122 2023-10-06T04:38:20.107 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 37/122 2023-10-06T04:38:20.107 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 38/122 2023-10-06T04:38:20.107 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T04:38:20.107 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T04:38:20.108 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T04:38:20.108 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T04:38:20.108 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T04:38:20.108 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T04:38:20.108 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T04:38:20.108 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T04:38:20.108 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T04:38:20.108 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T04:38:20.108 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T04:38:20.108 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T04:38:20.108 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T04:38:20.108 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T04:38:20.109 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T04:38:20.109 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T04:38:20.109 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T04:38:20.109 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T04:38:20.109 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T04:38:20.109 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T04:38:20.109 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T04:38:20.109 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T04:38:20.109 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T04:38:20.109 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T04:38:20.109 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T04:38:20.109 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T04:38:20.110 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T04:38:20.110 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T04:38:20.110 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T04:38:20.110 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T04:38:20.110 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T04:38:20.110 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T04:38:20.110 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T04:38:20.110 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-06T04:38:20.110 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-06T04:38:20.110 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-06T04:38:20.110 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-06T04:38:20.111 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-06T04:38:20.111 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-06T04:38:20.111 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-06T04:38:20.111 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-06T04:38:20.111 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-06T04:38:20.111 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-06T04:38:20.111 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-06T04:38:20.111 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-06T04:38:20.111 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-06T04:38:20.111 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-06T04:38:20.112 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-06T04:38:20.112 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-06T04:38:20.112 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-06T04:38:20.112 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-06T04:38:20.112 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-06T04:38:20.112 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-06T04:38:20.112 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-06T04:38:20.112 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-06T04:38:20.112 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-06T04:38:20.112 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-06T04:38:20.112 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-06T04:38:20.113 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-06T04:38:20.113 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-06T04:38:20.113 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-06T04:38:20.113 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-06T04:38:20.113 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-06T04:38:20.113 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-06T04:38:20.113 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-06T04:38:20.113 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-06T04:38:20.113 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-06T04:38:20.113 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-06T04:38:20.113 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-06T04:38:20.114 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-06T04:38:20.114 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-06T04:38:20.114 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-06T04:38:20.114 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-06T04:38:20.114 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-06T04:38:20.114 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-06T04:38:20.114 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-06T04:38:20.114 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-06T04:38:20.114 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-06T04:38:20.114 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-06T04:38:20.114 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-06T04:38:20.115 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 119/122 2023-10-06T04:38:20.115 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T04:38:20.115 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 121/122 2023-10-06T04:38:20.359 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:38:20.359 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 1/122 2023-10-06T04:38:20.360 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2/122 2023-10-06T04:38:20.360 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 3/122 2023-10-06T04:38:20.360 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/122 2023-10-06T04:38:20.360 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 5/122 2023-10-06T04:38:20.360 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:38:20.360 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:38:20.360 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/122 2023-10-06T04:38:20.360 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/122 2023-10-06T04:38:20.360 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:38:20.360 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 11/122 2023-10-06T04:38:20.360 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 12/122 2023-10-06T04:38:20.360 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:38:20.361 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 14/122 2023-10-06T04:38:20.361 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 15/122 2023-10-06T04:38:20.361 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 16/122 2023-10-06T04:38:20.361 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 17/122 2023-10-06T04:38:20.361 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/122 2023-10-06T04:38:20.361 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 19/122 2023-10-06T04:38:20.361 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 20/122 2023-10-06T04:38:20.361 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 21/122 2023-10-06T04:38:20.361 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 22/122 2023-10-06T04:38:20.361 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 23/122 2023-10-06T04:38:20.361 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 24/122 2023-10-06T04:38:20.361 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 25/122 2023-10-06T04:38:20.362 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 26/122 2023-10-06T04:38:20.362 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 27/122 2023-10-06T04:38:20.362 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 28/122 2023-10-06T04:38:20.362 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 29/122 2023-10-06T04:38:20.362 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 30/122 2023-10-06T04:38:20.362 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 31/122 2023-10-06T04:38:20.362 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 32/122 2023-10-06T04:38:20.362 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 33/122 2023-10-06T04:38:20.362 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 34/122 2023-10-06T04:38:20.362 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 35/122 2023-10-06T04:38:20.362 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 36/122 2023-10-06T04:38:20.362 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 37/122 2023-10-06T04:38:20.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 38/122 2023-10-06T04:38:20.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T04:38:20.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T04:38:20.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T04:38:20.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T04:38:20.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T04:38:20.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T04:38:20.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T04:38:20.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T04:38:20.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T04:38:20.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T04:38:20.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T04:38:20.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T04:38:20.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T04:38:20.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T04:38:20.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T04:38:20.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T04:38:20.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T04:38:20.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T04:38:20.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T04:38:20.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T04:38:20.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T04:38:20.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T04:38:20.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T04:38:20.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T04:38:20.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T04:38:20.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T04:38:20.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T04:38:20.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T04:38:20.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T04:38:20.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T04:38:20.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T04:38:20.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T04:38:20.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T04:38:20.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-06T04:38:20.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-06T04:38:20.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-06T04:38:20.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-06T04:38:20.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-06T04:38:20.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-06T04:38:20.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-06T04:38:20.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-06T04:38:20.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-06T04:38:20.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-06T04:38:20.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-06T04:38:20.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-06T04:38:20.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-06T04:38:20.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-06T04:38:20.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-06T04:38:20.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-06T04:38:20.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-06T04:38:20.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-06T04:38:20.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-06T04:38:20.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-06T04:38:20.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-06T04:38:20.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-06T04:38:20.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-06T04:38:20.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-06T04:38:20.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-06T04:38:20.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-06T04:38:20.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-06T04:38:20.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-06T04:38:20.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-06T04:38:20.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-06T04:38:20.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-06T04:38:20.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-06T04:38:20.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-06T04:38:20.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-06T04:38:20.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-06T04:38:20.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-06T04:38:20.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-06T04:38:20.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-06T04:38:20.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-06T04:38:20.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-06T04:38:20.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-06T04:38:20.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-06T04:38:20.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-06T04:38:20.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-06T04:38:20.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-06T04:38:20.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-06T04:38:20.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-06T04:38:20.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 119/122 2023-10-06T04:38:20.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T04:38:20.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 121/122 2023-10-06T04:38:22.408 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:38:22.408 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:45 ago on Fri 06 Oct 2023 04:36:37 AM UTC. 2023-10-06T04:38:22.503 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:38:22.503 INFO:teuthology.orchestra.run.smithi179.stdout:Last metadata expiration check: 0:01:44 ago on Fri 06 Oct 2023 04:36:38 AM UTC. 2023-10-06T04:38:24.646 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2023-10-06T04:38:24.770 INFO:teuthology.orchestra.run.smithi179.stdout:Installed products updated. 2023-10-06T04:38:24.828 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:24.828 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2023-10-06T04:38:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.829 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2023-10-06T04:38:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T04:38:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T04:38:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.829 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:38:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:38:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:38:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:38:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:38:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:38:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.830 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:38:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:38:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:38:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:38:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T04:38:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T04:38:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T04:38:24.831 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T04:38:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: jq-1.5-12.el8.x86_64 2023-10-06T04:38:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T04:38:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T04:38:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T04:38:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T04:38:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T04:38:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T04:38:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T04:38:24.832 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T04:38:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T04:38:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T04:38:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T04:38:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T04:38:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T04:38:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T04:38:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T04:38:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T04:38:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T04:38:24.833 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T04:38:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T04:38:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T04:38:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T04:38:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T04:38:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T04:38:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T04:38:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T04:38:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T04:38:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T04:38:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T04:38:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T04:38:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T04:38:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T04:38:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T04:38:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T04:38:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T04:38:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T04:38:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T04:38:24.835 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T04:38:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T04:38:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T04:38:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T04:38:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T04:38:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T04:38:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T04:38:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T04:38:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T04:38:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T04:38:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T04:38:24.836 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T04:38:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T04:38:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T04:38:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T04:38:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T04:38:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T04:38:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T04:38:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T04:38:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.837 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T04:38:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T04:38:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T04:38:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T04:38:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T04:38:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T04:38:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T04:38:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T04:38:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T04:38:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T04:38:24.838 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T04:38:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T04:38:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T04:38:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T04:38:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T04:38:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T04:38:24.839 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T04:38:24.840 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T04:38:24.840 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:24.840 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2023-10-06T04:38:24.932 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:24.932 INFO:teuthology.orchestra.run.smithi179.stdout:Upgraded: 2023-10-06T04:38:24.933 INFO:teuthology.orchestra.run.smithi179.stdout: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.933 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.933 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2023-10-06T04:38:24.933 INFO:teuthology.orchestra.run.smithi179.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T04:38:24.933 INFO:teuthology.orchestra.run.smithi179.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T04:38:24.934 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.934 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.934 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.934 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.934 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:38:24.934 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.935 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.935 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.935 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:38:24.935 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:38:24.935 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:38:24.935 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:38:24.935 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:38:24.936 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.936 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.936 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:38:24.936 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.936 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.936 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.937 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:38:24.937 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:38:24.937 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.937 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:38:24.937 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T04:38:24.938 INFO:teuthology.orchestra.run.smithi179.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T04:38:24.938 INFO:teuthology.orchestra.run.smithi179.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T04:38:24.938 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T04:38:24.938 INFO:teuthology.orchestra.run.smithi179.stdout: jq-1.5-12.el8.x86_64 2023-10-06T04:38:24.938 INFO:teuthology.orchestra.run.smithi179.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T04:38:24.938 INFO:teuthology.orchestra.run.smithi179.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T04:38:24.938 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T04:38:24.939 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.939 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.939 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.939 INFO:teuthology.orchestra.run.smithi179.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T04:38:24.939 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T04:38:24.939 INFO:teuthology.orchestra.run.smithi179.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T04:38:24.940 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T04:38:24.940 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T04:38:24.940 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.941 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.941 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T04:38:24.941 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.941 INFO:teuthology.orchestra.run.smithi179.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T04:38:24.941 INFO:teuthology.orchestra.run.smithi179.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T04:38:24.941 INFO:teuthology.orchestra.run.smithi179.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T04:38:24.942 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T04:38:24.942 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T04:38:24.942 INFO:teuthology.orchestra.run.smithi179.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T04:38:24.942 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T04:38:24.942 INFO:teuthology.orchestra.run.smithi179.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T04:38:24.942 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T04:38:24.943 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T04:38:24.943 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T04:38:24.943 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T04:38:24.943 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T04:38:24.943 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T04:38:24.943 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T04:38:24.944 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T04:38:24.944 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T04:38:24.944 INFO:teuthology.orchestra.run.smithi179.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T04:38:24.944 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T04:38:24.945 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.945 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.945 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.945 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T04:38:24.945 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T04:38:24.945 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T04:38:24.946 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T04:38:24.946 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T04:38:24.946 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T04:38:24.946 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T04:38:24.946 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T04:38:24.946 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T04:38:24.947 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T04:38:24.947 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T04:38:24.947 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T04:38:24.947 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T04:38:24.947 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T04:38:24.947 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T04:38:24.947 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T04:38:24.948 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T04:38:24.948 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T04:38:24.948 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T04:38:24.948 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T04:38:24.948 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T04:38:24.948 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T04:38:24.949 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T04:38:24.949 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T04:38:24.949 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T04:38:24.949 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.949 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.949 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T04:38:24.949 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T04:38:24.950 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.950 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T04:38:24.950 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T04:38:24.950 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T04:38:24.950 INFO:teuthology.orchestra.run.smithi179.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T04:38:24.951 INFO:teuthology.orchestra.run.smithi179.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T04:38:24.951 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T04:38:24.951 INFO:teuthology.orchestra.run.smithi179.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T04:38:24.951 INFO:teuthology.orchestra.run.smithi179.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T04:38:24.951 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T04:38:24.951 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T04:38:24.951 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T04:38:24.952 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T04:38:24.952 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T04:38:24.952 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.952 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.952 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:38:24.952 INFO:teuthology.orchestra.run.smithi179.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T04:38:24.952 INFO:teuthology.orchestra.run.smithi179.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T04:38:24.953 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T04:38:24.953 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T04:38:24.954 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T04:38:24.954 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:24.954 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2023-10-06T04:38:25.118 DEBUG:teuthology.parallel:result is None 2023-10-06T04:38:25.186 DEBUG:teuthology.parallel:result is None 2023-10-06T04:38:25.187 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:38:25.405 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T04:38:25.427 INFO:teuthology.orchestra.run.smithi112.stdout:17.2.6-1274.g68e53a4a.el8 2023-10-06T04:38:25.427 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274.g68e53a4a.el8 2023-10-06T04:38:25.427 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274.g68e53a4a is installed. 2023-10-06T04:38:25.428 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:38:25.569 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T04:38:25.591 INFO:teuthology.orchestra.run.smithi179.stdout:17.2.6-1274.g68e53a4a.el8 2023-10-06T04:38:25.591 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274.g68e53a4a.el8 2023-10-06T04:38:25.592 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274.g68e53a4a is installed. 2023-10-06T04:38:25.592 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T04:38:25.592 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:38:25.592 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T04:38:25.630 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:38:25.630 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T04:38:25.670 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T04:38:25.671 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:38:25.671 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T04:38:25.695 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T04:38:25.759 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:38:25.760 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T04:38:25.785 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T04:38:25.849 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T04:38:25.849 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:38:25.849 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T04:38:25.873 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T04:38:25.937 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:38:25.937 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T04:38:25.961 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T04:38:26.025 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T04:38:26.025 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:38:26.025 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T04:38:26.049 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T04:38:26.112 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:38:26.112 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T04:38:26.136 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T04:38:26.200 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T04:38:26.294 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T04:38:26.294 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /var/log/ceph 2023-10-06T04:38:26.297 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 777 /var/log/ceph 2023-10-06T04:38:26.321 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T04:38:26.321 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T04:38:26.361 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T04:38:26.385 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T04:38:26.385 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T04:38:26.425 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T04:38:26.456 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T04:38:26.456 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T04:38:26.456 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T04:38:26.456 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:38:26.457 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T04:38:26.501 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T04:38:26.609 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T04:38:26.634 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:38:26.634 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T04:38:26.649 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T04:38:26.757 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T04:38:26.786 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T04:38:26.786 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T04:38:26.786 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412285', 'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412285', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4002, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'targets': {'smithi112.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJsRpR60QY6/djFjGFx1U1QUBPfvDNOFoTsg8aYq7v/ox/m17tCw0bAhX2Xt+g7F/+kKgoscICYAM24k9irbb+U=', 'smithi179.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDzZEoCEQEHA5sl0fCfjXNw2SJAIjF9UHBJtEiPDjyFy3v9wiesRUT0oqBTmLJUlZOM/ExDMn/Vpt8k2DNXW11o='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, {'ceph': None}, {'kclient': None}, {'check-counter': {'counters': {'mgr': [{'min': 4, 'name': 'finisher-volumes.complete_latency.avgcount'}, {'expected_val': 0, 'name': 'finisher-volumes.queue_len'}]}}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestPerModuleFinsherThread']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:54:57', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T04:38:26.787 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T04:38:26.789 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T04:38:26.838 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T04:38:26.844 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T04:38:26.902 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:38:26.903 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T04:38:26.921 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T04:38:26.921 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2023-10-06T04:38:26.976 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T04:38:26.976 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:38:26.976 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 219366 Links: 1 2023-10-06T04:38:26.976 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:38:26.976 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:38:26.976 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2023-10-06 04:38:19.699040113 +0000 2023-10-06T04:38:26.976 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2023-10-06 04:35:54.938972765 +0000 2023-10-06T04:38:26.976 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2023-10-06 04:35:54.938972765 +0000 2023-10-06T04:38:26.976 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2023-10-06T04:38:26.977 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T04:38:27.038 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2023-10-06T04:38:27.038 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2023-10-06T04:38:27.039 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000252322 s, 2.0 MB/s 2023-10-06T04:38:27.039 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T04:38:27.096 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2023-10-06T04:38:27.152 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T04:38:27.152 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:38:27.152 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 220515 Links: 1 2023-10-06T04:38:27.152 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:38:27.153 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:38:27.153 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2023-10-06 04:38:19.699040113 +0000 2023-10-06T04:38:27.153 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2023-10-06 04:35:55.446959590 +0000 2023-10-06T04:38:27.153 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2023-10-06 04:35:55.446959590 +0000 2023-10-06T04:38:27.153 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2023-10-06T04:38:27.154 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T04:38:27.215 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2023-10-06T04:38:27.215 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2023-10-06T04:38:27.215 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000220939 s, 2.3 MB/s 2023-10-06T04:38:27.216 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T04:38:27.271 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2023-10-06T04:38:27.325 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T04:38:27.326 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:38:27.326 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 221301 Links: 1 2023-10-06T04:38:27.326 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:38:27.326 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:38:27.326 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2023-10-06 04:38:19.699040113 +0000 2023-10-06T04:38:27.326 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2023-10-06 04:35:55.964946157 +0000 2023-10-06T04:38:27.326 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2023-10-06 04:35:55.964946157 +0000 2023-10-06T04:38:27.326 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2023-10-06T04:38:27.326 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T04:38:27.388 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2023-10-06T04:38:27.388 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2023-10-06T04:38:27.388 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000225109 s, 2.3 MB/s 2023-10-06T04:38:27.389 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T04:38:27.445 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2023-10-06T04:38:27.500 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T04:38:27.501 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:38:27.501 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 213926 Links: 1 2023-10-06T04:38:27.501 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:38:27.501 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:38:27.502 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2023-10-06 04:38:19.699040113 +0000 2023-10-06T04:38:27.502 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2023-10-06 04:35:56.456933398 +0000 2023-10-06T04:38:27.502 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2023-10-06 04:35:56.456933398 +0000 2023-10-06T04:38:27.502 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2023-10-06T04:38:27.502 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T04:38:27.563 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2023-10-06T04:38:27.564 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2023-10-06T04:38:27.564 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000194562 s, 2.6 MB/s 2023-10-06T04:38:27.565 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T04:38:27.620 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:38:27.621 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:38:27.621 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T04:38:27.636 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T04:38:27.636 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_1 2023-10-06T04:38:27.692 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T04:38:27.692 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:38:27.692 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 6h/6d Inode: 220452 Links: 1 2023-10-06T04:38:27.693 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:38:27.693 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:38:27.693 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-10-06 04:38:19.940884189 +0000 2023-10-06T04:38:27.693 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-10-06 04:35:52.816523754 +0000 2023-10-06T04:38:27.693 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-10-06 04:35:52.816523754 +0000 2023-10-06T04:38:27.693 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2023-10-06T04:38:27.693 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T04:38:27.756 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-10-06T04:38:27.756 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-10-06T04:38:27.756 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000259131 s, 2.0 MB/s 2023-10-06T04:38:27.757 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T04:38:27.814 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_2 2023-10-06T04:38:27.869 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T04:38:27.870 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:38:27.870 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 6h/6d Inode: 215031 Links: 1 2023-10-06T04:38:27.870 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:38:27.870 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:38:27.870 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-10-06 04:38:19.940884189 +0000 2023-10-06T04:38:27.870 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-10-06 04:35:53.315512613 +0000 2023-10-06T04:38:27.870 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-10-06 04:35:53.315512613 +0000 2023-10-06T04:38:27.870 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2023-10-06T04:38:27.871 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T04:38:27.932 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-10-06T04:38:27.932 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-10-06T04:38:27.932 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000253458 s, 2.0 MB/s 2023-10-06T04:38:27.933 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T04:38:27.989 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_3 2023-10-06T04:38:28.044 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T04:38:28.044 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:38:28.044 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 6h/6d Inode: 220595 Links: 1 2023-10-06T04:38:28.044 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:38:28.044 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:38:28.044 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-10-06 04:38:19.940884189 +0000 2023-10-06T04:38:28.044 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-10-06 04:35:53.799501806 +0000 2023-10-06T04:38:28.044 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-10-06 04:35:53.799501806 +0000 2023-10-06T04:38:28.044 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2023-10-06T04:38:28.045 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T04:38:28.107 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-10-06T04:38:28.107 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-10-06T04:38:28.107 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000258397 s, 2.0 MB/s 2023-10-06T04:38:28.108 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T04:38:28.164 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_4 2023-10-06T04:38:28.219 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T04:38:28.219 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:38:28.220 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 6h/6d Inode: 218773 Links: 1 2023-10-06T04:38:28.220 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:38:28.220 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:38:28.220 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-10-06 04:38:19.940884189 +0000 2023-10-06T04:38:28.220 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-10-06 04:35:54.308490440 +0000 2023-10-06T04:38:28.220 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-10-06 04:35:54.308490440 +0000 2023-10-06T04:38:28.220 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2023-10-06T04:38:28.220 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T04:38:28.281 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-10-06T04:38:28.282 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-10-06T04:38:28.282 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000212121 s, 2.4 MB/s 2023-10-06T04:38:28.283 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T04:38:28.339 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:38:28.339 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T04:38:28.339 INFO:tasks.ceph:Generating config... 2023-10-06T04:38:28.340 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T04:38:28.340 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T04:38:28.340 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T04:38:28.341 INFO:tasks.ceph:[client] pid file = 2023-10-06T04:38:28.341 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T04:38:28.341 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T04:38:28.341 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-06T04:38:28.341 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T04:38:28.341 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T04:38:28.341 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T04:38:28.341 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T04:38:28.341 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T04:38:28.341 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T04:38:28.342 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T04:38:28.342 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T04:38:28.342 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T04:38:28.342 INFO:tasks.ceph:[mgr] debug client = 20 2023-10-06T04:38:28.342 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-10-06T04:38:28.342 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T04:38:28.342 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T04:38:28.342 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T04:38:28.342 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T04:38:28.342 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T04:38:28.343 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T04:38:28.343 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-06T04:38:28.343 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-06T04:38:28.343 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-06T04:38:28.343 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T04:38:28.343 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T04:38:28.343 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-06T04:38:28.343 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-06T04:38:28.343 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T04:38:28.343 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T04:38:28.344 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-06T04:38:28.344 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T04:38:28.344 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T04:38:28.344 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T04:38:28.344 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T04:38:28.344 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T04:38:28.344 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T04:38:28.344 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T04:38:28.345 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T04:38:28.391 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T04:38:28.393 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T04:38:28.432 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T04:38:28.495 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.112'), ('mon.b', '172.21.15.179'), ('mon.c', '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]')] 2023-10-06T04:38:28.496 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.112,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T04:38:28.497 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:38:28.498 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T04:38:28.550 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.112 --add b 172.21.15.179 --addv c '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:28.631 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:28.632 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: generated fsid 3e2b8a43-6e3c-475a-8b31-8dbcc20d6445 2023-10-06T04:38:28.632 INFO:teuthology.orchestra.run.smithi112.stdout:setting min_mon_release = octopus 2023-10-06T04:38:28.632 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 0 2023-10-06T04:38:28.632 INFO:teuthology.orchestra.run.smithi112.stdout:fsid 3e2b8a43-6e3c-475a-8b31-8dbcc20d6445 2023-10-06T04:38:28.632 INFO:teuthology.orchestra.run.smithi112.stdout:last_changed 2023-10-06T04:38:28.630883+0000 2023-10-06T04:38:28.632 INFO:teuthology.orchestra.run.smithi112.stdout:created 2023-10-06T04:38:28.630883+0000 2023-10-06T04:38:28.632 INFO:teuthology.orchestra.run.smithi112.stdout:min_mon_release 15 (octopus) 2023-10-06T04:38:28.632 INFO:teuthology.orchestra.run.smithi112.stdout:election_strategy: 1 2023-10-06T04:38:28.633 INFO:teuthology.orchestra.run.smithi112.stdout:0: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.a 2023-10-06T04:38:28.633 INFO:teuthology.orchestra.run.smithi112.stdout:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2023-10-06T04:38:28.633 INFO:teuthology.orchestra.run.smithi112.stdout:2: [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] mon.c 2023-10-06T04:38:28.633 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T04:38:28.634 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T04:38:28.688 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3e2b8a43-6e3c-475a-8b31-8dbcc20d6445... 2023-10-06T04:38:28.689 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T04:38:28.730 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T04:38:28.770 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2023-10-06T04:38:28.770 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2023-10-06T04:38:28.770 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T04:38:28.770 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2023-10-06T04:38:28.770 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.770 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2023-10-06T04:38:28.770 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.770 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2023-10-06T04:38:28.771 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.771 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2023-10-06T04:38:28.771 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2023-10-06T04:38:28.771 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.771 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2023-10-06T04:38:28.771 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2023-10-06T04:38:28.771 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.771 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T04:38:28.771 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2023-10-06T04:38:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T04:38:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T04:38:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2023-10-06T04:38:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2023-10-06T04:38:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2023-10-06T04:38:28.772 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2023-10-06T04:38:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2023-10-06T04:38:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2023-10-06T04:38:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2023-10-06T04:38:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2023-10-06T04:38:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T04:38:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T04:38:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2023-10-06T04:38:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T04:38:28.773 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2023-10-06T04:38:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2023-10-06T04:38:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2023-10-06T04:38:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2023-10-06T04:38:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2023-10-06T04:38:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.112,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2023-10-06T04:38:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on skipped message = False 2023-10-06T04:38:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = 3e2b8a43-6e3c-475a-8b31-8dbcc20d6445 2023-10-06T04:38:28.774 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.775 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2023-10-06T04:38:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2023-10-06T04:38:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2023-10-06T04:38:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2023-10-06T04:38:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: osd mclock profile = high_recovery_ops 2023-10-06T04:38:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2023-10-06T04:38:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2023-10-06T04:38:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2023-10-06T04:38:28.775 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2023-10-06T04:38:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2023-10-06T04:38:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2023-10-06T04:38:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2023-10-06T04:38:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2023-10-06T04:38:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2023-10-06T04:38:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2023-10-06T04:38:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.776 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2023-10-06T04:38:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2023-10-06T04:38:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2023-10-06T04:38:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2023-10-06T04:38:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: bdev async discard = True 2023-10-06T04:38:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: bdev enable discard = True 2023-10-06T04:38:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore allocator = bitmap 2023-10-06T04:38:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2023-10-06T04:38:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2023-10-06T04:38:28.777 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 1/20 2023-10-06T04:38:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 1/20 2023-10-06T04:38:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2023-10-06T04:38:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2023-10-06T04:38:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 4/10 2023-10-06T04:38:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T04:38:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2023-10-06T04:38:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2023-10-06T04:38:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2023-10-06T04:38:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2023-10-06T04:38:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2023-10-06T04:38:28.778 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.779 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2023-10-06T04:38:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2023-10-06T04:38:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2023-10-06T04:38:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2023-10-06T04:38:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2023-10-06T04:38:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:38:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:38:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2023-10-06T04:38:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2023-10-06T04:38:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: debug finisher = 20 2023-10-06T04:38:28.779 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.779 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2023-10-06T04:38:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2023-10-06T04:38:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2023-10-06T04:38:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2023-10-06T04:38:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2023-10-06T04:38:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2023-10-06T04:38:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2023-10-06T04:38:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:38:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2023-10-06T04:38:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2023-10-06T04:38:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:38:28.780 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T04:38:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T04:38:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T04:38:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T04:38:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T04:38:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T04:38:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2023-10-06T04:38:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2023-10-06T04:38:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.781 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2023-10-06T04:38:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: mon op complaint time = 120 2023-10-06T04:38:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:38:28.782 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2023-10-06T04:38:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2023-10-06T04:38:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2023-10-06T04:38:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2023-10-06T04:38:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T04:38:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T04:38:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: client mount timeout = 600 2023-10-06T04:38:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2023-10-06T04:38:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2023-10-06T04:38:28.783 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = "" 2023-10-06T04:38:28.783 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2023-10-06T04:38:28.783 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2023-10-06T04:38:28.783 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2023-10-06T04:38:28.783 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2023-10-06T04:38:28.783 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2023-10-06T04:38:28.783 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2023-10-06T04:38:28.783 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2023-10-06T04:38:28.783 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2023-10-06T04:38:28.783 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2023-10-06T04:38:28.783 INFO:teuthology.orchestra.run.smithi112.stdout:[mds] 2023-10-06T04:38:28.783 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds = 20 2023-10-06T04:38:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2023-10-06T04:38:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug frag = True 2023-10-06T04:38:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug scatterstat = True 2023-10-06T04:38:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: mds op complaint time = 180 2023-10-06T04:38:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: mds verify scatter = True 2023-10-06T04:38:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2023-10-06T04:38:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2023-10-06T04:38:28.784 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2023-10-06T04:38:28.786 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2023-10-06T04:38:28.786 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2023-10-06T04:38:28.786 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T04:38:28.786 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2023-10-06T04:38:28.786 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.786 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2023-10-06T04:38:28.786 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.786 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2023-10-06T04:38:28.786 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.786 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2023-10-06T04:38:28.787 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2023-10-06T04:38:28.787 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.787 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2023-10-06T04:38:28.787 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2023-10-06T04:38:28.787 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.787 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T04:38:28.787 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2023-10-06T04:38:28.787 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.787 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T04:38:28.787 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T04:38:28.787 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.788 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2023-10-06T04:38:28.788 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.788 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2023-10-06T04:38:28.788 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2023-10-06T04:38:28.788 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2023-10-06T04:38:28.788 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2023-10-06T04:38:28.788 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2023-10-06T04:38:28.788 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2023-10-06T04:38:28.788 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2023-10-06T04:38:28.788 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T04:38:28.788 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T04:38:28.788 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2023-10-06T04:38:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T04:38:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2023-10-06T04:38:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2023-10-06T04:38:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2023-10-06T04:38:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2023-10-06T04:38:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2023-10-06T04:38:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.112,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2023-10-06T04:38:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on skipped message = False 2023-10-06T04:38:28.790 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = 3e2b8a43-6e3c-475a-8b31-8dbcc20d6445 2023-10-06T04:38:28.790 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.790 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2023-10-06T04:38:28.790 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2023-10-06T04:38:28.790 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.790 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2023-10-06T04:38:28.790 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2023-10-06T04:38:28.790 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2023-10-06T04:38:28.790 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2023-10-06T04:38:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2023-10-06T04:38:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2023-10-06T04:38:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2023-10-06T04:38:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2023-10-06T04:38:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2023-10-06T04:38:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2023-10-06T04:38:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2023-10-06T04:38:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2023-10-06T04:38:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2023-10-06T04:38:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2023-10-06T04:38:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2023-10-06T04:38:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2023-10-06T04:38:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2023-10-06T04:38:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: bdev async discard = True 2023-10-06T04:38:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: bdev enable discard = True 2023-10-06T04:38:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore allocator = bitmap 2023-10-06T04:38:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2023-10-06T04:38:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2023-10-06T04:38:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 1/20 2023-10-06T04:38:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 1/20 2023-10-06T04:38:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-10-06T04:38:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2023-10-06T04:38:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 4/10 2023-10-06T04:38:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T04:38:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2023-10-06T04:38:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2023-10-06T04:38:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2023-10-06T04:38:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2023-10-06T04:38:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2023-10-06T04:38:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.800 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2023-10-06T04:38:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-10-06T04:38:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2023-10-06T04:38:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2023-10-06T04:38:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2023-10-06T04:38:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:38:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:38:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2023-10-06T04:38:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2023-10-06T04:38:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: debug finisher = 20 2023-10-06T04:38:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.801 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2023-10-06T04:38:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-10-06T04:38:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2023-10-06T04:38:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2023-10-06T04:38:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2023-10-06T04:38:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2023-10-06T04:38:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2023-10-06T04:38:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:38:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2023-10-06T04:38:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2023-10-06T04:38:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:38:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T04:38:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T04:38:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T04:38:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T04:38:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T04:38:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T04:38:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2023-10-06T04:38:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2023-10-06T04:38:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2023-10-06T04:38:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: mon op complaint time = 120 2023-10-06T04:38:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-06T04:38:28.803 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2023-10-06T04:38:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2023-10-06T04:38:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2023-10-06T04:38:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2023-10-06T04:38:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T04:38:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T04:38:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: client mount timeout = 600 2023-10-06T04:38:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2023-10-06T04:38:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-10-06T04:38:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = "" 2023-10-06T04:38:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2023-10-06T04:38:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2023-10-06T04:38:28.804 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2023-10-06T04:38:28.804 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2023-10-06T04:38:28.805 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2023-10-06T04:38:28.805 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2023-10-06T04:38:28.805 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2023-10-06T04:38:28.805 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2023-10-06T04:38:28.805 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2023-10-06T04:38:28.805 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2023-10-06T04:38:28.805 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds = 20 2023-10-06T04:38:28.805 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-10-06T04:38:28.805 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug frag = True 2023-10-06T04:38:28.805 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug scatterstat = True 2023-10-06T04:38:28.805 INFO:teuthology.orchestra.run.smithi179.stdout: mds op complaint time = 180 2023-10-06T04:38:28.806 INFO:teuthology.orchestra.run.smithi179.stdout: mds verify scatter = True 2023-10-06T04:38:28.806 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2023-10-06T04:38:28.806 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2023-10-06T04:38:28.806 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2023-10-06T04:38:28.806 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T04:38:28.806 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T04:38:28.876 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T04:38:28.876 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:38:28.876 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T04:38:28.891 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:38:28.891 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T04:38:28.945 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi112.front.sepia.ceph.com 2023-10-06T04:38:28.945 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:38:28.946 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T04:38:28.946 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T04:38:29.019 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:38:29.019 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:29.073 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi179.front.sepia.ceph.com 2023-10-06T04:38:29.074 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:38:29.074 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T04:38:29.074 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T04:38:29.109 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:38:29.109 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:29.164 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T04:38:29.164 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T04:38:29.165 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T04:38:29.212 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T04:38:29.214 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T04:38:29.287 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T04:38:29.290 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T04:38:29.290 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T04:38:29.338 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T04:38:29.340 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T04:38:29.364 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T04:38:29.451 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T04:38:29.453 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T04:38:29.477 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T04:38:29.524 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T04:38:29.526 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T04:38:29.550 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T04:38:29.637 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T04:38:29.640 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T04:38:29.663 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T04:38:29.663 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T04:38:29.701 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T04:38:29.713 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T04:38:29.791 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T04:38:29.804 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T04:38:29.841 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T04:38:29.853 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T04:38:29.931 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T04:38:29.943 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T04:38:29.943 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T04:38:29.944 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T04:38:29.967 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:38:29.968 INFO:tasks.ceph:role: osd.0 2023-10-06T04:38:29.968 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com 2023-10-06T04:38:29.968 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T04:38:30.039 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:38:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:38:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:38:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 2023-10-06T04:38:30.040 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:38:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:38:30.041 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:38:30.041 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:38:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:38:30.041 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:38:30.472 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2023-10-06T04:38:30.474 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2023-10-06T04:38:30.474 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T04:38:30.643 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T04:38:30.675 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T04:38:30.740 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:38:30.740 INFO:tasks.ceph:role: osd.1 2023-10-06T04:38:30.740 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com 2023-10-06T04:38:30.740 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T04:38:30.812 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:38:30.812 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:38:30.812 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:38:30.812 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 2023-10-06T04:38:30.812 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:38:30.812 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:38:30.812 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:38:30.812 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:38:30.812 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:38:30.813 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:38:31.239 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2023-10-06T04:38:31.241 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2023-10-06T04:38:31.241 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T04:38:31.345 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T04:38:31.375 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T04:38:31.440 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:38:31.440 INFO:tasks.ceph:role: osd.2 2023-10-06T04:38:31.440 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com 2023-10-06T04:38:31.440 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T04:38:31.511 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:38:31.511 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:38:31.511 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:38:31.511 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 2023-10-06T04:38:31.512 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:38:31.512 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:38:31.512 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:38:31.512 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:38:31.512 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:38:31.512 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:38:31.964 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2023-10-06T04:38:31.966 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2023-10-06T04:38:31.966 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T04:38:32.113 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T04:38:32.143 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T04:38:32.207 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:38:32.207 INFO:tasks.ceph:role: osd.3 2023-10-06T04:38:32.207 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com 2023-10-06T04:38:32.207 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T04:38:32.279 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:38:32.279 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:38:32.279 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:38:32.279 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 2023-10-06T04:38:32.279 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:38:32.279 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:38:32.279 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:38:32.279 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:38:32.279 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:38:32.280 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:38:32.730 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2023-10-06T04:38:32.731 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2023-10-06T04:38:32.731 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T04:38:32.906 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T04:38:32.938 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:33.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:33.101+0000 7f83f1762540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T04:38:33.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:33.101+0000 7f83f1762540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T04:38:33.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:33.101+0000 7f83f1762540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T04:38:33.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:33.101+0000 7f83f1762540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T04:38:33.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:33.101+0000 7f83f1762540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T04:38:33.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:33.102+0000 7f83f1762540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T04:38:33.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:33.627+0000 7f83f1762540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:34.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:34.391+0000 7f83f1762540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:35.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:35.153+0000 7f83f1762540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:35.946 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T04:38:35.971 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:36.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:36.049+0000 7fe09f73f540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T04:38:36.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:36.049+0000 7fe09f73f540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T04:38:36.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:36.049+0000 7fe09f73f540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T04:38:36.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:36.049+0000 7fe09f73f540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T04:38:36.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:36.049+0000 7fe09f73f540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T04:38:36.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:36.050+0000 7fe09f73f540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T04:38:36.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:36.572+0000 7fe09f73f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:37.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:37.334+0000 7fe09f73f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:38.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:38.097+0000 7fe09f73f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:38.903 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T04:38:38.974 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:39.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:39.058+0000 7fbfa23d1540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T04:38:39.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:39.058+0000 7fbfa23d1540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T04:38:39.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:39.058+0000 7fbfa23d1540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T04:38:39.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:39.058+0000 7fbfa23d1540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T04:38:39.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:39.058+0000 7fbfa23d1540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T04:38:39.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:39.059+0000 7fbfa23d1540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T04:38:39.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:39.588+0000 7fbfa23d1540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:40.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:40.351+0000 7fbfa23d1540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:41.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:41.113+0000 7fbfa23d1540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:41.911 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T04:38:41.940 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:42.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:42.022+0000 7f5d93a5d540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T04:38:42.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:42.022+0000 7f5d93a5d540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T04:38:42.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:42.022+0000 7f5d93a5d540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T04:38:42.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:42.022+0000 7f5d93a5d540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T04:38:42.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:42.022+0000 7f5d93a5d540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T04:38:42.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:42.023+0000 7f5d93a5d540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T04:38:42.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:42.553+0000 7f5d93a5d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:43.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:43.318+0000 7f5d93a5d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:44.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:38:44.081+0000 7f5d93a5d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:44.879 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T04:38:44.909 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T04:38:44.935 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:38:44.935 INFO:tasks.ceph:role: osd.4 2023-10-06T04:38:44.935 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-06T04:38:44.935 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T04:38:45.008 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:38:45.008 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:38:45.008 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:38:45.009 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 2023-10-06T04:38:45.009 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:38:45.009 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:38:45.009 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:38:45.009 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:38:45.009 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:38:45.009 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:38:45.434 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-10-06T04:38:45.436 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-10-06T04:38:45.437 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T04:38:45.612 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T04:38:45.649 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T04:38:45.718 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:38:45.719 INFO:tasks.ceph:role: osd.5 2023-10-06T04:38:45.719 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-06T04:38:45.719 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T04:38:45.793 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:38:45.793 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:38:45.794 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:38:45.794 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 2023-10-06T04:38:45.794 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:38:45.794 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:38:45.794 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:38:45.794 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:38:45.794 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:38:45.794 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:38:46.219 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-10-06T04:38:46.221 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-10-06T04:38:46.221 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T04:38:46.332 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T04:38:46.363 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T04:38:46.430 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:38:46.430 INFO:tasks.ceph:role: osd.6 2023-10-06T04:38:46.430 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-06T04:38:46.431 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T04:38:46.503 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:38:46.503 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:38:46.503 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:38:46.503 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 2023-10-06T04:38:46.503 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:38:46.503 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:38:46.503 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:38:46.504 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:38:46.504 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:38:46.504 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:38:46.964 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-10-06T04:38:46.966 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-10-06T04:38:46.966 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T04:38:47.147 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T04:38:47.181 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T04:38:47.250 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:38:47.250 INFO:tasks.ceph:role: osd.7 2023-10-06T04:38:47.251 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-06T04:38:47.251 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T04:38:47.324 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:38:47.325 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:38:47.325 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:38:47.325 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 2023-10-06T04:38:47.325 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:38:47.326 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:38:47.326 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:38:47.326 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:38:47.326 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:38:47.326 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:38:47.754 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-10-06T04:38:47.756 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-10-06T04:38:47.756 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T04:38:47.912 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T04:38:47.944 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:48.049 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:48.046+0000 7fe757d91540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T04:38:48.049 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:48.047+0000 7fe757d91540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T04:38:48.049 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:48.047+0000 7fe757d91540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T04:38:48.049 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:48.047+0000 7fe757d91540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T04:38:48.050 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:48.047+0000 7fe757d91540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T04:38:48.050 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:48.047+0000 7fe757d91540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T04:38:48.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:48.572+0000 7fe757d91540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:49.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:49.339+0000 7fe757d91540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:50.103 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:50.102+0000 7fe757d91540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:50.900 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T04:38:50.925 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:51.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:51.006+0000 7fc3f06a1540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T04:38:51.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:51.006+0000 7fc3f06a1540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T04:38:51.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:51.006+0000 7fc3f06a1540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T04:38:51.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:51.006+0000 7fc3f06a1540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T04:38:51.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:51.006+0000 7fc3f06a1540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T04:38:51.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:51.006+0000 7fc3f06a1540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T04:38:51.530 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:51.528+0000 7fc3f06a1540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:52.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:52.294+0000 7fc3f06a1540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:53.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:53.057+0000 7fc3f06a1540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:53.855 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T04:38:53.920 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:54.002 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:54.000+0000 7f9a21fd9540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T04:38:54.003 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:54.001+0000 7f9a21fd9540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T04:38:54.003 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:54.001+0000 7f9a21fd9540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T04:38:54.003 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:54.001+0000 7f9a21fd9540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T04:38:54.003 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:54.001+0000 7f9a21fd9540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T04:38:54.003 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:54.001+0000 7f9a21fd9540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T04:38:54.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:54.525+0000 7f9a21fd9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:55.292 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:55.290+0000 7f9a21fd9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:56.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:56.058+0000 7f9a21fd9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:56.788 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:38:56.801 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:38:56.867 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T04:38:56.950 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:38:57.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:57.032+0000 7f1c3545d540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T04:38:57.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:57.032+0000 7f1c3545d540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T04:38:57.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:57.032+0000 7f1c3545d540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T04:38:57.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:57.032+0000 7f1c3545d540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T04:38:57.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:57.032+0000 7f1c3545d540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T04:38:57.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:57.033+0000 7f1c3545d540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T04:38:57.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:57.559+0000 7f1c3545d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:58.322 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:58.321+0000 7f1c3545d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:59.085 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:38:59.083+0000 7f1c3545d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:38:59.879 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T04:38:59.945 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T04:38:59.945 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:38:59.945 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T04:38:59.972 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:38:59.972 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T04:39:00.037 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:39:00.037 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T04:39:00.102 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:39:00.102 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T04:39:00.166 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:39:00.166 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T04:39:00.229 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:39:00.230 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T04:39:00.294 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:39:00.294 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T04:39:00.358 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:39:00.358 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T04:39:00.384 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:39:00.384 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T04:39:00.448 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:39:00.448 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T04:39:00.513 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:39:00.513 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T04:39:00.577 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:39:00.577 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T04:39:00.641 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:39:00.641 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T04:39:00.705 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:39:00.705 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T04:39:00.769 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:39:00.770 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T04:39:00.784 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:39:00.785 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T04:39:00.839 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:39:00.840 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T04:39:00.854 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:39:00.854 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T04:39:00.908 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T04:39:00.908 DEBUG:teuthology.orchestra.run.smithi112:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T04:39:00.910 DEBUG:teuthology.orchestra.run.smithi179:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T04:39:00.951 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.y] 2023-10-06T04:39:00.952 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBFjx9lr+KZDBAAqTnvWgCJxJ4/OZuod+I3IA== 2023-10-06T04:39:00.953 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2023-10-06T04:39:00.953 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBFjx9lHRsgFBAAVmrOzSO916joB3iUPDqY/A== 2023-10-06T04:39:00.953 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2023-10-06T04:39:00.954 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBFjx9lmKDeGhAAJiJU058HFfg3HIqUE4rpLw== 2023-10-06T04:39:00.954 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.0] 2023-10-06T04:39:00.954 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBJjx9l3iwcBhAADAPEZKqdlv7ygDYgh1NPNQ== 2023-10-06T04:39:00.955 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.1] 2023-10-06T04:39:00.955 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBMjx9lSs0FAxAAmUyr5D3QwnXAmrzU6KwbbA== 2023-10-06T04:39:00.955 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.2] 2023-10-06T04:39:00.956 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBPjx9l6MuOAxAAUZ4aY+DF3CKXwTalTP+tkg== 2023-10-06T04:39:00.956 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.3] 2023-10-06T04:39:00.956 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBSjx9lIidoARAAIqNp0Q6fV9q2jnXSPQT/AQ== 2023-10-06T04:39:00.957 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.x] 2023-10-06T04:39:00.957 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBFjx9lnh4bERAAeV5SyL28+JjhcjhWw1IQ+g== 2023-10-06T04:39:00.957 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2023-10-06T04:39:00.957 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBFjx9lXB84HxAANT7HE/+7+jhEqpoLHpocaw== 2023-10-06T04:39:00.958 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2023-10-06T04:39:00.958 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBFjx9l1gX3JRAARGmfsEFVUNfw6k/Dzf+lwg== 2023-10-06T04:39:00.958 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.4] 2023-10-06T04:39:00.959 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBYjx9lSdbVAhAAZPqGYaBw04sdD3ix8I0TMw== 2023-10-06T04:39:00.959 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.5] 2023-10-06T04:39:00.959 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBbjx9lRtlmABAA1GGXcZC5Usx6BEh8FEKfUA== 2023-10-06T04:39:00.959 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.6] 2023-10-06T04:39:00.959 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBejx9lUsAXABAA73gmQkPcFxFG+KEQ/M2zZQ== 2023-10-06T04:39:00.960 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.7] 2023-10-06T04:39:00.960 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBhjx9lgwj5ARAA1GZF4aAi7GaqJQkK5+psIg== 2023-10-06T04:39:00.960 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2023-10-06T04:39:00.960 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBFjx9lB529KRAAcgqvfkVELgnt0AojZQSDhA== 2023-10-06T04:39:00.960 INFO:teuthology.orchestra.run.smithi112.stdout:[client.2] 2023-10-06T04:39:00.960 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBFjx9lczInLxAArt0EQqtNqzeINPY76QdgXw== 2023-10-06T04:39:00.960 INFO:teuthology.orchestra.run.smithi112.stdout:[client.1] 2023-10-06T04:39:00.960 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBFjx9li3gaMhAAgQc9tI4BBq9G8ZdSr5dJMQ== 2023-10-06T04:39:00.961 INFO:teuthology.orchestra.run.smithi112.stdout:[client.3] 2023-10-06T04:39:00.961 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBFjx9lVvxxNxAAIFHE41UvuBDhZ0R1hmIfnQ== 2023-10-06T04:39:00.970 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.y] 2023-10-06T04:39:00.971 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBFjx9lr+KZDBAAqTnvWgCJxJ4/OZuod+I3IA== 2023-10-06T04:39:00.971 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2023-10-06T04:39:00.971 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBFjx9lHRsgFBAAVmrOzSO916joB3iUPDqY/A== 2023-10-06T04:39:00.971 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2023-10-06T04:39:00.971 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBFjx9lmKDeGhAAJiJU058HFfg3HIqUE4rpLw== 2023-10-06T04:39:00.971 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.0] 2023-10-06T04:39:00.971 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBJjx9l3iwcBhAADAPEZKqdlv7ygDYgh1NPNQ== 2023-10-06T04:39:00.971 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.1] 2023-10-06T04:39:00.972 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBMjx9lSs0FAxAAmUyr5D3QwnXAmrzU6KwbbA== 2023-10-06T04:39:00.972 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.2] 2023-10-06T04:39:00.972 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBPjx9l6MuOAxAAUZ4aY+DF3CKXwTalTP+tkg== 2023-10-06T04:39:00.972 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.3] 2023-10-06T04:39:00.972 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBSjx9lIidoARAAIqNp0Q6fV9q2jnXSPQT/AQ== 2023-10-06T04:39:00.972 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.x] 2023-10-06T04:39:00.972 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBFjx9lnh4bERAAeV5SyL28+JjhcjhWw1IQ+g== 2023-10-06T04:39:00.972 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2023-10-06T04:39:00.972 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBFjx9lXB84HxAANT7HE/+7+jhEqpoLHpocaw== 2023-10-06T04:39:00.973 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2023-10-06T04:39:00.973 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBFjx9l1gX3JRAARGmfsEFVUNfw6k/Dzf+lwg== 2023-10-06T04:39:00.973 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.4] 2023-10-06T04:39:00.973 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBYjx9lSdbVAhAAZPqGYaBw04sdD3ix8I0TMw== 2023-10-06T04:39:00.973 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.5] 2023-10-06T04:39:00.973 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBbjx9lRtlmABAA1GGXcZC5Usx6BEh8FEKfUA== 2023-10-06T04:39:00.974 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.6] 2023-10-06T04:39:00.974 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBejx9lUsAXABAA73gmQkPcFxFG+KEQ/M2zZQ== 2023-10-06T04:39:00.974 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.7] 2023-10-06T04:39:00.974 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBhjx9lgwj5ARAA1GZF4aAi7GaqJQkK5+psIg== 2023-10-06T04:39:00.974 INFO:teuthology.orchestra.run.smithi179.stdout:[client.0] 2023-10-06T04:39:00.974 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBFjx9lB529KRAAcgqvfkVELgnt0AojZQSDhA== 2023-10-06T04:39:00.974 INFO:teuthology.orchestra.run.smithi179.stdout:[client.2] 2023-10-06T04:39:00.974 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBFjx9lczInLxAArt0EQqtNqzeINPY76QdgXw== 2023-10-06T04:39:00.975 INFO:teuthology.orchestra.run.smithi179.stdout:[client.1] 2023-10-06T04:39:00.975 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBFjx9li3gaMhAAgQc9tI4BBq9G8ZdSr5dJMQ== 2023-10-06T04:39:00.975 INFO:teuthology.orchestra.run.smithi179.stdout:[client.3] 2023-10-06T04:39:00.975 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBFjx9lVvxxNxAAIFHE41UvuBDhZ0R1hmIfnQ== 2023-10-06T04:39:00.976 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:39:01.004 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:39:01.063 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:39:01.065 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:39:01.115 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:39:01.117 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:39:01.166 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:39:01.168 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:39:01.215 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:39:01.217 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:39:01.264 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:39:01.266 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:39:01.313 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:39:01.315 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:39:01.362 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:39:01.364 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:39:01.411 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:39:01.414 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:39:01.464 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:39:01.466 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:39:01.517 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:39:01.519 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:39:01.566 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:39:01.568 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:39:01.615 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:39:01.617 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:39:01.665 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:39:01.667 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:39:01.714 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:39:01.716 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:39:01.766 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:39:01.775 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:39:01.825 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:39:01.827 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:39:01.877 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:39:01.879 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:39:01.929 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T04:39:01.929 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T04:39:01.953 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T04:39:02.045 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T04:39:02.069 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T04:39:02.093 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T04:39:02.184 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T04:39:02.208 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T04:39:02.272 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T04:39:02.364 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T04:39:02.389 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:39:02.391 DEBUG:teuthology.orchestra.run.smithi179:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:39:02.443 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T04:39:02.443 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T04:39:02.443 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T04:39:02.445 INFO:tasks.ceph.mon.a:Started 2023-10-06T04:39:02.446 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T04:39:02.446 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T04:39:02.485 INFO:tasks.ceph.mon.b:Started 2023-10-06T04:39:02.486 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T04:39:02.486 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T04:39:02.488 INFO:tasks.ceph.mon.c:Started 2023-10-06T04:39:02.488 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T04:39:02.488 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T04:39:02.488 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T04:39:02.490 INFO:tasks.ceph.mgr.y:Started 2023-10-06T04:39:02.490 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T04:39:02.491 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T04:39:02.492 INFO:tasks.ceph.mgr.x:Started 2023-10-06T04:39:02.493 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T04:39:02.493 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T04:39:02.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.607+0000 7fe00b65b700 1 Processor -- start 2023-10-06T04:39:02.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.607+0000 7fe00b65b700 1 -- start start 2023-10-06T04:39:02.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.608+0000 7fe00b65b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe00415ce60 0x7fe0040d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:02.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.608+0000 7fe00b65b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe0040d13a0 0x7fe0040cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:02.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.608+0000 7fe00b65b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0040cf610 con 0x7fe0040cb2d0 2023-10-06T04:39:02.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.608+0000 7fe00b65b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0040cb770 con 0x7fe0040d13a0 2023-10-06T04:39:02.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.608+0000 7fe00b65b700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0040cf8f0 con 0x7fe00415ce60 2023-10-06T04:39:02.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.608+0000 7fe008bf6700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe0040d13a0 0x7fe0040cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:02.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.608+0000 7fe009bf8700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe0040cb2d0 0x7fe0040ce320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60230/0 (socket says 172.21.15.112:60230) 2023-10-06T04:39:02.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.608+0000 7fe008bf6700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe0040d13a0 0x7fe0040cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46606/0 (socket says 172.21.15.112:46606) 2023-10-06T04:39:02.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.608+0000 7fe009bf8700 1 -- 172.21.15.112:0/3587388752 learned_addr learned my addr 172.21.15.112:0/3587388752 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:02.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.608+0000 7fe0093f7700 1 --2- 172.21.15.112:0/3587388752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe00415ce60 0x7fe0040d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:02.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.608+0000 7fe008bf6700 1 -- 172.21.15.112:0/3587388752 >> v2:172.21.15.112:3300/0 conn(0x7fe0040d13a0 msgr2=0x7fe0040cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T04:39:02.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.608+0000 7fe008bf6700 1 -- 172.21.15.112:0/3587388752 >> v2:172.21.15.112:3300/0 conn(0x7fe0040d13a0 msgr2=0x7fe0040cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:39:02.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.608+0000 7fe008bf6700 1 --2- 172.21.15.112:0/3587388752 >> v2:172.21.15.112:3300/0 conn(0x7fe0040d13a0 0x7fe0040cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:39:02.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.608+0000 7fe008bf6700 1 --2- 172.21.15.112:0/3587388752 >> v2:172.21.15.112:3300/0 conn(0x7fe0040d13a0 0x7fe0040cad90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T04:39:02.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.608+0000 7fe0093f7700 1 -- 172.21.15.112:0/3587388752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe00415ce60 msgr2=0x7fe0040d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T04:39:02.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.608+0000 7fe0093f7700 1 -- 172.21.15.112:0/3587388752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe00415ce60 msgr2=0x7fe0040d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:39:02.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.608+0000 7fe0093f7700 1 --2- 172.21.15.112:0/3587388752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe00415ce60 0x7fe0040d0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:39:02.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.608+0000 7fe0093f7700 1 --2- 172.21.15.112:0/3587388752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe00415ce60 0x7fe0040d0e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T04:39:02.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.781+0000 7fdffbfff700 1 -- 172.21.15.112:0/3587388752 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863009405 0 0) 0x7fe0040cf610 con 0x7fe0040cb2d0 2023-10-06T04:39:02.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.781+0000 7fdffbfff700 1 -- 172.21.15.112:0/3587388752 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff0003570 con 0x7fe0040cb2d0 2023-10-06T04:39:02.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.783+0000 7fdffbfff700 1 -- 172.21.15.112:0/3587388752 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3830585415 0 0) 0x7fdff0003570 con 0x7fe0040cb2d0 2023-10-06T04:39:02.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.783+0000 7fdffbfff700 1 -- 172.21.15.112:0/3587388752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe00415ce60 msgr2=0x7fe0040d0e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:39:02.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.783+0000 7fdffbfff700 1 --2- 172.21.15.112:0/3587388752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe00415ce60 0x7fe0040d0e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:02.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.783+0000 7fdffbfff700 1 -- 172.21.15.112:0/3587388752 >> v2:172.21.15.112:3300/0 conn(0x7fe0040d13a0 msgr2=0x7fe0040cad90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:39:02.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.783+0000 7fdffbfff700 1 --2- 172.21.15.112:0/3587388752 >> v2:172.21.15.112:3300/0 conn(0x7fe0040d13a0 0x7fe0040cad90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:02.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.783+0000 7fdffbfff700 1 -- 172.21.15.112:0/3587388752 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0040cfbd0 con 0x7fe0040cb2d0 2023-10-06T04:39:02.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.783+0000 7fdffbfff700 1 -- 172.21.15.112:0/3587388752 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7fdffc0017f0 con 0x7fe0040cb2d0 2023-10-06T04:39:02.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.783+0000 7fdffbfff700 1 -- 172.21.15.112:0/3587388752 >> v1:172.21.15.112:6789/0 conn(0x7fe0040cb2d0 legacy=0x7fe0040ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:02.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.783+0000 7fdffbfff700 1 --2- 172.21.15.112:0/3587388752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdff0003a60 0x7fdff0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:02.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.783+0000 7fdffbfff700 1 --2- 172.21.15.112:0/3587388752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe00415ce60 0x7fdff0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:02.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.783+0000 7fdffbfff700 1 --2- 172.21.15.112:0/3587388752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdff0004d50 0x7fdff00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:02.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.783+0000 7fdffbfff700 1 -- 172.21.15.112:0/3587388752 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0040cb770 con 0x7fdff0004d50 2023-10-06T04:39:02.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.783+0000 7fdffbfff700 1 -- 172.21.15.112:0/3587388752 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0040cf8f0 con 0x7fdff0003a60 2023-10-06T04:39:02.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.783+0000 7fdffbfff700 1 -- 172.21.15.112:0/3587388752 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff000bb90 con 0x7fe00415ce60 2023-10-06T04:39:02.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.783+0000 7fe009bf8700 1 --2- 172.21.15.112:0/3587388752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdff0004d50 0x7fdff00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:02.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.783+0000 7fe008bf6700 1 --2- 172.21.15.112:0/3587388752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe00415ce60 0x7fdff0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:02.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.783+0000 7fe0093f7700 1 --2- 172.21.15.112:0/3587388752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdff0003a60 0x7fdff0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:02.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.784+0000 7fe009bf8700 1 -- 172.21.15.112:0/3587388752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe00415ce60 msgr2=0x7fdff0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:02.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.784+0000 7fe009bf8700 1 --2- 172.21.15.112:0/3587388752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe00415ce60 0x7fdff0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:02.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.784+0000 7fe009bf8700 1 -- 172.21.15.112:0/3587388752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdff0003a60 msgr2=0x7fdff0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:02.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.784+0000 7fe009bf8700 1 --2- 172.21.15.112:0/3587388752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdff0003a60 0x7fdff0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:02.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.784+0000 7fe009bf8700 1 -- 172.21.15.112:0/3587388752 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff0003570 con 0x7fdff0004d50 2023-10-06T04:39:02.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.784+0000 7fe009bf8700 1 --2- 172.21.15.112:0/3587388752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdff0004d50 0x7fdff00051c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00a970 tx=0x7fdffc002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9556b34608cf08f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:02.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.784+0000 7fdffbfff700 1 -- 172.21.15.112:0/3587388752 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc012440 con 0x7fdff0004d50 2023-10-06T04:39:02.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.784+0000 7fdffbfff700 1 -- 172.21.15.112:0/3587388752 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdffc0125c0 con 0x7fdff0004d50 2023-10-06T04:39:02.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.784+0000 7fdffbfff700 1 -- 172.21.15.112:0/3587388752 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc012980 con 0x7fdff0004d50 2023-10-06T04:39:02.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.785+0000 7fe00b65b700 1 -- 172.21.15.112:0/3587388752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdff0004d50 msgr2=0x7fdff00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:02.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.785+0000 7fe00b65b700 1 --2- 172.21.15.112:0/3587388752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdff0004d50 0x7fdff00051c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00a970 tx=0x7fdffc002210 comp rx=0 tx=0).stop 2023-10-06T04:39:02.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.785+0000 7fe009bf8700 1 -- 172.21.15.112:0/3587388752 reap_dead start 2023-10-06T04:39:02.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.785+0000 7fe00b65b700 1 -- 172.21.15.112:0/3587388752 shutdown_connections 2023-10-06T04:39:02.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.785+0000 7fe00b65b700 1 -- 172.21.15.112:0/3587388752 >> 172.21.15.112:0/3587388752 conn(0x7fe00406cfb0 msgr2=0x7fe0040d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:02.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.785+0000 7fe00b65b700 1 -- 172.21.15.112:0/3587388752 shutdown_connections 2023-10-06T04:39:02.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.785+0000 7fe00b65b700 1 -- 172.21.15.112:0/3587388752 wait complete. 2023-10-06T04:39:02.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.786+0000 7fe00b65b700 1 Processor -- start 2023-10-06T04:39:02.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.786+0000 7fe00b65b700 1 -- start start 2023-10-06T04:39:02.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.787+0000 7fe00b65b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdff0004d50 0x7fe0040c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:02.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.787+0000 7fe00b65b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe004155d20 0x7fe004154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:02.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.787+0000 7fe00b65b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe00416d230 0x7fe00416d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:02.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.787+0000 7fe00b65b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00415d4f0 con 0x7fe004155d20 2023-10-06T04:39:02.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.787+0000 7fe00b65b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0040c86c0 con 0x7fdff0004d50 2023-10-06T04:39:02.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.787+0000 7fe00b65b700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0040c7e20 con 0x7fe00416d230 2023-10-06T04:39:02.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.787+0000 7fe008bf6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe004155d20 0x7fe004154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:02.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.787+0000 7fe008bf6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe004155d20 0x7fe004154030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46648/0 (socket says 172.21.15.112:46648) 2023-10-06T04:39:02.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.787+0000 7fe008bf6700 1 -- 172.21.15.112:0/1560220494 learned_addr learned my addr 172.21.15.112:0/1560220494 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:02.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.787+0000 7fe0093f7700 1 --2- 172.21.15.112:0/1560220494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdff0004d50 0x7fe0040c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:02.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.787+0000 7fe009bf8700 1 --2- 172.21.15.112:0/1560220494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe00416d230 0x7fe00416d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:02.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.787+0000 7fe008bf6700 1 -- 172.21.15.112:0/1560220494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe00416d230 msgr2=0x7fe00416d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:02.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.787+0000 7fe008bf6700 1 --2- 172.21.15.112:0/1560220494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe00416d230 0x7fe00416d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:02.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.787+0000 7fe008bf6700 1 -- 172.21.15.112:0/1560220494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdff0004d50 msgr2=0x7fe0040c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:02.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.787+0000 7fe008bf6700 1 --2- 172.21.15.112:0/1560220494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdff0004d50 0x7fe0040c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:02.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.787+0000 7fe008bf6700 1 -- 172.21.15.112:0/1560220494 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0040c8100 con 0x7fe004155d20 2023-10-06T04:39:02.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.787+0000 7fe009bf8700 1 --2- 172.21.15.112:0/1560220494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe00416d230 0x7fe00416d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:02.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.787+0000 7fe008bf6700 1 --2- 172.21.15.112:0/1560220494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe004155d20 0x7fe004154030 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdff400fa90 tx=0x7fdff4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:02.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.788+0000 7fdff97fa700 1 -- 172.21.15.112:0/1560220494 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff400e8d0 con 0x7fe004155d20 2023-10-06T04:39:02.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.788+0000 7fdff97fa700 1 -- 172.21.15.112:0/1560220494 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff400ea30 con 0x7fe004155d20 2023-10-06T04:39:02.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.788+0000 7fe00b65b700 1 -- 172.21.15.112:0/1560220494 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0040c83e0 con 0x7fe004155d20 2023-10-06T04:39:02.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.788+0000 7fe00b65b700 1 -- 172.21.15.112:0/1560220494 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe004154570 con 0x7fe004155d20 2023-10-06T04:39:02.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.788+0000 7fdff97fa700 1 -- 172.21.15.112:0/1560220494 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff400edf0 con 0x7fe004155d20 2023-10-06T04:39:02.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.789+0000 7fdff97fa700 1 -- 172.21.15.112:0/1560220494 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fdff40138d0 con 0x7fe004155d20 2023-10-06T04:39:02.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.789+0000 7fdff97fa700 1 -- 172.21.15.112:0/1560220494 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fdff401c590 con 0x7fe004155d20 2023-10-06T04:39:02.803 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.789+0000 7fe00b65b700 1 -- 172.21.15.112:0/1560220494 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe40052b0 con 0x7fe004155d20 2023-10-06T04:39:02.803 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.792+0000 7fdff97fa700 1 -- 172.21.15.112:0/1560220494 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fdff4021060 con 0x7fe004155d20 2023-10-06T04:39:02.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.866+0000 7fe00b65b700 1 -- 172.21.15.112:0/1560220494 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fdfe4005830 con 0x7fe004155d20 2023-10-06T04:39:02.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.871+0000 7fdff97fa700 1 -- 172.21.15.112:0/1560220494 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fdff402b090 con 0x7fe004155d20 2023-10-06T04:39:02.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.871+0000 7fe00b65b700 1 -- 172.21.15.112:0/1560220494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe004155d20 msgr2=0x7fe004154030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:02.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.871+0000 7fe00b65b700 1 --2- 172.21.15.112:0/1560220494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe004155d20 0x7fe004154030 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdff400fa90 tx=0x7fdff4008040 comp rx=0 tx=0).stop 2023-10-06T04:39:02.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.872+0000 7fe00b65b700 1 -- 172.21.15.112:0/1560220494 shutdown_connections 2023-10-06T04:39:02.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.872+0000 7fe00b65b700 1 --2- 172.21.15.112:0/1560220494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe00416d230 0x7fe00416d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:02.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.872+0000 7fe00b65b700 1 --2- 172.21.15.112:0/1560220494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdff0004d50 0x7fe0040c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:02.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.872+0000 7fe00b65b700 1 --2- 172.21.15.112:0/1560220494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe004155d20 0x7fe004154030 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:02.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.872+0000 7fe00b65b700 1 -- 172.21.15.112:0/1560220494 >> 172.21.15.112:0/1560220494 conn(0x7fe00406cfb0 msgr2=0x7fe004158440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:02.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.872+0000 7fe00b65b700 1 -- 172.21.15.112:0/1560220494 shutdown_connections 2023-10-06T04:39:02.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:02.872+0000 7fe00b65b700 1 -- 172.21.15.112:0/1560220494 wait complete. 2023-10-06T04:39:02.875 INFO:teuthology.orchestra.run.smithi112.stderr:adjusted tunables profile to default 2023-10-06T04:39:02.887 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T04:39:02.888 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:39:02.888 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T04:39:02.912 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:39:02.912 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T04:39:02.977 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:39:02.977 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T04:39:03.042 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-10-06T04:39:03.042 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T04:39:03.107 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:39:03.107 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T04:39:03.133 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:39:03.133 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T04:39:03.198 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:39:03.198 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T04:39:03.263 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-06T04:39:03.263 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T04:39:03.328 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new ee62e73f-1746-456a-9a1d-628f702005fa 0 2023-10-06T04:39:03.485 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.482+0000 7f57373ad700 1 Processor -- start 2023-10-06T04:39:03.485 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.482+0000 7f57373ad700 1 -- start start 2023-10-06T04:39:03.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.483+0000 7f57373ad700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f57300b11a0 0x7f57300b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:03.487 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.483+0000 7f57373ad700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573006cc20 con 0x7f57301597c0 2023-10-06T04:39:03.487 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.483+0000 7f57373ad700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573006cf00 con 0x7f573006dff0 2023-10-06T04:39:03.487 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.483+0000 7f57373ad700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573006d1e0 con 0x7f57300b11a0 2023-10-06T04:39:03.487 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.483+0000 7f5734948700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f57300b11a0 0x7f57300b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:03.487 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.483+0000 7f573594a700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f573006dff0 0x7f57300ca250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:58640/0 (socket says 172.21.15.179:58640) 2023-10-06T04:39:03.487 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.484+0000 7f573594a700 1 -- 172.21.15.179:0/2000083620 learned_addr learned my addr 172.21.15.179:0/2000083620 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-10-06T04:39:03.487 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.484+0000 7f5734948700 1 -- 172.21.15.179:0/2000083620 >> v1:172.21.15.179:6789/0 conn(0x7f573006dff0 legacy=0x7f57300ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:03.487 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.484+0000 7f5734948700 1 -- 172.21.15.179:0/2000083620 >> v1:172.21.15.112:6789/0 conn(0x7f57301597c0 legacy=0x7f57300ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:03.487 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.484+0000 7f5734948700 1 -- 172.21.15.179:0/2000083620 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573006d4c0 con 0x7f57300b11a0 2023-10-06T04:39:03.488 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.484+0000 7f5734948700 1 --2- 172.21.15.179:0/2000083620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57300b11a0 0x7f57300b28f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f572c0098e0 tx=0x7f572c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b811d5b1558463cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:03.488 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.484+0000 7f5727fff700 1 -- 172.21.15.179:0/2000083620 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c009e80 con 0x7f57300b11a0 2023-10-06T04:39:03.488 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.484+0000 7f5727fff700 1 -- 172.21.15.179:0/2000083620 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c00b860 con 0x7f57300b11a0 2023-10-06T04:39:03.488 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.484+0000 7f5727fff700 1 -- 172.21.15.179:0/2000083620 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c00bbe0 con 0x7f57300b11a0 2023-10-06T04:39:03.489 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.485+0000 7f57373ad700 1 -- 172.21.15.179:0/2000083620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57300b11a0 msgr2=0x7f57300b28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:03.489 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.485+0000 7f57373ad700 1 --2- 172.21.15.179:0/2000083620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57300b11a0 0x7f57300b28f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f572c0098e0 tx=0x7f572c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.489 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.485+0000 7f57373ad700 1 -- 172.21.15.179:0/2000083620 shutdown_connections 2023-10-06T04:39:03.489 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.485+0000 7f57373ad700 1 --2- 172.21.15.179:0/2000083620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57300b11a0 0x7f57300b28f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.489 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.485+0000 7f57373ad700 1 -- 172.21.15.179:0/2000083620 >> 172.21.15.179:0/2000083620 conn(0x7f5730068650 msgr2=0x7f573006d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:03.489 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.485+0000 7f57373ad700 1 -- 172.21.15.179:0/2000083620 shutdown_connections 2023-10-06T04:39:03.489 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.485+0000 7f57373ad700 1 -- 172.21.15.179:0/2000083620 wait complete. 2023-10-06T04:39:03.489 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.486+0000 7f57373ad700 1 Processor -- start 2023-10-06T04:39:03.490 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.486+0000 7f57373ad700 1 -- start start 2023-10-06T04:39:03.492 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.487+0000 7f57373ad700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f573006dff0 0x7f5730154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:03.492 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.487+0000 7f57373ad700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57300b11a0 0x7f573015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:03.493 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.487+0000 7f57373ad700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57301597c0 0x7f57300cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:03.493 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.487+0000 7f57373ad700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57300cd2a0 con 0x7f57301597c0 2023-10-06T04:39:03.493 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.487+0000 7f57373ad700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573015a040 con 0x7f57300b11a0 2023-10-06T04:39:03.493 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.487+0000 7f57373ad700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573015a2e0 con 0x7f573006dff0 2023-10-06T04:39:03.493 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.487+0000 7f5734948700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57300b11a0 0x7f573015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:03.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.487+0000 7f5734948700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57300b11a0 0x7f573015b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:59930/0 (socket says 172.21.15.179:59930) 2023-10-06T04:39:03.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.487+0000 7f5734948700 1 -- 172.21.15.179:0/1804514272 learned_addr learned my addr 172.21.15.179:0/1804514272 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-06T04:39:03.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.487+0000 7f5735149700 1 --2- 172.21.15.179:0/1804514272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f573006dff0 0x7f5730154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:03.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.487+0000 7f573594a700 1 --2- 172.21.15.179:0/1804514272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57301597c0 0x7f57300cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:03.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.487+0000 7f5734948700 1 -- 172.21.15.179:0/1804514272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f573006dff0 msgr2=0x7f5730154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:03.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.487+0000 7f5734948700 1 --2- 172.21.15.179:0/1804514272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f573006dff0 0x7f5730154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.487+0000 7f5734948700 1 -- 172.21.15.179:0/1804514272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57301597c0 msgr2=0x7f57300cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:03.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.487+0000 7f5734948700 1 --2- 172.21.15.179:0/1804514272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57301597c0 0x7f57300cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.487+0000 7f5734948700 1 -- 172.21.15.179:0/1804514272 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c009420 con 0x7f57300b11a0 2023-10-06T04:39:03.496 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.488+0000 7f5734948700 1 --2- 172.21.15.179:0/1804514272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57300b11a0 0x7f573015b0a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f572c013000 tx=0x7f572c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:03.496 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.488+0000 7f57257fa700 1 -- 172.21.15.179:0/1804514272 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c00b9d0 con 0x7f57300b11a0 2023-10-06T04:39:03.496 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.488+0000 7f57257fa700 1 -- 172.21.15.179:0/1804514272 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c00bb30 con 0x7f57300b11a0 2023-10-06T04:39:03.496 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.488+0000 7f57257fa700 1 -- 172.21.15.179:0/1804514272 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c025650 con 0x7f57300b11a0 2023-10-06T04:39:03.496 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.488+0000 7f57373ad700 1 -- 172.21.15.179:0/1804514272 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573015a5c0 con 0x7f57300b11a0 2023-10-06T04:39:03.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.488+0000 7f57373ad700 1 -- 172.21.15.179:0/1804514272 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573015ab80 con 0x7f57300b11a0 2023-10-06T04:39:03.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.488+0000 7f57257fa700 1 -- 172.21.15.179:0/1804514272 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f572c023070 con 0x7f57300b11a0 2023-10-06T04:39:03.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.488+0000 7f57257fa700 1 -- 172.21.15.179:0/1804514272 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f572c02f5c0 con 0x7f57300b11a0 2023-10-06T04:39:03.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.489+0000 7f57373ad700 1 -- 172.21.15.179:0/1804514272 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573015ad70 con 0x7f57300b11a0 2023-10-06T04:39:03.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.491+0000 7f57257fa700 1 -- 172.21.15.179:0/1804514272 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f572c02a070 con 0x7f57300b11a0 2023-10-06T04:39:03.577 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.574+0000 7f57373ad700 1 -- 172.21.15.179:0/1804514272 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ee62e73f-1746-456a-9a1d-628f702005fa", "id": 0} v 0) v1 -- 0x7f573005f230 con 0x7f57300b11a0 2023-10-06T04:39:03.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.580+0000 7f57257fa700 1 -- 172.21.15.179:0/1804514272 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ee62e73f-1746-456a-9a1d-628f702005fa", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f572c015020 con 0x7f57300b11a0 2023-10-06T04:39:03.583 INFO:teuthology.orchestra.run.smithi179.stdout:0 2023-10-06T04:39:03.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.581+0000 7f57373ad700 1 -- 172.21.15.179:0/1804514272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57300b11a0 msgr2=0x7f573015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:03.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.581+0000 7f57373ad700 1 --2- 172.21.15.179:0/1804514272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57300b11a0 0x7f573015b0a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f572c013000 tx=0x7f572c017000 comp rx=0 tx=0).stop 2023-10-06T04:39:03.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.581+0000 7f57373ad700 1 -- 172.21.15.179:0/1804514272 shutdown_connections 2023-10-06T04:39:03.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.581+0000 7f57373ad700 1 --2- 172.21.15.179:0/1804514272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57301597c0 0x7f57300cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.581+0000 7f57373ad700 1 --2- 172.21.15.179:0/1804514272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f573006dff0 0x7f5730154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.581+0000 7f57373ad700 1 --2- 172.21.15.179:0/1804514272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57300b11a0 0x7f573015b0a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.581+0000 7f57373ad700 1 -- 172.21.15.179:0/1804514272 >> 172.21.15.179:0/1804514272 conn(0x7f5730068650 msgr2=0x7f57300ae2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:03.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.581+0000 7f57373ad700 1 -- 172.21.15.179:0/1804514272 shutdown_connections 2023-10-06T04:39:03.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.581+0000 7f57373ad700 1 -- 172.21.15.179:0/1804514272 wait complete. 2023-10-06T04:39:03.595 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 0e3f8f45-7bb4-474e-8605-c24751329738 1 2023-10-06T04:39:03.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.708+0000 7f8073fff700 1 Processor -- start 2023-10-06T04:39:03.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.708+0000 7f8073fff700 1 -- start start 2023-10-06T04:39:03.713 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.709+0000 7f8073fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f80740ab810 0x7f80740c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:03.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.709+0000 7f8073fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f80740aede0 0x7f80740bf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:03.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.709+0000 7f8073fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f807406abc0 con 0x7f807406b050 2023-10-06T04:39:03.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.709+0000 7f8073fff700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80740af530 con 0x7f80740aede0 2023-10-06T04:39:03.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.709+0000 7f8073fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f807406a290 con 0x7f80740ab810 2023-10-06T04:39:03.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.709+0000 7f8072ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f80740ab810 0x7f80740c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:03.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.709+0000 7f80727fc700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f807406b050 0x7f80740abbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:58654/0 (socket says 172.21.15.179:58654) 2023-10-06T04:39:03.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.709+0000 7f80727fc700 1 -- 172.21.15.179:0/4168906097 learned_addr learned my addr 172.21.15.179:0/4168906097 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-10-06T04:39:03.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.709+0000 7f80737fe700 1 --2- 172.21.15.179:0/4168906097 >> v2:172.21.15.112:3300/0 conn(0x7f80740aede0 0x7f80740bf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:03.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.710+0000 7f8071ffb700 1 -- 172.21.15.179:0/4168906097 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50771141 0 0) 0x7f807406abc0 con 0x7f807406b050 2023-10-06T04:39:03.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.710+0000 7f8072ffd700 1 -- 172.21.15.179:0/4168906097 >> v2:172.21.15.112:3300/0 conn(0x7f80740aede0 msgr2=0x7f80740bf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:03.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.710+0000 7f8072ffd700 1 --2- 172.21.15.179:0/4168906097 >> v2:172.21.15.112:3300/0 conn(0x7f80740aede0 0x7f80740bf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.710+0000 7f8072ffd700 1 -- 172.21.15.179:0/4168906097 >> v1:172.21.15.179:6789/0 conn(0x7f807406b050 legacy=0x7f80740abbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:03.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.710+0000 7f8072ffd700 1 -- 172.21.15.179:0/4168906097 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807406a570 con 0x7f80740ab810 2023-10-06T04:39:03.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.710+0000 7f8072ffd700 1 --2- 172.21.15.179:0/4168906097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80740ab810 0x7f80740c8f40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f807406fc70 tx=0x7f806c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42730ede95df7293 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:03.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.710+0000 7f8071ffb700 1 -- 172.21.15.179:0/4168906097 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c011630 con 0x7f80740ab810 2023-10-06T04:39:03.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.710+0000 7f8071ffb700 1 -- 172.21.15.179:0/4168906097 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c011790 con 0x7f80740ab810 2023-10-06T04:39:03.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.710+0000 7f8071ffb700 1 -- 172.21.15.179:0/4168906097 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c011b30 con 0x7f80740ab810 2023-10-06T04:39:03.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.710+0000 7f8073fff700 1 -- 172.21.15.179:0/4168906097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80740ab810 msgr2=0x7f80740c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:03.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.710+0000 7f8073fff700 1 --2- 172.21.15.179:0/4168906097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80740ab810 0x7f80740c8f40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f807406fc70 tx=0x7f806c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.716 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.710+0000 7f8073fff700 1 -- 172.21.15.179:0/4168906097 shutdown_connections 2023-10-06T04:39:03.716 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.710+0000 7f8073fff700 1 --2- 172.21.15.179:0/4168906097 >> v2:172.21.15.112:3300/0 conn(0x7f80740aede0 0x7f80740bf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.716 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.710+0000 7f8073fff700 1 --2- 172.21.15.179:0/4168906097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80740ab810 0x7f80740c8f40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.716 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.710+0000 7f8073fff700 1 -- 172.21.15.179:0/4168906097 >> 172.21.15.179:0/4168906097 conn(0x7f80740cca90 msgr2=0x7f80740cce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:03.716 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.710+0000 7f8073fff700 1 -- 172.21.15.179:0/4168906097 shutdown_connections 2023-10-06T04:39:03.716 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.711+0000 7f8073fff700 1 -- 172.21.15.179:0/4168906097 wait complete. 2023-10-06T04:39:03.718 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.712+0000 7f8073fff700 1 Processor -- start 2023-10-06T04:39:03.718 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.712+0000 7f8073fff700 1 -- start start 2023-10-06T04:39:03.718 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.712+0000 7f8073fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f807406b050 0x7f80740c1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:03.718 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.712+0000 7f8073fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80740ab810 0x7f80740cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:03.718 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.712+0000 7f8073fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80740aede0 0x7f807414a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:03.719 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.712+0000 7f8073fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80740c2500 con 0x7f80740ab810 2023-10-06T04:39:03.719 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.712+0000 7f8073fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80740c27e0 con 0x7f807406b050 2023-10-06T04:39:03.719 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.712+0000 7f8073fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80740c2ac0 con 0x7f80740aede0 2023-10-06T04:39:03.719 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.713+0000 7f8072ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f807406b050 0x7f80740c1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:03.719 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.713+0000 7f80737fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80740aede0 0x7f807414a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:03.719 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.713+0000 7f8072ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f807406b050 0x7f80740c1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:59956/0 (socket says 172.21.15.179:59956) 2023-10-06T04:39:03.719 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.713+0000 7f8072ffd700 1 -- 172.21.15.179:0/1570104868 learned_addr learned my addr 172.21.15.179:0/1570104868 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-06T04:39:03.719 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.713+0000 7f80727fc700 1 --2- 172.21.15.179:0/1570104868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80740ab810 0x7f80740cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:03.719 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.713+0000 7f8072ffd700 1 -- 172.21.15.179:0/1570104868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80740aede0 msgr2=0x7f807414a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:03.719 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.713+0000 7f8072ffd700 1 --2- 172.21.15.179:0/1570104868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80740aede0 0x7f807414a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.719 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.713+0000 7f8072ffd700 1 -- 172.21.15.179:0/1570104868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80740ab810 msgr2=0x7f80740cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:03.720 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.713+0000 7f8072ffd700 1 --2- 172.21.15.179:0/1570104868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80740ab810 0x7f80740cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.720 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.713+0000 7f8072ffd700 1 -- 172.21.15.179:0/1570104868 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806c009420 con 0x7f807406b050 2023-10-06T04:39:03.720 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.713+0000 7f80737fe700 1 --2- 172.21.15.179:0/1570104868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80740aede0 0x7f807414a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:03.720 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.713+0000 7f8072ffd700 1 --2- 172.21.15.179:0/1570104868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f807406b050 0x7f80740c1b40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f807406a3d0 tx=0x7f806c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:03.720 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.713+0000 7f805affd700 1 -- 172.21.15.179:0/1570104868 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c000d10 con 0x7f807406b050 2023-10-06T04:39:03.720 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.713+0000 7f805affd700 1 -- 172.21.15.179:0/1570104868 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c011b10 con 0x7f807406b050 2023-10-06T04:39:03.720 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.713+0000 7f805affd700 1 -- 172.21.15.179:0/1570104868 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c025640 con 0x7f807406b050 2023-10-06T04:39:03.720 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.713+0000 7f8073fff700 1 -- 172.21.15.179:0/1570104868 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80740c2da0 con 0x7f807406b050 2023-10-06T04:39:03.720 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.713+0000 7f8073fff700 1 -- 172.21.15.179:0/1570104868 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807415e3a0 con 0x7f807406b050 2023-10-06T04:39:03.720 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.713+0000 7f805affd700 1 -- 172.21.15.179:0/1570104868 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f806c025cb0 con 0x7f807406b050 2023-10-06T04:39:03.720 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.713+0000 7f805affd700 1 -- 172.21.15.179:0/1570104868 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f806c02ec10 con 0x7f807406b050 2023-10-06T04:39:03.721 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.714+0000 7f8073fff700 1 -- 172.21.15.179:0/1570104868 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807405f230 con 0x7f807406b050 2023-10-06T04:39:03.721 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.716+0000 7f805affd700 1 -- 172.21.15.179:0/1570104868 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f806c033060 con 0x7f807406b050 2023-10-06T04:39:03.804 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.800+0000 7f8073fff700 1 -- 172.21.15.179:0/1570104868 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0e3f8f45-7bb4-474e-8605-c24751329738", "id": 1} v 0) v1 -- 0x7f807406a850 con 0x7f807406b050 2023-10-06T04:39:03.807 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.805+0000 7f805affd700 1 -- 172.21.15.179:0/1570104868 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0e3f8f45-7bb4-474e-8605-c24751329738", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f806c015020 con 0x7f807406b050 2023-10-06T04:39:03.808 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-10-06T04:39:03.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.806+0000 7f8073fff700 1 -- 172.21.15.179:0/1570104868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f807406b050 msgr2=0x7f80740c1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:03.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.806+0000 7f8073fff700 1 --2- 172.21.15.179:0/1570104868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f807406b050 0x7f80740c1b40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f807406a3d0 tx=0x7f806c017000 comp rx=0 tx=0).stop 2023-10-06T04:39:03.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.806+0000 7f8073fff700 1 -- 172.21.15.179:0/1570104868 shutdown_connections 2023-10-06T04:39:03.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.806+0000 7f8073fff700 1 --2- 172.21.15.179:0/1570104868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80740aede0 0x7f807414a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.806+0000 7f8073fff700 1 --2- 172.21.15.179:0/1570104868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f807406b050 0x7f80740c1b40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.806+0000 7f8073fff700 1 --2- 172.21.15.179:0/1570104868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80740ab810 0x7f80740cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.806+0000 7f8073fff700 1 -- 172.21.15.179:0/1570104868 >> 172.21.15.179:0/1570104868 conn(0x7f80740cca90 msgr2=0x7f807415a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:03.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.806+0000 7f8073fff700 1 -- 172.21.15.179:0/1570104868 shutdown_connections 2023-10-06T04:39:03.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.806+0000 7f8073fff700 1 -- 172.21.15.179:0/1570104868 wait complete. 2023-10-06T04:39:03.820 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 433ec17b-d963-4c91-8221-62c6a56a7552 2 2023-10-06T04:39:03.938 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.935+0000 7f9bc930e700 1 Processor -- start 2023-10-06T04:39:03.938 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.935+0000 7f9bc930e700 1 -- start start 2023-10-06T04:39:03.940 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.936+0000 7f9bc930e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9bc41597c0 0x7f9bc40ace30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:03.940 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.936+0000 7f9bc930e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bc40b11a0 0x7f9bc40b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:03.940 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.936+0000 7f9bc930e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc406cc20 con 0x7f9bc406dff0 2023-10-06T04:39:03.940 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.936+0000 7f9bc930e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc406cf00 con 0x7f9bc41597c0 2023-10-06T04:39:03.941 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.936+0000 7f9bc930e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc406d1e0 con 0x7f9bc40b11a0 2023-10-06T04:39:03.941 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.936+0000 7f9bc2ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9bc41597c0 0x7f9bc40ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:03.941 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.936+0000 7f9bc27fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bc40b11a0 0x7f9bc40b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:03.941 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.936+0000 7f9bc2ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9bc41597c0 0x7f9bc40ace30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:59966/0 (socket says 172.21.15.179:59966) 2023-10-06T04:39:03.941 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.936+0000 7f9bc27fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bc40b11a0 0x7f9bc40b28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:45416/0 (socket says 172.21.15.179:45416) 2023-10-06T04:39:03.941 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.936+0000 7f9bc2ffd700 1 -- 172.21.15.179:0/461556992 learned_addr learned my addr 172.21.15.179:0/461556992 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-06T04:39:03.941 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.936+0000 7f9bc27fc700 1 -- 172.21.15.179:0/461556992 >> v2:172.21.15.179:3300/0 conn(0x7f9bc41597c0 msgr2=0x7f9bc40ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:03.941 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.936+0000 7f9bc27fc700 1 --2- 172.21.15.179:0/461556992 >> v2:172.21.15.179:3300/0 conn(0x7f9bc41597c0 0x7f9bc40ace30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.941 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.936+0000 7f9bc27fc700 1 -- 172.21.15.179:0/461556992 >> v1:172.21.15.112:6789/0 conn(0x7f9bc406dff0 legacy=0x7f9bc40ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:03.941 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.936+0000 7f9bc27fc700 1 -- 172.21.15.179:0/461556992 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc406d4c0 con 0x7f9bc40b11a0 2023-10-06T04:39:03.941 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.936+0000 7f9bc2ffd700 1 --2- 172.21.15.179:0/461556992 >> v2:172.21.15.179:3300/0 conn(0x7f9bc41597c0 0x7f9bc40ace30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:03.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.936+0000 7f9bc27fc700 1 --2- 172.21.15.179:0/461556992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bc40b11a0 0x7f9bc40b28f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40098e0 tx=0x7f9bb40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6635592ad80e36de server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:03.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.937+0000 7f9bc1ffb700 1 -- 172.21.15.179:0/461556992 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb400b640 con 0x7f9bc40b11a0 2023-10-06T04:39:03.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.937+0000 7f9bc1ffb700 1 -- 172.21.15.179:0/461556992 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb400b7a0 con 0x7f9bc40b11a0 2023-10-06T04:39:03.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.937+0000 7f9bc1ffb700 1 -- 172.21.15.179:0/461556992 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb400bb40 con 0x7f9bc40b11a0 2023-10-06T04:39:03.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.937+0000 7f9bc930e700 1 -- 172.21.15.179:0/461556992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bc40b11a0 msgr2=0x7f9bc40b28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:03.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.937+0000 7f9bc930e700 1 --2- 172.21.15.179:0/461556992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bc40b11a0 0x7f9bc40b28f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40098e0 tx=0x7f9bb40091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.937+0000 7f9bc930e700 1 -- 172.21.15.179:0/461556992 shutdown_connections 2023-10-06T04:39:03.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.937+0000 7f9bc930e700 1 --2- 172.21.15.179:0/461556992 >> v2:172.21.15.179:3300/0 conn(0x7f9bc41597c0 0x7f9bc40ace30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.937+0000 7f9bc930e700 1 --2- 172.21.15.179:0/461556992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bc40b11a0 0x7f9bc40b28f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.937+0000 7f9bc930e700 1 -- 172.21.15.179:0/461556992 >> 172.21.15.179:0/461556992 conn(0x7f9bc4068650 msgr2=0x7f9bc406d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:03.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.937+0000 7f9bc930e700 1 -- 172.21.15.179:0/461556992 shutdown_connections 2023-10-06T04:39:03.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.937+0000 7f9bc930e700 1 -- 172.21.15.179:0/461556992 wait complete. 2023-10-06T04:39:03.943 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:03.939+0000 7f1ef8c35180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T04:39:03.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.939+0000 7f9bc930e700 1 Processor -- start 2023-10-06T04:39:03.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.939+0000 7f9bc930e700 1 -- start start 2023-10-06T04:39:03.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.939+0000 7f9bc930e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bc406dff0 0x7f9bc415fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:03.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.939+0000 7f9bc930e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bc40b11a0 0x7f9bc415adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:03.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.939+0000 7f9bc930e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bc41597c0 0x7f9bc4148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:03.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.939+0000 7f9bc930e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc40ac6d0 con 0x7f9bc406dff0 2023-10-06T04:39:03.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.939+0000 7f9bc930e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc415bd60 con 0x7f9bc41597c0 2023-10-06T04:39:03.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.939+0000 7f9bc930e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc415c8a0 con 0x7f9bc40b11a0 2023-10-06T04:39:03.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.940+0000 7f9bc27fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bc40b11a0 0x7f9bc415adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:03.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.940+0000 7f9bc27fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bc40b11a0 0x7f9bc415adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:45430/0 (socket says 172.21.15.179:45430) 2023-10-06T04:39:03.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.940+0000 7f9bc37fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bc41597c0 0x7f9bc4148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:03.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.940+0000 7f9bc27fc700 1 -- 172.21.15.179:0/3604722089 learned_addr learned my addr 172.21.15.179:0/3604722089 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-06T04:39:03.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.940+0000 7f9bc2ffd700 1 --2- 172.21.15.179:0/3604722089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bc406dff0 0x7f9bc415fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:03.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.940+0000 7f9bc27fc700 1 -- 172.21.15.179:0/3604722089 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bc41597c0 msgr2=0x7f9bc4148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:03.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.940+0000 7f9bc27fc700 1 --2- 172.21.15.179:0/3604722089 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bc41597c0 0x7f9bc4148ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.940+0000 7f9bc27fc700 1 -- 172.21.15.179:0/3604722089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bc406dff0 msgr2=0x7f9bc415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:03.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.940+0000 7f9bc27fc700 1 --2- 172.21.15.179:0/3604722089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bc406dff0 0x7f9bc415fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:03.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.940+0000 7f9bc27fc700 1 -- 172.21.15.179:0/3604722089 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb80094f0 con 0x7f9bc40b11a0 2023-10-06T04:39:03.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.940+0000 7f9bc37fe700 1 --2- 172.21.15.179:0/3604722089 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bc41597c0 0x7f9bc4148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:03.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.940+0000 7f9bc27fc700 1 --2- 172.21.15.179:0/3604722089 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bc40b11a0 0x7f9bc415adb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9bc40cd3d0 tx=0x7f9bb4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:03.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.940+0000 7f9baaffd700 1 -- 172.21.15.179:0/3604722089 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb401bc40 con 0x7f9bc40b11a0 2023-10-06T04:39:03.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.940+0000 7f9baaffd700 1 -- 172.21.15.179:0/3604722089 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb401bda0 con 0x7f9bc40b11a0 2023-10-06T04:39:03.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.940+0000 7f9bc930e700 1 -- 172.21.15.179:0/3604722089 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb4009420 con 0x7f9bc40b11a0 2023-10-06T04:39:03.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.940+0000 7f9baaffd700 1 -- 172.21.15.179:0/3604722089 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4011650 con 0x7f9bc40b11a0 2023-10-06T04:39:03.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.940+0000 7f9bc930e700 1 -- 172.21.15.179:0/3604722089 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc415c5c0 con 0x7f9bc40b11a0 2023-10-06T04:39:03.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.940+0000 7f9baaffd700 1 -- 172.21.15.179:0/3604722089 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9bb4011cc0 con 0x7f9bc40b11a0 2023-10-06T04:39:03.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.940+0000 7f9baaffd700 1 -- 172.21.15.179:0/3604722089 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f9bb4025ce0 con 0x7f9bc40b11a0 2023-10-06T04:39:03.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.941+0000 7f9bc930e700 1 -- 172.21.15.179:0/3604722089 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bc405f230 con 0x7f9bc40b11a0 2023-10-06T04:39:03.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:03.943+0000 7f9baaffd700 1 -- 172.21.15.179:0/3604722089 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9bb4029070 con 0x7f9bc40b11a0 2023-10-06T04:39:03.982 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:03.979+0000 7f4040b1a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T04:39:04.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.026+0000 7f9bc930e700 1 -- 172.21.15.179:0/3604722089 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "433ec17b-d963-4c91-8221-62c6a56a7552", "id": 2} v 0) v1 -- 0x7f9bc40af5d0 con 0x7f9bc40b11a0 2023-10-06T04:39:04.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.033+0000 7f9baaffd700 1 -- 172.21.15.179:0/3604722089 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "433ec17b-d963-4c91-8221-62c6a56a7552", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9bb4015020 con 0x7f9bc40b11a0 2023-10-06T04:39:04.036 INFO:teuthology.orchestra.run.smithi179.stdout:2 2023-10-06T04:39:04.037 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.034+0000 7f9bc930e700 1 -- 172.21.15.179:0/3604722089 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bc40b11a0 msgr2=0x7f9bc415adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.037 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.034+0000 7f9bc930e700 1 --2- 172.21.15.179:0/3604722089 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bc40b11a0 0x7f9bc415adb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9bc40cd3d0 tx=0x7f9bb4017000 comp rx=0 tx=0).stop 2023-10-06T04:39:04.037 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.034+0000 7f9bc930e700 1 -- 172.21.15.179:0/3604722089 shutdown_connections 2023-10-06T04:39:04.037 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.034+0000 7f9bc930e700 1 --2- 172.21.15.179:0/3604722089 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bc41597c0 0x7f9bc4148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.038 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.034+0000 7f9bc930e700 1 --2- 172.21.15.179:0/3604722089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bc406dff0 0x7f9bc415fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.038 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.034+0000 7f9bc930e700 1 --2- 172.21.15.179:0/3604722089 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bc40b11a0 0x7f9bc415adb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.038 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.034+0000 7f9bc930e700 1 -- 172.21.15.179:0/3604722089 >> 172.21.15.179:0/3604722089 conn(0x7f9bc4068650 msgr2=0x7f9bc40aeb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:04.038 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.034+0000 7f9bc930e700 1 -- 172.21.15.179:0/3604722089 shutdown_connections 2023-10-06T04:39:04.038 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.034+0000 7f9bc930e700 1 -- 172.21.15.179:0/3604722089 wait complete. 2023-10-06T04:39:04.049 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 971a992c-3499-4f4b-a792-8cd91076a33d 3 2023-10-06T04:39:04.073 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:04.071+0000 7f1ef8c35180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T04:39:04.120 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:04.118+0000 7f4040b1a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T04:39:04.147 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:04.145+0000 7f1ef8c35180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T04:39:04.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.162+0000 7fb2f3069700 1 Processor -- start 2023-10-06T04:39:04.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.162+0000 7fb2f3069700 1 -- start start 2023-10-06T04:39:04.171 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.163+0000 7fb2f3069700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec15a9b0 0x7fb2ec0c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.171 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.163+0000 7fb2f3069700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb2ec0ca210 0x7fb2ec06afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.171 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.163+0000 7fb2f3069700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ec0ca670 con 0x7fb2ec0b2520 2023-10-06T04:39:04.171 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.163+0000 7fb2f3069700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ec1568e0 con 0x7fb2ec0ca210 2023-10-06T04:39:04.173 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.163+0000 7fb2f3069700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0cacb0 con 0x7fb2ec15a9b0 2023-10-06T04:39:04.173 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.163+0000 7fb2f2868700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb2ec0ca210 0x7fb2ec06afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.173 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.163+0000 7fb2f1866700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec15a9b0 0x7fb2ec0c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.173 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.163+0000 7fb2f2868700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb2ec0ca210 0x7fb2ec06afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:59984/0 (socket says 172.21.15.179:59984) 2023-10-06T04:39:04.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.163+0000 7fb2f2868700 1 -- 172.21.15.179:0/2007305938 learned_addr learned my addr 172.21.15.179:0/2007305938 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-06T04:39:04.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.163+0000 7fb2f1866700 1 -- 172.21.15.179:0/2007305938 >> v2:172.21.15.179:3300/0 conn(0x7fb2ec0ca210 msgr2=0x7fb2ec06afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:04.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.163+0000 7fb2f1866700 1 --2- 172.21.15.179:0/2007305938 >> v2:172.21.15.179:3300/0 conn(0x7fb2ec0ca210 0x7fb2ec06afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.163+0000 7fb2f1866700 1 -- 172.21.15.179:0/2007305938 >> v1:172.21.15.112:6789/0 conn(0x7fb2ec0b2520 legacy=0x7fb2ec0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.164+0000 7fb2f1866700 1 -- 172.21.15.179:0/2007305938 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec06ab20 con 0x7fb2ec15a9b0 2023-10-06T04:39:04.175 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.164+0000 7fb2f2868700 1 --2- 172.21.15.179:0/2007305938 >> v2:172.21.15.179:3300/0 conn(0x7fb2ec0ca210 0x7fb2ec06afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:04.175 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.164+0000 7fb2f1866700 1 --2- 172.21.15.179:0/2007305938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec15a9b0 0x7fb2ec0c9cd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb2e80098e0 tx=0x7fb2e80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27eb883a10cbbb03 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:04.175 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.164+0000 7fb2f1065700 1 -- 172.21.15.179:0/2007305938 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e800b640 con 0x7fb2ec15a9b0 2023-10-06T04:39:04.175 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.164+0000 7fb2f1065700 1 -- 172.21.15.179:0/2007305938 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e800b7a0 con 0x7fb2ec15a9b0 2023-10-06T04:39:04.175 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.164+0000 7fb2f1065700 1 -- 172.21.15.179:0/2007305938 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e800bb40 con 0x7fb2ec15a9b0 2023-10-06T04:39:04.175 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.164+0000 7fb2f3069700 1 -- 172.21.15.179:0/2007305938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec15a9b0 msgr2=0x7fb2ec0c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.175 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.164+0000 7fb2f3069700 1 --2- 172.21.15.179:0/2007305938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec15a9b0 0x7fb2ec0c9cd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb2e80098e0 tx=0x7fb2e80091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.175 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.165+0000 7fb2f3069700 1 -- 172.21.15.179:0/2007305938 shutdown_connections 2023-10-06T04:39:04.175 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.165+0000 7fb2f3069700 1 --2- 172.21.15.179:0/2007305938 >> v2:172.21.15.179:3300/0 conn(0x7fb2ec0ca210 0x7fb2ec06afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.165+0000 7fb2f3069700 1 --2- 172.21.15.179:0/2007305938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec15a9b0 0x7fb2ec0c9cd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.165+0000 7fb2f3069700 1 -- 172.21.15.179:0/2007305938 >> 172.21.15.179:0/2007305938 conn(0x7fb2ec06d8e0 msgr2=0x7fb2ec06dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:04.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.165+0000 7fb2f3069700 1 -- 172.21.15.179:0/2007305938 shutdown_connections 2023-10-06T04:39:04.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.165+0000 7fb2f3069700 1 -- 172.21.15.179:0/2007305938 wait complete. 2023-10-06T04:39:04.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.166+0000 7fb2f3069700 1 Processor -- start 2023-10-06T04:39:04.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.166+0000 7fb2f3069700 1 -- start start 2023-10-06T04:39:04.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.166+0000 7fb2f3069700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec0b2520 0x7fb2ec14adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.166+0000 7fb2f3069700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2ec0ca210 0x7fb2ec14ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.177 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.166+0000 7fb2f3069700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2ec15a9b0 0x7fb2ec14b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.177 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.166+0000 7fb2f3069700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec14b300 con 0x7fb2ec15a9b0 2023-10-06T04:39:04.177 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.166+0000 7fb2f3069700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec14f4c0 con 0x7fb2ec0ca210 2023-10-06T04:39:04.177 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.166+0000 7fb2f3069700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec14c120 con 0x7fb2ec0b2520 2023-10-06T04:39:04.177 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.166+0000 7fb2f1866700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2ec0ca210 0x7fb2ec14ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.177 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.167+0000 7fb2f1866700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2ec0ca210 0x7fb2ec14ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:59986/0 (socket says 172.21.15.179:59986) 2023-10-06T04:39:04.177 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.167+0000 7fb2f1866700 1 -- 172.21.15.179:0/1214330812 learned_addr learned my addr 172.21.15.179:0/1214330812 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-06T04:39:04.177 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.167+0000 7fb2f2067700 1 --2- 172.21.15.179:0/1214330812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec0b2520 0x7fb2ec14adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.177 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.167+0000 7fb2f2868700 1 --2- 172.21.15.179:0/1214330812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2ec15a9b0 0x7fb2ec14b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.177 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.167+0000 7fb2f1866700 1 -- 172.21.15.179:0/1214330812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec0b2520 msgr2=0x7fb2ec14adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.178 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.167+0000 7fb2f1866700 1 --2- 172.21.15.179:0/1214330812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec0b2520 0x7fb2ec14adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.178 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.167+0000 7fb2f1866700 1 -- 172.21.15.179:0/1214330812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2ec15a9b0 msgr2=0x7fb2ec14b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.178 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.167+0000 7fb2f1866700 1 --2- 172.21.15.179:0/1214330812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2ec15a9b0 0x7fb2ec14b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.178 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.167+0000 7fb2f1866700 1 -- 172.21.15.179:0/1214330812 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e4009ae0 con 0x7fb2ec0ca210 2023-10-06T04:39:04.178 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.167+0000 7fb2f1866700 1 --2- 172.21.15.179:0/1214330812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2ec0ca210 0x7fb2ec14ce60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0cadf0 tx=0x7fb2e8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:04.178 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.167+0000 7fb2e27fc700 1 -- 172.21.15.179:0/1214330812 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e801bb30 con 0x7fb2ec0ca210 2023-10-06T04:39:04.178 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.167+0000 7fb2e27fc700 1 -- 172.21.15.179:0/1214330812 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e801bcb0 con 0x7fb2ec0ca210 2023-10-06T04:39:04.179 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.167+0000 7fb2f3069700 1 -- 172.21.15.179:0/1214330812 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e8009420 con 0x7fb2ec0ca210 2023-10-06T04:39:04.179 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.167+0000 7fb2e27fc700 1 -- 172.21.15.179:0/1214330812 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e80228b0 con 0x7fb2ec0ca210 2023-10-06T04:39:04.179 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.167+0000 7fb2f3069700 1 -- 172.21.15.179:0/1214330812 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ec14c6e0 con 0x7fb2ec0ca210 2023-10-06T04:39:04.179 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.167+0000 7fb2e27fc700 1 -- 172.21.15.179:0/1214330812 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb2e8011420 con 0x7fb2ec0ca210 2023-10-06T04:39:04.179 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.167+0000 7fb2e27fc700 1 -- 172.21.15.179:0/1214330812 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fb2e801be20 con 0x7fb2ec0ca210 2023-10-06T04:39:04.179 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.168+0000 7fb2f3069700 1 -- 172.21.15.179:0/1214330812 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ec06be20 con 0x7fb2ec0ca210 2023-10-06T04:39:04.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.170+0000 7fb2e27fc700 1 -- 172.21.15.179:0/1214330812 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb2e8026070 con 0x7fb2ec0ca210 2023-10-06T04:39:04.201 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:04.198+0000 7f4040b1a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T04:39:04.256 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.253+0000 7fb2f3069700 1 -- 172.21.15.179:0/1214330812 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "971a992c-3499-4f4b-a792-8cd91076a33d", "id": 3} v 0) v1 -- 0x7fb2ec14f630 con 0x7fb2ec0ca210 2023-10-06T04:39:04.261 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.259+0000 7fb2e27fc700 1 -- 172.21.15.179:0/1214330812 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "971a992c-3499-4f4b-a792-8cd91076a33d", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb2e8015020 con 0x7fb2ec0ca210 2023-10-06T04:39:04.261 INFO:teuthology.orchestra.run.smithi179.stdout:3 2023-10-06T04:39:04.263 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.260+0000 7fb2f3069700 1 -- 172.21.15.179:0/1214330812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2ec0ca210 msgr2=0x7fb2ec14ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.263 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.260+0000 7fb2f3069700 1 --2- 172.21.15.179:0/1214330812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2ec0ca210 0x7fb2ec14ce60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0cadf0 tx=0x7fb2e8017000 comp rx=0 tx=0).stop 2023-10-06T04:39:04.263 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.260+0000 7fb2f3069700 1 -- 172.21.15.179:0/1214330812 shutdown_connections 2023-10-06T04:39:04.263 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.260+0000 7fb2f3069700 1 --2- 172.21.15.179:0/1214330812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2ec15a9b0 0x7fb2ec14b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.263 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.260+0000 7fb2f3069700 1 --2- 172.21.15.179:0/1214330812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec0b2520 0x7fb2ec14adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.264 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.260+0000 7fb2f3069700 1 --2- 172.21.15.179:0/1214330812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2ec0ca210 0x7fb2ec14ce60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.264 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.260+0000 7fb2f3069700 1 -- 172.21.15.179:0/1214330812 >> 172.21.15.179:0/1214330812 conn(0x7fb2ec06d8e0 msgr2=0x7fb2ec156d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:04.264 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.260+0000 7fb2f3069700 1 -- 172.21.15.179:0/1214330812 shutdown_connections 2023-10-06T04:39:04.264 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.260+0000 7fb2f3069700 1 -- 172.21.15.179:0/1214330812 wait complete. 2023-10-06T04:39:04.274 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 6031b367-0b9d-4928-ba70-f08242317af1 4 2023-10-06T04:39:04.330 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:04.328+0000 7f1ef8c35180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:39:04.391 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.388+0000 7f90f6f51700 1 Processor -- start 2023-10-06T04:39:04.391 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.388+0000 7f90f6f51700 1 -- start start 2023-10-06T04:39:04.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.389+0000 7f90f6f51700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f90f01597c0 0x7f90f00ace30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.389+0000 7f90f6f51700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f006dff0 0x7f90f00ca250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.389+0000 7f90f6f51700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f006cc20 con 0x7f90f00b11a0 2023-10-06T04:39:04.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.389+0000 7f90f6f51700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f006cf00 con 0x7f90f01597c0 2023-10-06T04:39:04.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.389+0000 7f90f6f51700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f006d1e0 con 0x7f90f006dff0 2023-10-06T04:39:04.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.389+0000 7f90effff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f90f00b11a0 0x7f90f00b28f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:58660/0 (socket says 172.21.15.179:58660) 2023-10-06T04:39:04.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.389+0000 7f90effff700 1 -- 172.21.15.179:0/2342612742 learned_addr learned my addr 172.21.15.179:0/2342612742 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-10-06T04:39:04.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.389+0000 7f90f54ee700 1 --2- 172.21.15.179:0/2342612742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f006dff0 0x7f90f00ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.389+0000 7f90f4ced700 1 --2- 172.21.15.179:0/2342612742 >> v2:172.21.15.112:3300/0 conn(0x7f90f01597c0 0x7f90f00ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.389+0000 7f90ef7fe700 1 -- 172.21.15.179:0/2342612742 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230509666 0 0) 0x7f90f006cc20 con 0x7f90f00b11a0 2023-10-06T04:39:04.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.389+0000 7f90ef7fe700 1 -- 172.21.15.179:0/2342612742 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90e0003570 con 0x7f90f00b11a0 2023-10-06T04:39:04.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.389+0000 7f90f54ee700 1 -- 172.21.15.179:0/2342612742 >> v2:172.21.15.112:3300/0 conn(0x7f90f01597c0 msgr2=0x7f90f00ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:04.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.389+0000 7f90f54ee700 1 --2- 172.21.15.179:0/2342612742 >> v2:172.21.15.112:3300/0 conn(0x7f90f01597c0 0x7f90f00ace30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.389+0000 7f90f54ee700 1 -- 172.21.15.179:0/2342612742 >> v1:172.21.15.179:6789/0 conn(0x7f90f00b11a0 legacy=0x7f90f00b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.389+0000 7f90f54ee700 1 -- 172.21.15.179:0/2342612742 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f006d4c0 con 0x7f90f006dff0 2023-10-06T04:39:04.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.390+0000 7f90f54ee700 1 --2- 172.21.15.179:0/2342612742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f006dff0 0x7f90f00ca250 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f90e8009e60 tx=0x7f90e8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e951285bf920800e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:04.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.390+0000 7f90ef7fe700 1 -- 172.21.15.179:0/2342612742 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e800e070 con 0x7f90f006dff0 2023-10-06T04:39:04.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.390+0000 7f90ef7fe700 1 -- 172.21.15.179:0/2342612742 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e800bab0 con 0x7f90f006dff0 2023-10-06T04:39:04.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.390+0000 7f90ef7fe700 1 -- 172.21.15.179:0/2342612742 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e800be70 con 0x7f90f006dff0 2023-10-06T04:39:04.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.390+0000 7f90f6f51700 1 -- 172.21.15.179:0/2342612742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f006dff0 msgr2=0x7f90f00ca250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.390+0000 7f90f6f51700 1 --2- 172.21.15.179:0/2342612742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f006dff0 0x7f90f00ca250 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f90e8009e60 tx=0x7f90e8009780 comp rx=0 tx=0).stop 2023-10-06T04:39:04.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.390+0000 7f90f6f51700 1 -- 172.21.15.179:0/2342612742 shutdown_connections 2023-10-06T04:39:04.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.390+0000 7f90f6f51700 1 --2- 172.21.15.179:0/2342612742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f006dff0 0x7f90f00ca250 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.390+0000 7f90f6f51700 1 --2- 172.21.15.179:0/2342612742 >> v2:172.21.15.112:3300/0 conn(0x7f90f01597c0 0x7f90f00ace30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.390+0000 7f90f6f51700 1 -- 172.21.15.179:0/2342612742 >> 172.21.15.179:0/2342612742 conn(0x7f90f0068650 msgr2=0x7f90f006d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:04.396 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.390+0000 7f90f6f51700 1 -- 172.21.15.179:0/2342612742 shutdown_connections 2023-10-06T04:39:04.396 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.390+0000 7f90f6f51700 1 -- 172.21.15.179:0/2342612742 wait complete. 2023-10-06T04:39:04.397 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.391+0000 7f90f6f51700 1 Processor -- start 2023-10-06T04:39:04.398 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.392+0000 7f90f6f51700 1 -- start start 2023-10-06T04:39:04.398 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.392+0000 7f90f6f51700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90f006dff0 0x7f90f01562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.398 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.392+0000 7f90f6f51700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90f00b11a0 0x7f90f00cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.398 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.392+0000 7f90f6f51700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f01597c0 0x7f90f00cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.398 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.392+0000 7f90f6f51700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00a9890 con 0x7f90f006dff0 2023-10-06T04:39:04.398 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.392+0000 7f90f6f51700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00a9b70 con 0x7f90f00b11a0 2023-10-06T04:39:04.398 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.392+0000 7f90f6f51700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00a9e50 con 0x7f90f01597c0 2023-10-06T04:39:04.398 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.392+0000 7f90effff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90f00b11a0 0x7f90f00cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.398 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.392+0000 7f90f54ee700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f01597c0 0x7f90f00cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.398 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.392+0000 7f90effff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90f00b11a0 0x7f90f00cbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:60002/0 (socket says 172.21.15.179:60002) 2023-10-06T04:39:04.398 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.392+0000 7f90effff700 1 -- 172.21.15.179:0/399194891 learned_addr learned my addr 172.21.15.179:0/399194891 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-06T04:39:04.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.392+0000 7f90f4ced700 1 --2- 172.21.15.179:0/399194891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90f006dff0 0x7f90f01562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.393+0000 7f90effff700 1 -- 172.21.15.179:0/399194891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f01597c0 msgr2=0x7f90f00cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.393+0000 7f90effff700 1 --2- 172.21.15.179:0/399194891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f01597c0 0x7f90f00cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.393+0000 7f90effff700 1 -- 172.21.15.179:0/399194891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90f006dff0 msgr2=0x7f90f01562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.393+0000 7f90effff700 1 --2- 172.21.15.179:0/399194891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90f006dff0 0x7f90f01562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.393+0000 7f90effff700 1 -- 172.21.15.179:0/399194891 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e8009a20 con 0x7f90f00b11a0 2023-10-06T04:39:04.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.393+0000 7f90f4ced700 1 --2- 172.21.15.179:0/399194891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90f006dff0 0x7f90f01562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:04.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.393+0000 7f90effff700 1 --2- 172.21.15.179:0/399194891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90f00b11a0 0x7f90f00cbff0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00c7c0 tx=0x7f90dc007dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:04.399 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:04.393+0000 7f4040b1a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:39:04.400 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.393+0000 7f90ecff9700 1 -- 172.21.15.179:0/399194891 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc005c00 con 0x7f90f00b11a0 2023-10-06T04:39:04.400 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.393+0000 7f90ecff9700 1 -- 172.21.15.179:0/399194891 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc005d60 con 0x7f90f00b11a0 2023-10-06T04:39:04.401 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.393+0000 7f90f6f51700 1 -- 172.21.15.179:0/399194891 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f00aa130 con 0x7f90f00b11a0 2023-10-06T04:39:04.401 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.393+0000 7f90ecff9700 1 -- 172.21.15.179:0/399194891 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc007320 con 0x7f90f00b11a0 2023-10-06T04:39:04.401 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.393+0000 7f90f6f51700 1 -- 172.21.15.179:0/399194891 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f01567e0 con 0x7f90f00b11a0 2023-10-06T04:39:04.401 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.393+0000 7f90ecff9700 1 -- 172.21.15.179:0/399194891 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f90dc01c440 con 0x7f90f00b11a0 2023-10-06T04:39:04.401 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.393+0000 7f90ecff9700 1 -- 172.21.15.179:0/399194891 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f90dc012910 con 0x7f90f00b11a0 2023-10-06T04:39:04.401 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.394+0000 7f90f6f51700 1 -- 172.21.15.179:0/399194891 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f0156a00 con 0x7f90f00b11a0 2023-10-06T04:39:04.401 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.396+0000 7f90ecff9700 1 -- 172.21.15.179:0/399194891 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f90dc017070 con 0x7f90f00b11a0 2023-10-06T04:39:04.481 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.478+0000 7f90f6f51700 1 -- 172.21.15.179:0/399194891 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6031b367-0b9d-4928-ba70-f08242317af1", "id": 4} v 0) v1 -- 0x7f90f005f230 con 0x7f90f00b11a0 2023-10-06T04:39:04.484 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.481+0000 7f90ecff9700 1 -- 172.21.15.179:0/399194891 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6031b367-0b9d-4928-ba70-f08242317af1", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f90dc01c920 con 0x7f90f00b11a0 2023-10-06T04:39:04.484 INFO:teuthology.orchestra.run.smithi179.stdout:4 2023-10-06T04:39:04.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.482+0000 7f90f6f51700 1 -- 172.21.15.179:0/399194891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90f00b11a0 msgr2=0x7f90f00cbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.482+0000 7f90f6f51700 1 --2- 172.21.15.179:0/399194891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90f00b11a0 0x7f90f00cbff0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00c7c0 tx=0x7f90dc007dd0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.482+0000 7f90f6f51700 1 -- 172.21.15.179:0/399194891 shutdown_connections 2023-10-06T04:39:04.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.482+0000 7f90f6f51700 1 --2- 172.21.15.179:0/399194891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f01597c0 0x7f90f00cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.482+0000 7f90f6f51700 1 --2- 172.21.15.179:0/399194891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90f006dff0 0x7f90f01562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.482+0000 7f90f6f51700 1 --2- 172.21.15.179:0/399194891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90f00b11a0 0x7f90f00cbff0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.487 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.482+0000 7f90f6f51700 1 -- 172.21.15.179:0/399194891 >> 172.21.15.179:0/399194891 conn(0x7f90f0068650 msgr2=0x7f90f00b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:04.487 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.483+0000 7f90f6f51700 1 -- 172.21.15.179:0/399194891 shutdown_connections 2023-10-06T04:39:04.487 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.483+0000 7f90f6f51700 1 -- 172.21.15.179:0/399194891 wait complete. 2023-10-06T04:39:04.497 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new a7fb2369-bb19-4d8d-8f78-c386cab59868 5 2023-10-06T04:39:04.501 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:04.499+0000 7f1ef8c35180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T04:39:04.577 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:04.574+0000 7f4040b1a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T04:39:04.577 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:04.575+0000 7f1ef8c35180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T04:39:04.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.610+0000 7fe8f918f700 1 Processor -- start 2023-10-06T04:39:04.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.610+0000 7fe8f918f700 1 -- start start 2023-10-06T04:39:04.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.611+0000 7fe8f918f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe8f4143360 0x7fe8f40b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.611+0000 7fe8f918f700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe8f406e1f0 0x7fe8f40b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.611+0000 7fe8f918f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f40cce70 con 0x7fe8f4142f90 2023-10-06T04:39:04.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.611+0000 7fe8f918f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f40b1780 con 0x7fe8f4143360 2023-10-06T04:39:04.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.611+0000 7fe8f918f700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f40b0b70 con 0x7fe8f406e1f0 2023-10-06T04:39:04.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.611+0000 7fe8f898e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe8f406e1f0 0x7fe8f40b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.611+0000 7fe8f898e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe8f406e1f0 0x7fe8f40b5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:60014/0 (socket says 172.21.15.179:60014) 2023-10-06T04:39:04.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.611+0000 7fe8f898e700 1 -- 172.21.15.179:0/4040697896 learned_addr learned my addr 172.21.15.179:0/4040697896 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-06T04:39:04.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.611+0000 7fe8f37fe700 1 --2- 172.21.15.179:0/4040697896 >> v2:172.21.15.112:3300/0 conn(0x7fe8f4143360 0x7fe8f40b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.611+0000 7fe8f898e700 1 -- 172.21.15.179:0/4040697896 >> v2:172.21.15.112:3300/0 conn(0x7fe8f4143360 msgr2=0x7fe8f40b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:04.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.611+0000 7fe8f898e700 1 --2- 172.21.15.179:0/4040697896 >> v2:172.21.15.112:3300/0 conn(0x7fe8f4143360 0x7fe8f40b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.611+0000 7fe8f898e700 1 -- 172.21.15.179:0/4040697896 >> v1:172.21.15.112:6789/0 conn(0x7fe8f4142f90 legacy=0x7fe8f406dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.611+0000 7fe8f898e700 1 -- 172.21.15.179:0/4040697896 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f40b0e50 con 0x7fe8f406e1f0 2023-10-06T04:39:04.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.611+0000 7fe8f898e700 1 --2- 172.21.15.179:0/4040697896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8f406e1f0 0x7fe8f40b5cd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4159c50 tx=0x7fe8ec009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72e0e0ca480a581e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:04.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.611+0000 7fe8f2ffd700 1 -- 172.21.15.179:0/4040697896 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec00e070 con 0x7fe8f406e1f0 2023-10-06T04:39:04.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.612+0000 7fe8f2ffd700 1 -- 172.21.15.179:0/4040697896 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ec00ba50 con 0x7fe8f406e1f0 2023-10-06T04:39:04.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.612+0000 7fe8f2ffd700 1 -- 172.21.15.179:0/4040697896 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec0092e0 con 0x7fe8f406e1f0 2023-10-06T04:39:04.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.612+0000 7fe8f918f700 1 -- 172.21.15.179:0/4040697896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8f406e1f0 msgr2=0x7fe8f40b5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.612+0000 7fe8f918f700 1 --2- 172.21.15.179:0/4040697896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8f406e1f0 0x7fe8f40b5cd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4159c50 tx=0x7fe8ec009840 comp rx=0 tx=0).stop 2023-10-06T04:39:04.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.612+0000 7fe8f918f700 1 -- 172.21.15.179:0/4040697896 shutdown_connections 2023-10-06T04:39:04.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.612+0000 7fe8f918f700 1 --2- 172.21.15.179:0/4040697896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8f406e1f0 0x7fe8f40b5cd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.612+0000 7fe8f918f700 1 --2- 172.21.15.179:0/4040697896 >> v2:172.21.15.112:3300/0 conn(0x7fe8f4143360 0x7fe8f40b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.612+0000 7fe8f918f700 1 -- 172.21.15.179:0/4040697896 >> 172.21.15.179:0/4040697896 conn(0x7fe8f406c7d0 msgr2=0x7fe8f406cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:04.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.612+0000 7fe8f918f700 1 -- 172.21.15.179:0/4040697896 shutdown_connections 2023-10-06T04:39:04.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.612+0000 7fe8f918f700 1 -- 172.21.15.179:0/4040697896 wait complete. 2023-10-06T04:39:04.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.613+0000 7fe8f918f700 1 Processor -- start 2023-10-06T04:39:04.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.613+0000 7fe8f918f700 1 -- start start 2023-10-06T04:39:04.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.614+0000 7fe8f918f700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8f406e1f0 0x7fe8f40c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.614+0000 7fe8f918f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8f4142f90 0x7fe8f40c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.614+0000 7fe8f918f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8f4143360 0x7fe8f41400f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.614+0000 7fe8f918f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f40c9730 con 0x7fe8f4142f90 2023-10-06T04:39:04.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.614+0000 7fe8f918f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f40c8d60 con 0x7fe8f4143360 2023-10-06T04:39:04.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.614+0000 7fe8f918f700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f40c8150 con 0x7fe8f406e1f0 2023-10-06T04:39:04.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.614+0000 7fe8f898e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8f4143360 0x7fe8f41400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.614+0000 7fe8f3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8f406e1f0 0x7fe8f40c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.614+0000 7fe8f3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8f406e1f0 0x7fe8f40c91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:45474/0 (socket says 172.21.15.179:45474) 2023-10-06T04:39:04.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.614+0000 7fe8f3fff700 1 -- 172.21.15.179:0/108087859 learned_addr learned my addr 172.21.15.179:0/108087859 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-06T04:39:04.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.614+0000 7fe8f898e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8f4143360 0x7fe8f41400f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:60020/0 (socket says 172.21.15.179:60020) 2023-10-06T04:39:04.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.614+0000 7fe8f37fe700 1 --2- 172.21.15.179:0/108087859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8f4142f90 0x7fe8f40c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.614+0000 7fe8f3fff700 1 -- 172.21.15.179:0/108087859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8f4143360 msgr2=0x7fe8f41400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.615+0000 7fe8f3fff700 1 --2- 172.21.15.179:0/108087859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8f4143360 0x7fe8f41400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.615+0000 7fe8f3fff700 1 -- 172.21.15.179:0/108087859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8f4142f90 msgr2=0x7fe8f40c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.615+0000 7fe8f3fff700 1 --2- 172.21.15.179:0/108087859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8f4142f90 0x7fe8f40c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.615+0000 7fe8f3fff700 1 -- 172.21.15.179:0/108087859 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ec009ae0 con 0x7fe8f406e1f0 2023-10-06T04:39:04.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.615+0000 7fe8f898e700 1 --2- 172.21.15.179:0/108087859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8f4143360 0x7fe8f41400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:04.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.615+0000 7fe8f3fff700 1 --2- 172.21.15.179:0/108087859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8f406e1f0 0x7fe8f40c91f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800c7f0 tx=0x7fe8e8007f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:04.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.615+0000 7fe8dbfff700 1 -- 172.21.15.179:0/108087859 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8011590 con 0x7fe8f406e1f0 2023-10-06T04:39:04.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.615+0000 7fe8dbfff700 1 -- 172.21.15.179:0/108087859 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e8011710 con 0x7fe8f406e1f0 2023-10-06T04:39:04.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.615+0000 7fe8f918f700 1 -- 172.21.15.179:0/108087859 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f40c8430 con 0x7fe8f406e1f0 2023-10-06T04:39:04.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.615+0000 7fe8dbfff700 1 -- 172.21.15.179:0/108087859 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8011ad0 con 0x7fe8f406e1f0 2023-10-06T04:39:04.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.615+0000 7fe8f918f700 1 -- 172.21.15.179:0/108087859 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f40c89f0 con 0x7fe8f406e1f0 2023-10-06T04:39:04.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.615+0000 7fe8dbfff700 1 -- 172.21.15.179:0/108087859 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe8e801c6c0 con 0x7fe8f406e1f0 2023-10-06T04:39:04.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.615+0000 7fe8dbfff700 1 -- 172.21.15.179:0/108087859 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fe8e8012420 con 0x7fe8f406e1f0 2023-10-06T04:39:04.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.616+0000 7fe8f918f700 1 -- 172.21.15.179:0/108087859 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f40b4390 con 0x7fe8f406e1f0 2023-10-06T04:39:04.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.618+0000 7fe8dbfff700 1 -- 172.21.15.179:0/108087859 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe8e8017070 con 0x7fe8f406e1f0 2023-10-06T04:39:04.658 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:04.655+0000 7f4040b1a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T04:39:04.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.701+0000 7fe8f918f700 1 -- 172.21.15.179:0/108087859 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a7fb2369-bb19-4d8d-8f78-c386cab59868", "id": 5} v 0) v1 -- 0x7fe8f40c8bb0 con 0x7fe8f406e1f0 2023-10-06T04:39:04.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.705+0000 7fe8dbfff700 1 -- 172.21.15.179:0/108087859 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a7fb2369-bb19-4d8d-8f78-c386cab59868", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe8e801c970 con 0x7fe8f406e1f0 2023-10-06T04:39:04.707 INFO:teuthology.orchestra.run.smithi179.stdout:5 2023-10-06T04:39:04.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.706+0000 7fe8f918f700 1 -- 172.21.15.179:0/108087859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8f406e1f0 msgr2=0x7fe8f40c91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.706+0000 7fe8f918f700 1 --2- 172.21.15.179:0/108087859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8f406e1f0 0x7fe8f40c91f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800c7f0 tx=0x7fe8e8007f70 comp rx=0 tx=0).stop 2023-10-06T04:39:04.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.706+0000 7fe8f918f700 1 -- 172.21.15.179:0/108087859 shutdown_connections 2023-10-06T04:39:04.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.706+0000 7fe8f918f700 1 --2- 172.21.15.179:0/108087859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8f4143360 0x7fe8f41400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.706+0000 7fe8f918f700 1 --2- 172.21.15.179:0/108087859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8f406e1f0 0x7fe8f40c91f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.706+0000 7fe8f918f700 1 --2- 172.21.15.179:0/108087859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8f4142f90 0x7fe8f40c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.706+0000 7fe8f918f700 1 -- 172.21.15.179:0/108087859 >> 172.21.15.179:0/108087859 conn(0x7fe8f406c7d0 msgr2=0x7fe8f4142040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:04.710 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.706+0000 7fe8f918f700 1 -- 172.21.15.179:0/108087859 shutdown_connections 2023-10-06T04:39:04.710 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.706+0000 7fe8f918f700 1 -- 172.21.15.179:0/108087859 wait complete. 2023-10-06T04:39:04.715 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:04.713+0000 7f1ef8c35180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T04:39:04.720 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 270ea168-0734-4c80-9c7c-1be085e9e906 6 2023-10-06T04:39:04.802 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:04.800+0000 7f4040b1a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T04:39:04.809 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:04.807+0000 7f1ef8c35180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T04:39:04.838 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.835+0000 7fc6f0baf700 1 Processor -- start 2023-10-06T04:39:04.838 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.835+0000 7fc6f0baf700 1 -- start start 2023-10-06T04:39:04.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.836+0000 7fc6f0baf700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc6ec159830 0x7fc6ec159c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.836+0000 7fc6f0baf700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6ec06cee0 0x7fc6ec06af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.836+0000 7fc6f0baf700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ec0b0110 con 0x7fc6ec06e4f0 2023-10-06T04:39:04.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.836+0000 7fc6f0baf700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ec06aa90 con 0x7fc6ec159830 2023-10-06T04:39:04.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.836+0000 7fc6f0baf700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec15d720 con 0x7fc6ec06cee0 2023-10-06T04:39:04.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.836+0000 7fc6ebfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6ec06cee0 0x7fc6ec06af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.836+0000 7fc6ebfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6ec06cee0 0x7fc6ec06af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:45488/0 (socket says 172.21.15.179:45488) 2023-10-06T04:39:04.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.836+0000 7fc6ebfff700 1 -- 172.21.15.179:0/2345489362 learned_addr learned my addr 172.21.15.179:0/2345489362 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-06T04:39:04.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.836+0000 7fc6eb7fe700 1 --2- 172.21.15.179:0/2345489362 >> v2:172.21.15.112:3300/0 conn(0x7fc6ec159830 0x7fc6ec159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.837+0000 7fc6ebfff700 1 -- 172.21.15.179:0/2345489362 >> v2:172.21.15.112:3300/0 conn(0x7fc6ec159830 msgr2=0x7fc6ec159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:04.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.837+0000 7fc6ebfff700 1 --2- 172.21.15.179:0/2345489362 >> v2:172.21.15.112:3300/0 conn(0x7fc6ec159830 0x7fc6ec159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.837+0000 7fc6ebfff700 1 -- 172.21.15.179:0/2345489362 >> v1:172.21.15.112:6789/0 conn(0x7fc6ec06e4f0 legacy=0x7fc6ec06c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:04.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.837+0000 7fc6ebfff700 1 -- 172.21.15.179:0/2345489362 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ec15da00 con 0x7fc6ec06cee0 2023-10-06T04:39:04.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.837+0000 7fc6ebfff700 1 --2- 172.21.15.179:0/2345489362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6ec06cee0 0x7fc6ec06af20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009f20 tx=0x7fc6e4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=568e11e3b83b3df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:04.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.837+0000 7fc6eaffd700 1 -- 172.21.15.179:0/2345489362 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e400e070 con 0x7fc6ec06cee0 2023-10-06T04:39:04.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.837+0000 7fc6eaffd700 1 -- 172.21.15.179:0/2345489362 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e400b990 con 0x7fc6ec06cee0 2023-10-06T04:39:04.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.837+0000 7fc6eaffd700 1 -- 172.21.15.179:0/2345489362 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e40092e0 con 0x7fc6ec06cee0 2023-10-06T04:39:04.845 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.837+0000 7fc6f0baf700 1 -- 172.21.15.179:0/2345489362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6ec06cee0 msgr2=0x7fc6ec06af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.845 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.837+0000 7fc6f0baf700 1 --2- 172.21.15.179:0/2345489362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6ec06cee0 0x7fc6ec06af20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009f20 tx=0x7fc6e4009840 comp rx=0 tx=0).stop 2023-10-06T04:39:04.845 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.837+0000 7fc6f0baf700 1 -- 172.21.15.179:0/2345489362 shutdown_connections 2023-10-06T04:39:04.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.837+0000 7fc6f0baf700 1 --2- 172.21.15.179:0/2345489362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6ec06cee0 0x7fc6ec06af20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.837+0000 7fc6f0baf700 1 --2- 172.21.15.179:0/2345489362 >> v2:172.21.15.112:3300/0 conn(0x7fc6ec159830 0x7fc6ec159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.838+0000 7fc6f0baf700 1 -- 172.21.15.179:0/2345489362 >> 172.21.15.179:0/2345489362 conn(0x7fc6ec06d8e0 msgr2=0x7fc6ec06dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:04.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.838+0000 7fc6f0baf700 1 -- 172.21.15.179:0/2345489362 shutdown_connections 2023-10-06T04:39:04.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.838+0000 7fc6f0baf700 1 -- 172.21.15.179:0/2345489362 wait complete. 2023-10-06T04:39:04.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.839+0000 7fc6f0baf700 1 Processor -- start 2023-10-06T04:39:04.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.839+0000 7fc6f0baf700 1 -- start start 2023-10-06T04:39:04.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.839+0000 7fc6f0baf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6ec06cee0 0x7fc6ec145e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.839+0000 7fc6f0baf700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6ec06e4f0 0x7fc6ec154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.847 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.839+0000 7fc6f0baf700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6ec159830 0x7fc6ec1554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:04.847 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.839+0000 7fc6f0baf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec16a570 con 0x7fc6ec06cee0 2023-10-06T04:39:04.848 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.839+0000 7fc6f0baf700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec156c60 con 0x7fc6ec159830 2023-10-06T04:39:04.848 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.839+0000 7fc6f0baf700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec155b30 con 0x7fc6ec06e4f0 2023-10-06T04:39:04.848 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.839+0000 7fc6e3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6ec06e4f0 0x7fc6ec154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.848 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.839+0000 7fc6ebfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6ec159830 0x7fc6ec1554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:04.848 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.840+0000 7fc6e3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6ec06e4f0 0x7fc6ec154f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:45494/0 (socket says 172.21.15.179:45494) 2023-10-06T04:39:04.848 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.840+0000 7fc6e3fff700 1 -- 172.21.15.179:0/3318723357 learned_addr learned my addr 172.21.15.179:0/3318723357 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-06T04:39:04.848 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.840+0000 7fc6ebfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6ec159830 0x7fc6ec1554b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:60030/0 (socket says 172.21.15.179:60030) 2023-10-06T04:39:04.848 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.840+0000 7fc6e3fff700 1 -- 172.21.15.179:0/3318723357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6ec159830 msgr2=0x7fc6ec1554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.848 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.840+0000 7fc6e3fff700 1 --2- 172.21.15.179:0/3318723357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6ec159830 0x7fc6ec1554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.849 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.840+0000 7fc6e3fff700 1 -- 172.21.15.179:0/3318723357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6ec06cee0 msgr2=0x7fc6ec145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.849 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.840+0000 7fc6e3fff700 1 --2- 172.21.15.179:0/3318723357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6ec06cee0 0x7fc6ec145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.849 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.840+0000 7fc6e3fff700 1 -- 172.21.15.179:0/3318723357 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e4009ae0 con 0x7fc6ec06e4f0 2023-10-06T04:39:04.849 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.840+0000 7fc6ebfff700 1 --2- 172.21.15.179:0/3318723357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6ec159830 0x7fc6ec1554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:04.849 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.840+0000 7fc6e3fff700 1 --2- 172.21.15.179:0/3318723357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6ec06e4f0 0x7fc6ec154f70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400c590 tx=0x7fc6d4007f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:04.849 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.840+0000 7fc6e37fe700 1 -- 172.21.15.179:0/3318723357 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4011660 con 0x7fc6ec06e4f0 2023-10-06T04:39:04.849 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.840+0000 7fc6e37fe700 1 -- 172.21.15.179:0/3318723357 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d40117c0 con 0x7fc6ec06e4f0 2023-10-06T04:39:04.849 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.840+0000 7fc6f0baf700 1 -- 172.21.15.179:0/3318723357 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ec169c40 con 0x7fc6ec06e4f0 2023-10-06T04:39:04.849 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.840+0000 7fc6e37fe700 1 -- 172.21.15.179:0/3318723357 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4011b80 con 0x7fc6ec06e4f0 2023-10-06T04:39:04.849 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.840+0000 7fc6f0baf700 1 -- 172.21.15.179:0/3318723357 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ec16a200 con 0x7fc6ec06e4f0 2023-10-06T04:39:04.849 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.840+0000 7fc6e37fe700 1 -- 172.21.15.179:0/3318723357 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc6d401c460 con 0x7fc6ec06e4f0 2023-10-06T04:39:04.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.840+0000 7fc6e37fe700 1 -- 172.21.15.179:0/3318723357 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fc6d4012420 con 0x7fc6ec06e4f0 2023-10-06T04:39:04.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.841+0000 7fc6f0baf700 1 -- 172.21.15.179:0/3318723357 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ec064550 con 0x7fc6ec06e4f0 2023-10-06T04:39:04.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.843+0000 7fc6e37fe700 1 -- 172.21.15.179:0/3318723357 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc6ec064550 con 0x7fc6ec06e4f0 2023-10-06T04:39:04.902 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:04.900+0000 7f4040b1a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T04:39:04.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.926+0000 7fc6f0baf700 1 -- 172.21.15.179:0/3318723357 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "270ea168-0734-4c80-9c7c-1be085e9e906", "id": 6} v 0) v1 -- 0x7fc6ec05f230 con 0x7fc6ec06e4f0 2023-10-06T04:39:04.937 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.934+0000 7fc6e37fe700 1 -- 172.21.15.179:0/3318723357 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "270ea168-0734-4c80-9c7c-1be085e9e906", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc6d401c710 con 0x7fc6ec06e4f0 2023-10-06T04:39:04.937 INFO:teuthology.orchestra.run.smithi179.stdout:6 2023-10-06T04:39:04.938 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.935+0000 7fc6f0baf700 1 -- 172.21.15.179:0/3318723357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6ec06e4f0 msgr2=0x7fc6ec154f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:04.938 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.935+0000 7fc6f0baf700 1 --2- 172.21.15.179:0/3318723357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6ec06e4f0 0x7fc6ec154f70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400c590 tx=0x7fc6d4007f30 comp rx=0 tx=0).stop 2023-10-06T04:39:04.938 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.935+0000 7fc6f0baf700 1 -- 172.21.15.179:0/3318723357 shutdown_connections 2023-10-06T04:39:04.938 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.935+0000 7fc6f0baf700 1 --2- 172.21.15.179:0/3318723357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6ec159830 0x7fc6ec1554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.938 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.935+0000 7fc6f0baf700 1 --2- 172.21.15.179:0/3318723357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6ec06cee0 0x7fc6ec145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.939 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.935+0000 7fc6f0baf700 1 --2- 172.21.15.179:0/3318723357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6ec06e4f0 0x7fc6ec154f70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:04.939 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.935+0000 7fc6f0baf700 1 -- 172.21.15.179:0/3318723357 >> 172.21.15.179:0/3318723357 conn(0x7fc6ec06d8e0 msgr2=0x7fc6ec156fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:04.939 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.936+0000 7fc6f0baf700 1 -- 172.21.15.179:0/3318723357 shutdown_connections 2023-10-06T04:39:04.939 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:04.936+0000 7fc6f0baf700 1 -- 172.21.15.179:0/3318723357 wait complete. 2023-10-06T04:39:04.950 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 57fcaee9-8dda-4cfe-90cf-ac12cc8133d4 7 2023-10-06T04:39:05.065 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.063+0000 7f316476b700 1 Processor -- start 2023-10-06T04:39:05.066 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.063+0000 7f316476b700 1 -- start start 2023-10-06T04:39:05.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.064+0000 7f316476b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f315c06d430 0x7f315c0ca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:05.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.064+0000 7f316476b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f315c0cad80 0x7f315c06c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:05.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.064+0000 7f316476b700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315c06af30 con 0x7f315c156420 2023-10-06T04:39:05.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.064+0000 7f316476b700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315c0cb210 con 0x7f315c06d430 2023-10-06T04:39:05.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.064+0000 7f316476b700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315c06a3f0 con 0x7f315c0cad80 2023-10-06T04:39:05.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.064+0000 7f3162d08700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f315c0cad80 0x7f315c06c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:05.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.064+0000 7f3161d06700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f315c06d430 0x7f315c0ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:05.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.064+0000 7f3162d08700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f315c0cad80 0x7f315c06c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:45496/0 (socket says 172.21.15.179:45496) 2023-10-06T04:39:05.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.064+0000 7f3162d08700 1 -- 172.21.15.179:0/573111716 learned_addr learned my addr 172.21.15.179:0/573111716 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-06T04:39:05.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.064+0000 7f3162507700 1 --1- 172.21.15.179:0/573111716 >> v1:172.21.15.179:6789/0 conn(0x7f315c156420 0x7f315c06b3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:58670/0 (socket says 172.21.15.179:58670) 2023-10-06T04:39:05.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.064+0000 7f3162d08700 1 -- 172.21.15.179:0/573111716 >> v2:172.21.15.179:3300/0 conn(0x7f315c06d430 msgr2=0x7f315c0ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:05.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.064+0000 7f3162d08700 1 --2- 172.21.15.179:0/573111716 >> v2:172.21.15.179:3300/0 conn(0x7f315c06d430 0x7f315c0ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.064+0000 7f3162d08700 1 -- 172.21.15.179:0/573111716 >> v1:172.21.15.179:6789/0 conn(0x7f315c156420 legacy=0x7f315c06b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:05.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.064+0000 7f3162d08700 1 -- 172.21.15.179:0/573111716 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c06a600 con 0x7f315c0cad80 2023-10-06T04:39:05.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.064+0000 7f3161505700 1 -- 172.21.15.179:0/573111716 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103780607 0 0) 0x7f315c06af30 con 0x7f315c156420 2023-10-06T04:39:05.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.064+0000 7f3161d06700 1 --2- 172.21.15.179:0/573111716 >> v2:172.21.15.179:3300/0 conn(0x7f315c06d430 0x7f315c0ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:05.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.064+0000 7f3162d08700 1 --2- 172.21.15.179:0/573111716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f315c0cad80 0x7f315c06c7d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f315400d1a0 tx=0x7f315400ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1374c880625c0c41 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:05.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.064+0000 7f3161505700 1 -- 172.21.15.179:0/573111716 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154010070 con 0x7f315c0cad80 2023-10-06T04:39:05.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.064+0000 7f3161505700 1 -- 172.21.15.179:0/573111716 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315400de10 con 0x7f315c0cad80 2023-10-06T04:39:05.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.064+0000 7f3161505700 1 -- 172.21.15.179:0/573111716 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315400b320 con 0x7f315c0cad80 2023-10-06T04:39:05.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.065+0000 7f316476b700 1 -- 172.21.15.179:0/573111716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f315c0cad80 msgr2=0x7f315c06c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:05.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.065+0000 7f316476b700 1 --2- 172.21.15.179:0/573111716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f315c0cad80 0x7f315c06c7d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f315400d1a0 tx=0x7f315400ba50 comp rx=0 tx=0).stop 2023-10-06T04:39:05.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.065+0000 7f316476b700 1 -- 172.21.15.179:0/573111716 shutdown_connections 2023-10-06T04:39:05.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.065+0000 7f316476b700 1 --2- 172.21.15.179:0/573111716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f315c0cad80 0x7f315c06c7d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.065+0000 7f316476b700 1 --2- 172.21.15.179:0/573111716 >> v2:172.21.15.179:3300/0 conn(0x7f315c06d430 0x7f315c0ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.065+0000 7f316476b700 1 -- 172.21.15.179:0/573111716 >> 172.21.15.179:0/573111716 conn(0x7f315c06e740 msgr2=0x7f315c06eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:05.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.065+0000 7f316476b700 1 -- 172.21.15.179:0/573111716 shutdown_connections 2023-10-06T04:39:05.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.065+0000 7f316476b700 1 -- 172.21.15.179:0/573111716 wait complete. 2023-10-06T04:39:05.072 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.066+0000 7f316476b700 1 Processor -- start 2023-10-06T04:39:05.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.066+0000 7f316476b700 1 -- start start 2023-10-06T04:39:05.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.067+0000 7f316476b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f315c06d430 0x7f315c145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:05.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.067+0000 7f316476b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f315c0cad80 0x7f315c16d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:05.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.067+0000 7f316476b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f315c156420 0x7f315c16dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:05.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.067+0000 7f316476b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c1489f0 con 0x7f315c156420 2023-10-06T04:39:05.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.067+0000 7f316476b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c148cd0 con 0x7f315c06d430 2023-10-06T04:39:05.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.067+0000 7f316476b700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315c148fb0 con 0x7f315c0cad80 2023-10-06T04:39:05.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.067+0000 7f3162507700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f315c06d430 0x7f315c145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:05.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.067+0000 7f3161d06700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f315c0cad80 0x7f315c16d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:05.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.067+0000 7f3161d06700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f315c0cad80 0x7f315c16d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:45504/0 (socket says 172.21.15.179:45504) 2023-10-06T04:39:05.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.067+0000 7f3162507700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f315c06d430 0x7f315c145fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:60046/0 (socket says 172.21.15.179:60046) 2023-10-06T04:39:05.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.067+0000 7f3161d06700 1 -- 172.21.15.179:0/2766595558 learned_addr learned my addr 172.21.15.179:0/2766595558 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-06T04:39:05.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.067+0000 7f3162d08700 1 --2- 172.21.15.179:0/2766595558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f315c156420 0x7f315c16dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:05.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.067+0000 7f3161d06700 1 -- 172.21.15.179:0/2766595558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f315c06d430 msgr2=0x7f315c145fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:05.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.067+0000 7f3161d06700 1 --2- 172.21.15.179:0/2766595558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f315c06d430 0x7f315c145fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.067+0000 7f3161d06700 1 -- 172.21.15.179:0/2766595558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f315c156420 msgr2=0x7f315c16dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:05.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.067+0000 7f3161d06700 1 --2- 172.21.15.179:0/2766595558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f315c156420 0x7f315c16dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.067+0000 7f3161d06700 1 -- 172.21.15.179:0/2766595558 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c009420 con 0x7f315c0cad80 2023-10-06T04:39:05.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.067+0000 7f3162507700 1 --2- 172.21.15.179:0/2766595558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f315c06d430 0x7f315c145fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:05.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.067+0000 7f3161d06700 1 --2- 172.21.15.179:0/2766595558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f315c0cad80 0x7f315c16d580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f314c00ec80 tx=0x7f314c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:05.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.068+0000 7f31527fc700 1 -- 172.21.15.179:0/2766595558 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c00c850 con 0x7f315c0cad80 2023-10-06T04:39:05.075 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.068+0000 7f31527fc700 1 -- 172.21.15.179:0/2766595558 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314c00c9b0 con 0x7f315c0cad80 2023-10-06T04:39:05.075 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.068+0000 7f316476b700 1 -- 172.21.15.179:0/2766595558 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315400bcf0 con 0x7f315c0cad80 2023-10-06T04:39:05.075 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.068+0000 7f31527fc700 1 -- 172.21.15.179:0/2766595558 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c00cd50 con 0x7f315c0cad80 2023-10-06T04:39:05.075 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.068+0000 7f316476b700 1 -- 172.21.15.179:0/2766595558 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315c0ac720 con 0x7f315c0cad80 2023-10-06T04:39:05.075 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.068+0000 7f31527fc700 1 -- 172.21.15.179:0/2766595558 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f314c005a00 con 0x7f315c0cad80 2023-10-06T04:39:05.075 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.068+0000 7f31527fc700 1 -- 172.21.15.179:0/2766595558 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f314c006640 con 0x7f315c0cad80 2023-10-06T04:39:05.075 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.068+0000 7f316476b700 1 -- 172.21.15.179:0/2766595558 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315c0ac940 con 0x7f315c0cad80 2023-10-06T04:39:05.075 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.070+0000 7f31527fc700 1 -- 172.21.15.179:0/2766595558 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f314c021060 con 0x7f315c0cad80 2023-10-06T04:39:05.162 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.160+0000 7f316476b700 1 -- 172.21.15.179:0/2766595558 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "57fcaee9-8dda-4cfe-90cf-ac12cc8133d4", "id": 7} v 0) v1 -- 0x7f315c05f230 con 0x7f315c0cad80 2023-10-06T04:39:05.168 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.165+0000 7f31527fc700 1 -- 172.21.15.179:0/2766595558 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "57fcaee9-8dda-4cfe-90cf-ac12cc8133d4", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f314c017070 con 0x7f315c0cad80 2023-10-06T04:39:05.168 INFO:teuthology.orchestra.run.smithi179.stdout:7 2023-10-06T04:39:05.169 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.166+0000 7f316476b700 1 -- 172.21.15.179:0/2766595558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f315c0cad80 msgr2=0x7f315c16d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:05.169 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.166+0000 7f316476b700 1 --2- 172.21.15.179:0/2766595558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f315c0cad80 0x7f315c16d580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f314c00ec80 tx=0x7f314c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.169 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.166+0000 7f316476b700 1 -- 172.21.15.179:0/2766595558 shutdown_connections 2023-10-06T04:39:05.170 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.166+0000 7f316476b700 1 --2- 172.21.15.179:0/2766595558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f315c156420 0x7f315c16dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.170 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.166+0000 7f316476b700 1 --2- 172.21.15.179:0/2766595558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f315c06d430 0x7f315c145fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.170 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.166+0000 7f316476b700 1 --2- 172.21.15.179:0/2766595558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f315c0cad80 0x7f315c16d580 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.170 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.166+0000 7f316476b700 1 -- 172.21.15.179:0/2766595558 >> 172.21.15.179:0/2766595558 conn(0x7f315c06e740 msgr2=0x7f315c1516f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:05.170 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.166+0000 7f316476b700 1 -- 172.21.15.179:0/2766595558 shutdown_connections 2023-10-06T04:39:05.170 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-06T04:39:05.166+0000 7f316476b700 1 -- 172.21.15.179:0/2766595558 wait complete. 2023-10-06T04:39:05.182 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T04:39:05.182 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T04:39:05.184 INFO:tasks.ceph.osd.0:Started 2023-10-06T04:39:05.184 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T04:39:05.184 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T04:39:05.186 INFO:tasks.ceph.osd.1:Started 2023-10-06T04:39:05.187 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T04:39:05.187 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T04:39:05.189 INFO:tasks.ceph.osd.2:Started 2023-10-06T04:39:05.189 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T04:39:05.189 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T04:39:05.191 INFO:tasks.ceph.osd.3:Started 2023-10-06T04:39:05.191 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T04:39:05.191 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T04:39:05.193 INFO:tasks.ceph.osd.4:Started 2023-10-06T04:39:05.194 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T04:39:05.194 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T04:39:05.199 INFO:tasks.ceph.osd.5:Started 2023-10-06T04:39:05.199 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T04:39:05.199 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T04:39:05.201 INFO:tasks.ceph.osd.6:Started 2023-10-06T04:39:05.202 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T04:39:05.202 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T04:39:05.204 INFO:tasks.ceph.osd.7:Started 2023-10-06T04:39:05.204 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:05.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.360+0000 7fc8f9aa2700 1 Processor -- start 2023-10-06T04:39:05.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.360+0000 7fc8f9aa2700 1 -- start start 2023-10-06T04:39:05.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.360+0000 7fc8f9aa2700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc8f40abfd0 0x7fc8f406dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:05.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.360+0000 7fc8f9aa2700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f4159a90 con 0x7fc8f40abc00 2023-10-06T04:39:05.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.361+0000 7fc8f9aa2700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f4159d70 con 0x7fc8f415a200 2023-10-06T04:39:05.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.361+0000 7fc8f9aa2700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f4156ce0 con 0x7fc8f40abfd0 2023-10-06T04:39:05.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.361+0000 7fc8f37fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc8f40abc00 0x7fc8f4156460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60276/0 (socket says 172.21.15.112:60276) 2023-10-06T04:39:05.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.361+0000 7fc8f37fe700 1 -- 172.21.15.112:0/793355294 learned_addr learned my addr 172.21.15.112:0/793355294 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:05.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.361+0000 7fc8f2ffd700 1 --2- 172.21.15.112:0/793355294 >> v2:172.21.15.179:3300/0 conn(0x7fc8f40abfd0 0x7fc8f406dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:05.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.361+0000 7fc8f27fc700 1 -- 172.21.15.112:0/793355294 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 714056960 0 0) 0x7fc8f4159a90 con 0x7fc8f40abc00 2023-10-06T04:39:05.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.361+0000 7fc8f27fc700 1 -- 172.21.15.112:0/793355294 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8dc003570 con 0x7fc8f40abc00 2023-10-06T04:39:05.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.361+0000 7fc8f27fc700 1 -- 172.21.15.112:0/793355294 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1979118392 0 0) 0x7fc8dc003570 con 0x7fc8f40abc00 2023-10-06T04:39:05.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.361+0000 7fc8f2ffd700 1 -- 172.21.15.112:0/793355294 >> v1:172.21.15.179:6789/0 conn(0x7fc8f415a200 legacy=0x7fc8f406a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:05.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.361+0000 7fc8f2ffd700 1 -- 172.21.15.112:0/793355294 >> v1:172.21.15.112:6789/0 conn(0x7fc8f40abc00 legacy=0x7fc8f4156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:05.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.361+0000 7fc8f2ffd700 1 -- 172.21.15.112:0/793355294 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f4156fc0 con 0x7fc8f40abfd0 2023-10-06T04:39:05.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.361+0000 7fc8f2ffd700 1 --2- 172.21.15.112:0/793355294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f40abfd0 0x7fc8f406dd90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80098e0 tx=0x7fc8e80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4efb29ecdb0fbd1f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:05.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.361+0000 7fc8f27fc700 1 -- 172.21.15.112:0/793355294 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4001470 con 0x7fc8f40abfd0 2023-10-06T04:39:05.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.362+0000 7fc8f27fc700 1 -- 172.21.15.112:0/793355294 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e8011420 con 0x7fc8f40abfd0 2023-10-06T04:39:05.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.362+0000 7fc8f27fc700 1 -- 172.21.15.112:0/793355294 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e80117c0 con 0x7fc8f40abfd0 2023-10-06T04:39:05.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.362+0000 7fc8f9aa2700 1 -- 172.21.15.112:0/793355294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f40abfd0 msgr2=0x7fc8f406dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:05.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.362+0000 7fc8f9aa2700 1 --2- 172.21.15.112:0/793355294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f40abfd0 0x7fc8f406dd90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80098e0 tx=0x7fc8e80091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.362+0000 7fc8f9aa2700 1 -- 172.21.15.112:0/793355294 shutdown_connections 2023-10-06T04:39:05.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.362+0000 7fc8f9aa2700 1 --2- 172.21.15.112:0/793355294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f40abfd0 0x7fc8f406dd90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.362+0000 7fc8f9aa2700 1 -- 172.21.15.112:0/793355294 >> 172.21.15.112:0/793355294 conn(0x7fc8f40cd6e0 msgr2=0x7fc8f40ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:05.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.362+0000 7fc8f9aa2700 1 -- 172.21.15.112:0/793355294 shutdown_connections 2023-10-06T04:39:05.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.362+0000 7fc8f9aa2700 1 -- 172.21.15.112:0/793355294 wait complete. 2023-10-06T04:39:05.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.363+0000 7fc8f9aa2700 1 Processor -- start 2023-10-06T04:39:05.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.363+0000 7fc8f9aa2700 1 -- start start 2023-10-06T04:39:05.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.364+0000 7fc8f9aa2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f40abc00 0x7fc8f40a5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:05.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.364+0000 7fc8f9aa2700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f40abfd0 0x7fc8f413c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:05.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.364+0000 7fc8f9aa2700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f415a200 0x7fc8f416b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:05.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.364+0000 7fc8f9aa2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f40a59c0 con 0x7fc8f40abc00 2023-10-06T04:39:05.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.364+0000 7fc8f9aa2700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f4154090 con 0x7fc8f415a200 2023-10-06T04:39:05.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.364+0000 7fc8f9aa2700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f4153480 con 0x7fc8f40abfd0 2023-10-06T04:39:05.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.364+0000 7fc8f37fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f40abc00 0x7fc8f40a5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:05.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.364+0000 7fc8f37fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f40abc00 0x7fc8f40a5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46688/0 (socket says 172.21.15.112:46688) 2023-10-06T04:39:05.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.364+0000 7fc8f37fe700 1 -- 172.21.15.112:0/4208060357 learned_addr learned my addr 172.21.15.112:0/4208060357 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:05.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.364+0000 7fc8f3fff700 1 --2- 172.21.15.112:0/4208060357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f415a200 0x7fc8f416b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:05.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.364+0000 7fc8f2ffd700 1 --2- 172.21.15.112:0/4208060357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f40abfd0 0x7fc8f413c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:05.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.364+0000 7fc8f37fe700 1 -- 172.21.15.112:0/4208060357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f40abfd0 msgr2=0x7fc8f413c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:05.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.364+0000 7fc8f37fe700 1 --2- 172.21.15.112:0/4208060357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f40abfd0 0x7fc8f413c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.364+0000 7fc8f37fe700 1 -- 172.21.15.112:0/4208060357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f415a200 msgr2=0x7fc8f416b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:05.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.364+0000 7fc8f37fe700 1 --2- 172.21.15.112:0/4208060357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f415a200 0x7fc8f416b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.364+0000 7fc8f37fe700 1 -- 172.21.15.112:0/4208060357 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e8009420 con 0x7fc8f40abc00 2023-10-06T04:39:05.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.365+0000 7fc8f37fe700 1 --2- 172.21.15.112:0/4208060357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f40abc00 0x7fc8f40a5480 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400cb90 tx=0x7fc8e4001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:05.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.365+0000 7fc8db7fe700 1 -- 172.21.15.112:0/4208060357 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4007150 con 0x7fc8f40abc00 2023-10-06T04:39:05.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.365+0000 7fc8db7fe700 1 -- 172.21.15.112:0/4208060357 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e40072d0 con 0x7fc8f40abc00 2023-10-06T04:39:05.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.365+0000 7fc8db7fe700 1 -- 172.21.15.112:0/4208060357 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4007690 con 0x7fc8f40abc00 2023-10-06T04:39:05.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.365+0000 7fc8f9aa2700 1 -- 172.21.15.112:0/4208060357 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f4153760 con 0x7fc8f40abc00 2023-10-06T04:39:05.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.365+0000 7fc8f9aa2700 1 -- 172.21.15.112:0/4208060357 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f4153d20 con 0x7fc8f40abc00 2023-10-06T04:39:05.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.365+0000 7fc8db7fe700 1 -- 172.21.15.112:0/4208060357 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc8e4004cc0 con 0x7fc8f40abc00 2023-10-06T04:39:05.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.365+0000 7fc8db7fe700 1 -- 172.21.15.112:0/4208060357 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fc8e400ab70 con 0x7fc8f40abc00 2023-10-06T04:39:05.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.366+0000 7fc8f9aa2700 1 -- 172.21.15.112:0/4208060357 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f405f230 con 0x7fc8f40abc00 2023-10-06T04:39:05.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.368+0000 7fc8db7fe700 1 -- 172.21.15.112:0/4208060357 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc8e4018070 con 0x7fc8f40abc00 2023-10-06T04:39:05.372 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:05.369+0000 7f1ef8c35180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T04:39:05.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.437+0000 7fc8f9aa2700 1 -- 172.21.15.112:0/4208060357 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8f41572a0 con 0x7fc8f40abc00 2023-10-06T04:39:05.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.437+0000 7fc8db7fe700 1 -- 172.21.15.112:0/4208060357 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fc8e400a570 con 0x7fc8f40abc00 2023-10-06T04:39:05.439 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:05.440 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":10,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:39:05.162492+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:05.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.439+0000 7fc8f9aa2700 1 -- 172.21.15.112:0/4208060357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f40abc00 msgr2=0x7fc8f40a5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:05.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.439+0000 7fc8f9aa2700 1 --2- 172.21.15.112:0/4208060357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f40abc00 0x7fc8f40a5480 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400cb90 tx=0x7fc8e4001a30 comp rx=0 tx=0).stop 2023-10-06T04:39:05.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.439+0000 7fc8f9aa2700 1 -- 172.21.15.112:0/4208060357 shutdown_connections 2023-10-06T04:39:05.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.439+0000 7fc8f9aa2700 1 --2- 172.21.15.112:0/4208060357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f415a200 0x7fc8f416b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.439+0000 7fc8f9aa2700 1 --2- 172.21.15.112:0/4208060357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f40abc00 0x7fc8f40a5480 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.439+0000 7fc8f9aa2700 1 --2- 172.21.15.112:0/4208060357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f40abfd0 0x7fc8f413c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:05.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.439+0000 7fc8f9aa2700 1 -- 172.21.15.112:0/4208060357 >> 172.21.15.112:0/4208060357 conn(0x7fc8f40cd6e0 msgr2=0x7fc8f4157a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:05.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.439+0000 7fc8f9aa2700 1 -- 172.21.15.112:0/4208060357 shutdown_connections 2023-10-06T04:39:05.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:05.439+0000 7fc8f9aa2700 1 -- 172.21.15.112:0/4208060357 wait complete. 2023-10-06T04:39:05.457 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T04:39:05.457 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T04:39:05.458 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:05.455+0000 7f1ef8c35180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T04:39:05.476 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:05.474+0000 7f4040b1a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T04:39:05.533 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-10-06T04:39:05.531+0000 7f6417f2f540 -1 Falling back to public interface 2023-10-06T04:39:05.536 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:05.534+0000 7f1ef8c35180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T04:39:05.554 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:05.551+0000 7f4040b1a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T04:39:05.633 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:05.630+0000 7f4040b1a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T04:39:05.787 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-10-06T04:39:05.784+0000 7fb615cd8540 -1 Falling back to public interface 2023-10-06T04:39:05.789 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-10-06T04:39:05.787+0000 7f956f4fd540 -1 Falling back to public interface 2023-10-06T04:39:05.798 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-10-06T04:39:05.796+0000 7f36ace5e540 -1 Falling back to public interface 2023-10-06T04:39:05.799 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-10-06T04:39:05.796+0000 7fead182b540 -1 Falling back to public interface 2023-10-06T04:39:05.816 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-10-06T04:39:05.813+0000 7f6172de2540 -1 Falling back to public interface 2023-10-06T04:39:05.816 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-10-06T04:39:05.814+0000 7fca07838540 -1 Falling back to public interface 2023-10-06T04:39:05.821 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-10-06T04:39:05.818+0000 7f34ca655540 -1 Falling back to public interface 2023-10-06T04:39:06.117 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:06.114+0000 7f1ef8c35180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T04:39:06.206 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:06.203+0000 7f4040b1a180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T04:39:06.254 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:06.252+0000 7f1ef8c35180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:39:06.262 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:06.344 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:06.341+0000 7f4040b1a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:39:06.344 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:06.342+0000 7f1ef8c35180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T04:39:06.370 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.367+0000 7f59c6dd0700 1 Processor -- start 2023-10-06T04:39:06.370 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.368+0000 7f59c6dd0700 1 -- start start 2023-10-06T04:39:06.374 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.368+0000 7f59c6dd0700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c00aef10 0x7f59c006b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.374 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.368+0000 7f59c6dd0700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f59c006b8e0 0x7f59c0155e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.374 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.368+0000 7f59c6dd0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f59c00af2e0 0x7f59c01563b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.374 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.368+0000 7f59c6dd0700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c00b2e70 con 0x7f59c00af2e0 2023-10-06T04:39:06.374 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.368+0000 7f59c6dd0700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c0157760 con 0x7f59c006b8e0 2023-10-06T04:39:06.374 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.369+0000 7f59c6dd0700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c01568f0 con 0x7f59c00aef10 2023-10-06T04:39:06.374 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.369+0000 7f59c65cf700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f59c00af2e0 0x7f59c01563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.375 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.369+0000 7f59c65cf700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f59c00af2e0 0x7f59c01563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46696/0 (socket says 172.21.15.112:46696) 2023-10-06T04:39:06.375 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.369+0000 7f59c65cf700 1 -- 172.21.15.112:0/1165276733 learned_addr learned my addr 172.21.15.112:0/1165276733 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:06.375 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.369+0000 7f59c55cd700 1 --2- 172.21.15.112:0/1165276733 >> v2:172.21.15.179:3300/0 conn(0x7f59c006b8e0 0x7f59c0155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.375 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.369+0000 7f59c5dce700 1 --2- 172.21.15.112:0/1165276733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c00aef10 0x7f59c006b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.375 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.369+0000 7f59c65cf700 1 -- 172.21.15.112:0/1165276733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c00aef10 msgr2=0x7f59c006b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:06.375 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.369+0000 7f59c65cf700 1 --2- 172.21.15.112:0/1165276733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c00aef10 0x7f59c006b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.375 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.369+0000 7f59c65cf700 1 -- 172.21.15.112:0/1165276733 >> v2:172.21.15.179:3300/0 conn(0x7f59c006b8e0 msgr2=0x7f59c0155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:06.375 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.369+0000 7f59c65cf700 1 --2- 172.21.15.112:0/1165276733 >> v2:172.21.15.179:3300/0 conn(0x7f59c006b8e0 0x7f59c0155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.376 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.369+0000 7f59c65cf700 1 -- 172.21.15.112:0/1165276733 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c00c9bd0 con 0x7f59c00af2e0 2023-10-06T04:39:06.376 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.369+0000 7f59c65cf700 1 --2- 172.21.15.112:0/1165276733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c00af2e0 0x7f59c01563b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f59c006f360 tx=0x7f59b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651df27f0dc0c5ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:06.376 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.369+0000 7f59c4dcc700 1 -- 172.21.15.112:0/1165276733 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b800e070 con 0x7f59c00af2e0 2023-10-06T04:39:06.376 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.369+0000 7f59c4dcc700 1 -- 172.21.15.112:0/1165276733 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b800b970 con 0x7f59c00af2e0 2023-10-06T04:39:06.376 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.369+0000 7f59c4dcc700 1 -- 172.21.15.112:0/1165276733 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b80092e0 con 0x7f59c00af2e0 2023-10-06T04:39:06.376 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.370+0000 7f59c6dd0700 1 -- 172.21.15.112:0/1165276733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c00af2e0 msgr2=0x7f59c01563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.376 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.370+0000 7f59c6dd0700 1 --2- 172.21.15.112:0/1165276733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c00af2e0 0x7f59c01563b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f59c006f360 tx=0x7f59b8009840 comp rx=0 tx=0).stop 2023-10-06T04:39:06.376 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.370+0000 7f59c6dd0700 1 -- 172.21.15.112:0/1165276733 shutdown_connections 2023-10-06T04:39:06.376 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.370+0000 7f59c6dd0700 1 --2- 172.21.15.112:0/1165276733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c00aef10 0x7f59c006b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.376 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.370+0000 7f59c6dd0700 1 --2- 172.21.15.112:0/1165276733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c00af2e0 0x7f59c01563b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.376 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.370+0000 7f59c6dd0700 1 --2- 172.21.15.112:0/1165276733 >> v2:172.21.15.179:3300/0 conn(0x7f59c006b8e0 0x7f59c0155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.377 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.370+0000 7f59c6dd0700 1 -- 172.21.15.112:0/1165276733 >> 172.21.15.112:0/1165276733 conn(0x7f59c00675d0 msgr2=0x7f59c00679d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:06.377 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.370+0000 7f59c6dd0700 1 -- 172.21.15.112:0/1165276733 shutdown_connections 2023-10-06T04:39:06.377 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.370+0000 7f59c6dd0700 1 -- 172.21.15.112:0/1165276733 wait complete. 2023-10-06T04:39:06.377 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.371+0000 7f59c6dd0700 1 Processor -- start 2023-10-06T04:39:06.377 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.371+0000 7f59c6dd0700 1 -- start start 2023-10-06T04:39:06.379 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.372+0000 7f59c6dd0700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c006b8e0 0x7f59c014f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.380 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.372+0000 7f59c6dd0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c00aef10 0x7f59c0168620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.380 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.372+0000 7f59c6dd0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59c00af2e0 0x7f59c0167440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:06.380 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.372+0000 7f59c6dd0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c015ac40 con 0x7f59c00aef10 2023-10-06T04:39:06.380 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.372+0000 7f59c6dd0700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c0168410 con 0x7f59c00af2e0 2023-10-06T04:39:06.380 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.372+0000 7f59c6dd0700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c015a910 con 0x7f59c006b8e0 2023-10-06T04:39:06.380 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.372+0000 7f59c55cd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c00aef10 0x7f59c0168620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.380 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.372+0000 7f59c55cd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c00aef10 0x7f59c0168620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46710/0 (socket says 172.21.15.112:46710) 2023-10-06T04:39:06.380 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.372+0000 7f59c55cd700 1 -- 172.21.15.112:0/1088374992 learned_addr learned my addr 172.21.15.112:0/1088374992 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:06.380 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.372+0000 7f59c5dce700 1 --2- 172.21.15.112:0/1088374992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c006b8e0 0x7f59c014f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.380 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.372+0000 7f59c65cf700 1 --2- 172.21.15.112:0/1088374992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59c00af2e0 0x7f59c0167440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:06.380 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.372+0000 7f59c55cd700 1 -- 172.21.15.112:0/1088374992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c006b8e0 msgr2=0x7f59c014f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.381 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.372+0000 7f59c55cd700 1 --2- 172.21.15.112:0/1088374992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c006b8e0 0x7f59c014f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.381 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.372+0000 7f59c55cd700 1 -- 172.21.15.112:0/1088374992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59c00af2e0 msgr2=0x7f59c0167440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.381 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.372+0000 7f59c55cd700 1 --2- 172.21.15.112:0/1088374992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59c00af2e0 0x7f59c0167440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.381 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.372+0000 7f59c55cd700 1 -- 172.21.15.112:0/1088374992 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b8009ae0 con 0x7f59c00aef10 2023-10-06T04:39:06.381 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.373+0000 7f59c55cd700 1 --2- 172.21.15.112:0/1088374992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c00aef10 0x7f59c0168620 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00ec80 tx=0x7f59bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:06.381 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.373+0000 7f59b5ffb700 1 -- 172.21.15.112:0/1088374992 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc00c850 con 0x7f59c00aef10 2023-10-06T04:39:06.381 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.373+0000 7f59b5ffb700 1 -- 172.21.15.112:0/1088374992 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc00c9b0 con 0x7f59c00aef10 2023-10-06T04:39:06.381 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.373+0000 7f59b5ffb700 1 -- 172.21.15.112:0/1088374992 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc00cd50 con 0x7f59c00aef10 2023-10-06T04:39:06.381 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.373+0000 7f59c6dd0700 1 -- 172.21.15.112:0/1088374992 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c0167e50 con 0x7f59c00aef10 2023-10-06T04:39:06.381 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.373+0000 7f59c6dd0700 1 -- 172.21.15.112:0/1088374992 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c0168b60 con 0x7f59c00aef10 2023-10-06T04:39:06.381 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.373+0000 7f59b5ffb700 1 -- 172.21.15.112:0/1088374992 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f59bc005c80 con 0x7f59c00aef10 2023-10-06T04:39:06.382 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.373+0000 7f59b5ffb700 1 -- 172.21.15.112:0/1088374992 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f59bc013680 con 0x7f59c00aef10 2023-10-06T04:39:06.382 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.374+0000 7f59c6dd0700 1 -- 172.21.15.112:0/1088374992 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c015adb0 con 0x7f59c00aef10 2023-10-06T04:39:06.382 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.376+0000 7f59b5ffb700 1 -- 172.21.15.112:0/1088374992 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f59bc021060 con 0x7f59c00aef10 2023-10-06T04:39:06.434 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:06.432+0000 7f4040b1a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T04:39:06.448 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.446+0000 7f59c6dd0700 1 -- 172.21.15.112:0/1088374992 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59c004c380 con 0x7f59c00aef10 2023-10-06T04:39:06.448 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.446+0000 7f59b5ffb700 1 -- 172.21.15.112:0/1088374992 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f59bc029020 con 0x7f59c00aef10 2023-10-06T04:39:06.448 INFO:teuthology.misc.health.smithi112.stdout: 2023-10-06T04:39:06.449 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":10,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:39:05.162492+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:06.450 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.447+0000 7f59c6dd0700 1 -- 172.21.15.112:0/1088374992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c00aef10 msgr2=0x7f59c0168620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:06.450 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.447+0000 7f59c6dd0700 1 --2- 172.21.15.112:0/1088374992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c00aef10 0x7f59c0168620 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00ec80 tx=0x7f59bc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.450 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.447+0000 7f59c6dd0700 1 -- 172.21.15.112:0/1088374992 shutdown_connections 2023-10-06T04:39:06.450 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.447+0000 7f59c6dd0700 1 --2- 172.21.15.112:0/1088374992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59c00af2e0 0x7f59c0167440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.450 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.447+0000 7f59c6dd0700 1 --2- 172.21.15.112:0/1088374992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c006b8e0 0x7f59c014f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.450 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.447+0000 7f59c6dd0700 1 --2- 172.21.15.112:0/1088374992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c00aef10 0x7f59c0168620 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:06.450 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.447+0000 7f59c6dd0700 1 -- 172.21.15.112:0/1088374992 >> 172.21.15.112:0/1088374992 conn(0x7f59c00675d0 msgr2=0x7f59c00b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:06.450 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.447+0000 7f59c6dd0700 1 -- 172.21.15.112:0/1088374992 shutdown_connections 2023-10-06T04:39:06.450 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:06.447+0000 7f59c6dd0700 1 -- 172.21.15.112:0/1088374992 wait complete. 2023-10-06T04:39:06.461 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T04:39:06.597 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:06.595+0000 7f1ef8c35180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T04:39:06.675 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:06.673+0000 7f1ef8c35180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T04:39:06.683 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:06.681+0000 7f4040b1a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T04:39:06.760 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:06.757+0000 7f4040b1a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T04:39:07.507 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:07.504+0000 7f1ef8c35180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T04:39:07.579 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:07.577+0000 7f1ef8c35180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T04:39:07.592 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:07.589+0000 7f4040b1a180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T04:39:07.651 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:07.649+0000 7f1ef8c35180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T04:39:07.665 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:07.663+0000 7f4040b1a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T04:39:07.741 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:07.739+0000 7f4040b1a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T04:39:07.785 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:07.783+0000 7f1ef8c35180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T04:39:07.873 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:07.870+0000 7f1ef8c35180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T04:39:07.875 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:07.872+0000 7f4040b1a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T04:39:07.960 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:07.957+0000 7f4040b1a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T04:39:08.026 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:08.024+0000 7f1ef8c35180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T04:39:08.101 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:08.099+0000 7f1ef8c35180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T04:39:08.110 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:08.108+0000 7f4040b1a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T04:39:08.176 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:08.173+0000 7f1ef8c35180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T04:39:08.186 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:08.183+0000 7f4040b1a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T04:39:08.256 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:08.254+0000 7f1ef8c35180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T04:39:08.263 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:08.261+0000 7f4040b1a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T04:39:08.346 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-06T04:39:08.343+0000 7f4040b1a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T04:39:09.034 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-10-06T04:39:09.032+0000 7f6417f2f540 -1 osd.2 0 log_to_monitors true 2023-10-06T04:39:09.269 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-10-06T04:39:09.267+0000 7f956f4fd540 -1 osd.1 0 log_to_monitors true 2023-10-06T04:39:09.274 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-10-06T04:39:09.271+0000 7fb615cd8540 -1 osd.4 0 log_to_monitors true 2023-10-06T04:39:09.281 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:09.278+0000 7f1eb2038700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T04:39:09.281 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:39:09.278+0000 7f1eb2038700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T04:39:09.307 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-10-06T04:39:09.305+0000 7fead182b540 -1 osd.7 0 log_to_monitors true 2023-10-06T04:39:09.309 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-10-06T04:39:09.307+0000 7f36ace5e540 -1 osd.0 0 log_to_monitors true 2023-10-06T04:39:09.313 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-10-06T04:39:09.311+0000 7fca07838540 -1 osd.3 0 log_to_monitors true 2023-10-06T04:39:09.341 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-10-06T04:39:09.338+0000 7f6172de2540 -1 osd.5 0 log_to_monitors true 2023-10-06T04:39:09.349 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-10-06T04:39:09.347+0000 7f34ca655540 -1 osd.6 0 log_to_monitors true 2023-10-06T04:39:12.471 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-10-06T04:39:12.469+0000 7fb60c8fa700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T04:39:12.479 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-10-06T04:39:12.477+0000 7fb6056f1700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:39:12.491 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-10-06T04:39:12.489+0000 7f616b207700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T04:39:12.497 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-10-06T04:39:12.495+0000 7f61627fb700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:39:12.548 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-10-06T04:39:12.545+0000 7feac844d700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T04:39:12.551 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-10-06T04:39:12.549+0000 7feac1244700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:39:12.554 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-10-06T04:39:12.552+0000 7fc9ffc5d700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T04:39:12.565 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-10-06T04:39:12.563+0000 7fc9f7251700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:39:12.574 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-10-06T04:39:12.571+0000 7f956611f700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T04:39:12.579 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-10-06T04:39:12.577+0000 7f955ef16700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:39:12.582 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-10-06T04:39:12.580+0000 7f34c1277700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T04:39:12.583 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-10-06T04:39:12.580+0000 7f36a5283700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T04:39:12.589 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-10-06T04:39:12.585+0000 7f369c877700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:39:12.590 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-10-06T04:39:12.584+0000 7f34ba06e700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:39:12.607 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-10-06T04:39:12.605+0000 7f640eb51700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T04:39:12.612 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-10-06T04:39:12.610+0000 7f6407948700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:39:13.267 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:13.380 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.378+0000 7f671e965700 1 Processor -- start 2023-10-06T04:39:13.380 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.378+0000 7f671e965700 1 -- start start 2023-10-06T04:39:13.389 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.378+0000 7f671e965700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67181597c0 0x7f67180a9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:13.389 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.378+0000 7f671e965700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f671806d6c0 0x7f67180c1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:13.389 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.378+0000 7f671e965700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67180ab660 con 0x7f6718159b90 2023-10-06T04:39:13.389 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.378+0000 7f671e965700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67180a9eb0 con 0x7f671806d6c0 2023-10-06T04:39:13.389 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.378+0000 7f671e965700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67180aa190 con 0x7f67181597c0 2023-10-06T04:39:13.390 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.379+0000 7f671cf02700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f671806d6c0 0x7f67180c1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:13.390 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.379+0000 7f6717fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67181597c0 0x7f67180a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:13.390 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.379+0000 7f67177fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f6718159b90 0x7f67180aaf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.112:33556/0 (socket says 172.21.15.112:33556) 2023-10-06T04:39:13.390 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.379+0000 7f6717fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67181597c0 0x7f67180a9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.112:45976/0 (socket says 172.21.15.112:45976) 2023-10-06T04:39:13.390 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.379+0000 7f671cf02700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f671806d6c0 0x7f67180c1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.112:44050/0 (socket says 172.21.15.112:44050) 2023-10-06T04:39:13.390 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.379+0000 7f67177fe700 1 -- 172.21.15.112:0/2450668339 learned_addr learned my addr 172.21.15.112:0/2450668339 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:13.391 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.379+0000 7f6717fff700 1 -- 172.21.15.112:0/2450668339 >> v2:172.21.15.179:3300/0 conn(0x7f671806d6c0 msgr2=0x7f67180c1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:13.391 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.379+0000 7f6717fff700 1 --2- 172.21.15.112:0/2450668339 >> v2:172.21.15.179:3300/0 conn(0x7f671806d6c0 0x7f67180c1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.391 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.379+0000 7f6717fff700 1 -- 172.21.15.112:0/2450668339 >> v1:172.21.15.179:6789/0 conn(0x7f6718159b90 legacy=0x7f67180aaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:13.391 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.379+0000 7f6717fff700 1 -- 172.21.15.112:0/2450668339 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67180aa470 con 0x7f67181597c0 2023-10-06T04:39:13.391 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.379+0000 7f6717fff700 1 --2- 172.21.15.112:0/2450668339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67181597c0 0x7f67180a9890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f67080098e0 tx=0x7f67080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5691c27f1caa951b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:13.392 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.379+0000 7f6716ffd700 1 -- 172.21.15.112:0/2450668339 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670800b640 con 0x7f67181597c0 2023-10-06T04:39:13.392 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.379+0000 7f6716ffd700 1 -- 172.21.15.112:0/2450668339 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670800b7a0 con 0x7f67181597c0 2023-10-06T04:39:13.392 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.379+0000 7f6716ffd700 1 -- 172.21.15.112:0/2450668339 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670800bb40 con 0x7f67181597c0 2023-10-06T04:39:13.392 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.380+0000 7f671e965700 1 -- 172.21.15.112:0/2450668339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67181597c0 msgr2=0x7f67180a9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:13.392 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.380+0000 7f671e965700 1 --2- 172.21.15.112:0/2450668339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67181597c0 0x7f67180a9890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f67080098e0 tx=0x7f67080091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.393 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.380+0000 7f671e965700 1 -- 172.21.15.112:0/2450668339 shutdown_connections 2023-10-06T04:39:13.393 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.380+0000 7f671e965700 1 --2- 172.21.15.112:0/2450668339 >> v2:172.21.15.179:3300/0 conn(0x7f671806d6c0 0x7f67180c1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.393 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.380+0000 7f671e965700 1 --2- 172.21.15.112:0/2450668339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67181597c0 0x7f67180a9890 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.393 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.380+0000 7f671e965700 1 -- 172.21.15.112:0/2450668339 >> 172.21.15.112:0/2450668339 conn(0x7f67180ccbd0 msgr2=0x7f67180ccfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:13.393 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.380+0000 7f671e965700 1 -- 172.21.15.112:0/2450668339 shutdown_connections 2023-10-06T04:39:13.393 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.380+0000 7f671e965700 1 -- 172.21.15.112:0/2450668339 wait complete. 2023-10-06T04:39:13.393 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.381+0000 7f671e965700 1 Processor -- start 2023-10-06T04:39:13.394 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.381+0000 7f671e965700 1 -- start start 2023-10-06T04:39:13.394 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.382+0000 7f671e965700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f671806d6c0 0x7f6718156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:13.394 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.382+0000 7f671e965700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67181597c0 0x7f67180af990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:13.394 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.382+0000 7f671e965700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6718159b90 0x7f67180ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:13.394 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.382+0000 7f671e965700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67180b0dd0 con 0x7f671806d6c0 2023-10-06T04:39:13.394 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.382+0000 7f671e965700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67180b01c0 con 0x7f67181597c0 2023-10-06T04:39:13.394 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.382+0000 7f671e965700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67180b04a0 con 0x7f6718159b90 2023-10-06T04:39:13.395 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.382+0000 7f6717fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f671806d6c0 0x7f6718156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:13.395 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.382+0000 7f6717fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f671806d6c0 0x7f6718156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56980/0 (socket says 172.21.15.112:56980) 2023-10-06T04:39:13.395 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.382+0000 7f6717fff700 1 -- 172.21.15.112:0/798974025 learned_addr learned my addr 172.21.15.112:0/798974025 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:13.395 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.382+0000 7f67177fe700 1 --2- 172.21.15.112:0/798974025 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67181597c0 0x7f67180af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:13.395 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.382+0000 7f671cf02700 1 --2- 172.21.15.112:0/798974025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6718159b90 0x7f67180ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:13.395 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.383+0000 7f6717fff700 1 -- 172.21.15.112:0/798974025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6718159b90 msgr2=0x7f67180ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:13.396 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.383+0000 7f6717fff700 1 --2- 172.21.15.112:0/798974025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6718159b90 0x7f67180ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.396 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.383+0000 7f6717fff700 1 -- 172.21.15.112:0/798974025 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67181597c0 msgr2=0x7f67180af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:13.396 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.383+0000 7f6717fff700 1 --2- 172.21.15.112:0/798974025 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67181597c0 0x7f67180af990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.396 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.383+0000 7f6717fff700 1 -- 172.21.15.112:0/798974025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6708009420 con 0x7f671806d6c0 2023-10-06T04:39:13.396 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.383+0000 7f6717fff700 1 --2- 172.21.15.112:0/798974025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f671806d6c0 0x7f6718156810 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6708009f80 tx=0x7f6708017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:13.397 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.383+0000 7f66fffff700 1 -- 172.21.15.112:0/798974025 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670800b910 con 0x7f671806d6c0 2023-10-06T04:39:13.397 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.383+0000 7f66fffff700 1 -- 172.21.15.112:0/798974025 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670800ba70 con 0x7f671806d6c0 2023-10-06T04:39:13.397 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.383+0000 7f671e965700 1 -- 172.21.15.112:0/798974025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67180b0780 con 0x7f671806d6c0 2023-10-06T04:39:13.397 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.383+0000 7f66fffff700 1 -- 172.21.15.112:0/798974025 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708024670 con 0x7f671806d6c0 2023-10-06T04:39:13.397 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.383+0000 7f671e965700 1 -- 172.21.15.112:0/798974025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67180afed0 con 0x7f671806d6c0 2023-10-06T04:39:13.397 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.384+0000 7f671e965700 1 -- 172.21.15.112:0/798974025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67180657a0 con 0x7f671806d6c0 2023-10-06T04:39:13.397 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.384+0000 7f66fffff700 1 -- 172.21.15.112:0/798974025 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f6708011420 con 0x7f671806d6c0 2023-10-06T04:39:13.398 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.384+0000 7f66fffff700 1 --2- 172.21.15.112:0/798974025 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6704066ed0 0x7f6704069380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:13.398 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.385+0000 7f66fffff700 1 -- 172.21.15.112:0/798974025 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7f6708085070 con 0x7f671806d6c0 2023-10-06T04:39:13.398 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.385+0000 7f67177fe700 1 --2- 172.21.15.112:0/798974025 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6704066ed0 0x7f6704069380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:13.398 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.385+0000 7f67177fe700 1 --2- 172.21.15.112:0/798974025 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6704066ed0 0x7f6704069380 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f671816cc20 tx=0x7f670c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:13.399 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.389+0000 7f66fffff700 1 -- 172.21.15.112:0/798974025 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6708053200 con 0x7f671806d6c0 2023-10-06T04:39:13.591 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.589+0000 7f671e965700 1 -- 172.21.15.112:0/798974025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67180cab70 con 0x7f671806d6c0 2023-10-06T04:39:13.592 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.589+0000 7f66fffff700 1 -- 172.21.15.112:0/798974025 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10444 (secure 0 0 0) 0x7f6708056820 con 0x7f671806d6c0 2023-10-06T04:39:13.592 INFO:teuthology.misc.health.smithi112.stdout: 2023-10-06T04:39:13.592 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":13,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:39:13.474642+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:13.594 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.591+0000 7f671e965700 1 -- 172.21.15.112:0/798974025 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6704066ed0 msgr2=0x7f6704069380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:13.594 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.591+0000 7f671e965700 1 --2- 172.21.15.112:0/798974025 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6704066ed0 0x7f6704069380 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f671816cc20 tx=0x7f670c009040 comp rx=0 tx=0).stop 2023-10-06T04:39:13.594 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.591+0000 7f671e965700 1 -- 172.21.15.112:0/798974025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f671806d6c0 msgr2=0x7f6718156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:13.594 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.591+0000 7f671e965700 1 --2- 172.21.15.112:0/798974025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f671806d6c0 0x7f6718156810 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6708009f80 tx=0x7f6708017000 comp rx=0 tx=0).stop 2023-10-06T04:39:13.594 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.591+0000 7f671e965700 1 -- 172.21.15.112:0/798974025 shutdown_connections 2023-10-06T04:39:13.594 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.591+0000 7f671e965700 1 --2- 172.21.15.112:0/798974025 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6704066ed0 0x7f6704069380 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.595 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.592+0000 7f671e965700 1 --2- 172.21.15.112:0/798974025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6718159b90 0x7f67180ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.595 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.592+0000 7f671e965700 1 --2- 172.21.15.112:0/798974025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f671806d6c0 0x7f6718156810 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.595 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.592+0000 7f671e965700 1 --2- 172.21.15.112:0/798974025 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67181597c0 0x7f67180af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.595 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.592+0000 7f671e965700 1 -- 172.21.15.112:0/798974025 >> 172.21.15.112:0/798974025 conn(0x7f67180ccbd0 msgr2=0x7f6718158760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:13.595 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.592+0000 7f671e965700 1 -- 172.21.15.112:0/798974025 shutdown_connections 2023-10-06T04:39:13.595 INFO:teuthology.misc.health.smithi112.stderr:2023-10-06T04:39:13.592+0000 7f671e965700 1 -- 172.21.15.112:0/798974025 wait complete. 2023-10-06T04:39:13.605 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T04:39:13.605 INFO:tasks.ceph:Creating RBD pool 2023-10-06T04:39:13.605 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T04:39:13.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.719+0000 7fb803a99700 1 Processor -- start 2023-10-06T04:39:13.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.719+0000 7fb803a99700 1 -- start start 2023-10-06T04:39:13.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.720+0000 7fb803a99700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb7fc159a20 0x7fb7fc0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:13.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.720+0000 7fb803a99700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb7fc06d3b0 0x7fb7fc0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:13.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.720+0000 7fb803a99700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7fc15af50 con 0x7fb7fc15a9f0 2023-10-06T04:39:13.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.720+0000 7fb803a99700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7fc0cca70 con 0x7fb7fc159a20 2023-10-06T04:39:13.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.720+0000 7fb803a99700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7fc08a080 con 0x7fb7fc06d3b0 2023-10-06T04:39:13.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.720+0000 7fb801835700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb7fc159a20 0x7fb7fc0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:13.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.720+0000 7fb801835700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb7fc159a20 0x7fb7fc0cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56992/0 (socket says 172.21.15.112:56992) 2023-10-06T04:39:13.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.720+0000 7fb801835700 1 -- 172.21.15.112:0/1597382152 learned_addr learned my addr 172.21.15.112:0/1597382152 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:13.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.720+0000 7fb801835700 1 -- 172.21.15.112:0/1597382152 >> v2:172.21.15.179:3300/0 conn(0x7fb7fc06d3b0 msgr2=0x7fb7fc0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:13.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.720+0000 7fb801835700 1 --2- 172.21.15.112:0/1597382152 >> v2:172.21.15.179:3300/0 conn(0x7fb7fc06d3b0 0x7fb7fc0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.720+0000 7fb801835700 1 -- 172.21.15.112:0/1597382152 >> v1:172.21.15.179:6789/0 conn(0x7fb7fc15a9f0 legacy=0x7fb7fc15d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:13.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.720+0000 7fb801835700 1 -- 172.21.15.112:0/1597382152 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc0cae50 con 0x7fb7fc159a20 2023-10-06T04:39:13.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.720+0000 7fb801835700 1 --2- 172.21.15.112:0/1597382152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7fc159a20 0x7fb7fc0cb7f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc08ac00 tx=0x7fb7f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3746471d70b56306 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:13.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.720+0000 7fb800833700 1 -- 172.21.15.112:0/1597382152 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f400b7e0 con 0x7fb7fc159a20 2023-10-06T04:39:13.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.720+0000 7fb800833700 1 -- 172.21.15.112:0/1597382152 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f400b940 con 0x7fb7fc159a20 2023-10-06T04:39:13.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.720+0000 7fb800833700 1 -- 172.21.15.112:0/1597382152 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f400bce0 con 0x7fb7fc159a20 2023-10-06T04:39:13.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.721+0000 7fb803a99700 1 -- 172.21.15.112:0/1597382152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7fc159a20 msgr2=0x7fb7fc0cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:13.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.721+0000 7fb803a99700 1 --2- 172.21.15.112:0/1597382152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7fc159a20 0x7fb7fc0cb7f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc08ac00 tx=0x7fb7f4009250 comp rx=0 tx=0).stop 2023-10-06T04:39:13.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.721+0000 7fb803a99700 1 -- 172.21.15.112:0/1597382152 shutdown_connections 2023-10-06T04:39:13.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.721+0000 7fb803a99700 1 --2- 172.21.15.112:0/1597382152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7fc159a20 0x7fb7fc0cb7f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.721+0000 7fb803a99700 1 --2- 172.21.15.112:0/1597382152 >> v2:172.21.15.179:3300/0 conn(0x7fb7fc06d3b0 0x7fb7fc0cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.721+0000 7fb803a99700 1 -- 172.21.15.112:0/1597382152 >> 172.21.15.112:0/1597382152 conn(0x7fb7fc06cfb0 msgr2=0x7fb7fc0d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:13.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.721+0000 7fb803a99700 1 -- 172.21.15.112:0/1597382152 shutdown_connections 2023-10-06T04:39:13.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.721+0000 7fb803a99700 1 -- 172.21.15.112:0/1597382152 wait complete. 2023-10-06T04:39:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.722+0000 7fb803a99700 1 Processor -- start 2023-10-06T04:39:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.722+0000 7fb803a99700 1 -- start start 2023-10-06T04:39:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb803a99700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc06d3b0 0x7fb7fc0b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb803a99700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7fc159a20 0x7fb7fc0b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb803a99700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7fc15a9f0 0x7fb7fc0aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb803a99700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc0b4070 con 0x7fb7fc159a20 2023-10-06T04:39:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb803a99700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc0b4310 con 0x7fb7fc06d3b0 2023-10-06T04:39:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb803a99700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc0b45f0 con 0x7fb7fc15a9f0 2023-10-06T04:39:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb801034700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7fc159a20 0x7fb7fc0b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb801034700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7fc159a20 0x7fb7fc0b1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56996/0 (socket says 172.21.15.112:56996) 2023-10-06T04:39:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb801034700 1 -- 172.21.15.112:0/256291213 learned_addr learned my addr 172.21.15.112:0/256291213 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb801835700 1 --2- 172.21.15.112:0/256291213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc06d3b0 0x7fb7fc0b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb802036700 1 --2- 172.21.15.112:0/256291213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7fc15a9f0 0x7fb7fc0aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb801034700 1 -- 172.21.15.112:0/256291213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7fc15a9f0 msgr2=0x7fb7fc0aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb801034700 1 --2- 172.21.15.112:0/256291213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7fc15a9f0 0x7fb7fc0aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb801034700 1 -- 172.21.15.112:0/256291213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc06d3b0 msgr2=0x7fb7fc0b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb801034700 1 --2- 172.21.15.112:0/256291213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc06d3b0 0x7fb7fc0b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb801034700 1 -- 172.21.15.112:0/256291213 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f40094f0 con 0x7fb7fc159a20 2023-10-06T04:39:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb801835700 1 --2- 172.21.15.112:0/256291213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc06d3b0 0x7fb7fc0b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:13.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb801034700 1 --2- 172.21.15.112:0/256291213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7fc159a20 0x7fb7fc0b1f60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000b810 tx=0x7fb7f0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:13.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb7f9ffb700 1 -- 172.21.15.112:0/256291213 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f000f5f0 con 0x7fb7fc159a20 2023-10-06T04:39:13.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb7f9ffb700 1 -- 172.21.15.112:0/256291213 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f000f750 con 0x7fb7fc159a20 2023-10-06T04:39:13.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb7f9ffb700 1 -- 172.21.15.112:0/256291213 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f000fb10 con 0x7fb7fc159a20 2023-10-06T04:39:13.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.723+0000 7fb803a99700 1 -- 172.21.15.112:0/256291213 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7fc0b48d0 con 0x7fb7fc159a20 2023-10-06T04:39:13.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.724+0000 7fb803a99700 1 -- 172.21.15.112:0/256291213 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7fc0af380 con 0x7fb7fc159a20 2023-10-06T04:39:13.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.725+0000 7fb803a99700 1 -- 172.21.15.112:0/256291213 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7fc0af5a0 con 0x7fb7fc159a20 2023-10-06T04:39:13.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.725+0000 7fb7f9ffb700 1 -- 172.21.15.112:0/256291213 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fb7f0010480 con 0x7fb7fc159a20 2023-10-06T04:39:13.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.725+0000 7fb7f9ffb700 1 --2- 172.21.15.112:0/256291213 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb7e8066f20 0x7fb7e80693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:13.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.725+0000 7fb7f9ffb700 1 -- 172.21.15.112:0/256291213 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7fb7f0083ef0 con 0x7fb7fc159a20 2023-10-06T04:39:13.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.725+0000 7fb801835700 1 --2- 172.21.15.112:0/256291213 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb7e8066f20 0x7fb7e80693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:13.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.726+0000 7fb801835700 1 --2- 172.21.15.112:0/256291213 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb7e8066f20 0x7fb7e80693d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc08ac00 tx=0x7fb7f4016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:13.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.730+0000 7fb7f9ffb700 1 -- 172.21.15.112:0/256291213 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7f00516f0 con 0x7fb7fc159a20 2023-10-06T04:39:13.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:13.911+0000 7fb803a99700 1 -- 172.21.15.112:0/256291213 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fb7fc0b24a0 con 0x7fb7fc159a20 2023-10-06T04:39:14.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.574+0000 7fb7f9ffb700 1 -- 172.21.15.112:0/256291213 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7fb7f0054d10 con 0x7fb7fc159a20 2023-10-06T04:39:14.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.577+0000 7fb803a99700 1 -- 172.21.15.112:0/256291213 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb7e8066f20 msgr2=0x7fb7e80693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:14.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.577+0000 7fb803a99700 1 --2- 172.21.15.112:0/256291213 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb7e8066f20 0x7fb7e80693d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc08ac00 tx=0x7fb7f4016000 comp rx=0 tx=0).stop 2023-10-06T04:39:14.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.577+0000 7fb803a99700 1 -- 172.21.15.112:0/256291213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7fc159a20 msgr2=0x7fb7fc0b1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:14.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.577+0000 7fb803a99700 1 --2- 172.21.15.112:0/256291213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7fc159a20 0x7fb7fc0b1f60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000b810 tx=0x7fb7f0009220 comp rx=0 tx=0).stop 2023-10-06T04:39:14.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.577+0000 7fb803a99700 1 -- 172.21.15.112:0/256291213 shutdown_connections 2023-10-06T04:39:14.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.577+0000 7fb803a99700 1 --2- 172.21.15.112:0/256291213 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb7e8066f20 0x7fb7e80693d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:14.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.577+0000 7fb803a99700 1 --2- 172.21.15.112:0/256291213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7fc15a9f0 0x7fb7fc0aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:14.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.577+0000 7fb803a99700 1 --2- 172.21.15.112:0/256291213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc06d3b0 0x7fb7fc0b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:14.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.577+0000 7fb803a99700 1 --2- 172.21.15.112:0/256291213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7fc159a20 0x7fb7fc0b1f60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:14.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.577+0000 7fb803a99700 1 -- 172.21.15.112:0/256291213 >> 172.21.15.112:0/256291213 conn(0x7fb7fc06cfb0 msgr2=0x7fb7fc15dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:14.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.577+0000 7fb803a99700 1 -- 172.21.15.112:0/256291213 shutdown_connections 2023-10-06T04:39:14.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.577+0000 7fb803a99700 1 -- 172.21.15.112:0/256291213 wait complete. 2023-10-06T04:39:14.582 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'rbd' created 2023-10-06T04:39:14.592 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T04:39:14.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.706+0000 7f57ce43a700 1 Processor -- start 2023-10-06T04:39:14.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.706+0000 7f57ce43a700 1 -- start start 2023-10-06T04:39:14.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57ce43a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57c8159a20 0x7f57c80cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:14.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57ce43a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f57c806d3b0 0x7f57c80cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:14.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57ce43a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c815af50 con 0x7f57c815a9f0 2023-10-06T04:39:14.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57ce43a700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c80cca70 con 0x7f57c806d3b0 2023-10-06T04:39:14.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57ce43a700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c808a080 con 0x7f57c8159a20 2023-10-06T04:39:14.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57cc9d7700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f57c815a9f0 0x7f57c815d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34490/0 (socket says 172.21.15.112:34490) 2023-10-06T04:39:14.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57cc9d7700 1 -- 172.21.15.112:0/3311173525 learned_addr learned my addr 172.21.15.112:0/3311173525 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:14.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57c77fe700 1 --2- 172.21.15.112:0/3311173525 >> v2:172.21.15.179:3300/0 conn(0x7f57c806d3b0 0x7f57c80cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:14.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57c6ffd700 1 -- 172.21.15.112:0/3311173525 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922457455 0 0) 0x7f57c815af50 con 0x7f57c815a9f0 2023-10-06T04:39:14.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57c6ffd700 1 -- 172.21.15.112:0/3311173525 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57b0003570 con 0x7f57c815a9f0 2023-10-06T04:39:14.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57c7fff700 1 --2- 172.21.15.112:0/3311173525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57c8159a20 0x7f57c80cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:14.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57c6ffd700 1 -- 172.21.15.112:0/3311173525 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4007219312 0 0) 0x7f57b0003570 con 0x7f57c815a9f0 2023-10-06T04:39:14.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57c6ffd700 1 -- 172.21.15.112:0/3311173525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57c8159a20 msgr2=0x7f57c80cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:14.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57c6ffd700 1 --2- 172.21.15.112:0/3311173525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57c8159a20 0x7f57c80cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:14.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57c6ffd700 1 -- 172.21.15.112:0/3311173525 >> v2:172.21.15.179:3300/0 conn(0x7f57c806d3b0 msgr2=0x7f57c80cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:14.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57c6ffd700 1 --2- 172.21.15.112:0/3311173525 >> v2:172.21.15.179:3300/0 conn(0x7f57c806d3b0 0x7f57c80cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:14.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57c6ffd700 1 -- 172.21.15.112:0/3311173525 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c80cae50 con 0x7f57c815a9f0 2023-10-06T04:39:14.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57c6ffd700 1 -- 172.21.15.112:0/3311173525 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f57c00017f0 con 0x7f57c815a9f0 2023-10-06T04:39:14.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57c6ffd700 1 -- 172.21.15.112:0/3311173525 >> v1:172.21.15.112:6789/0 conn(0x7f57c815a9f0 legacy=0x7f57c815d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:14.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57c6ffd700 1 --2- 172.21.15.112:0/3311173525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57c8159a20 0x7f57b0003b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:14.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57c6ffd700 1 --2- 172.21.15.112:0/3311173525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57b00040e0 0x7f57b0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:14.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57c6ffd700 1 --2- 172.21.15.112:0/3311173525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57b0004d50 0x7f57b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:14.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57c6ffd700 1 -- 172.21.15.112:0/3311173525 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c80cca70 con 0x7f57b0004d50 2023-10-06T04:39:14.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57c6ffd700 1 -- 172.21.15.112:0/3311173525 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c808a080 con 0x7f57b00040e0 2023-10-06T04:39:14.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.707+0000 7f57c6ffd700 1 -- 172.21.15.112:0/3311173525 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b000bb90 con 0x7f57c8159a20 2023-10-06T04:39:14.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.708+0000 7f57cc9d7700 1 --2- 172.21.15.112:0/3311173525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57b0004d50 0x7f57b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:14.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.708+0000 7f57c7fff700 1 --2- 172.21.15.112:0/3311173525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57c8159a20 0x7f57b0003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:14.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.708+0000 7f57c77fe700 1 --2- 172.21.15.112:0/3311173525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57b00040e0 0x7f57b0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:14.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.708+0000 7f57cc9d7700 1 -- 172.21.15.112:0/3311173525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57c8159a20 msgr2=0x7f57b0003b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:14.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.708+0000 7f57cc9d7700 1 --2- 172.21.15.112:0/3311173525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57c8159a20 0x7f57b0003b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:14.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.708+0000 7f57cc9d7700 1 -- 172.21.15.112:0/3311173525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57b00040e0 msgr2=0x7f57b0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:14.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.708+0000 7f57cc9d7700 1 --2- 172.21.15.112:0/3311173525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57b00040e0 0x7f57b0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:14.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.708+0000 7f57cc9d7700 1 -- 172.21.15.112:0/3311173525 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b0003570 con 0x7f57b0004d50 2023-10-06T04:39:14.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.708+0000 7f57cc9d7700 1 --2- 172.21.15.112:0/3311173525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57b0004d50 0x7f57b00051c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f57c000a830 tx=0x7f57c0002100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d8cfa7b8f2cbda server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:14.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.708+0000 7f57c6ffd700 1 -- 172.21.15.112:0/3311173525 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c00070f0 con 0x7f57b0004d50 2023-10-06T04:39:14.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.708+0000 7f57c6ffd700 1 -- 172.21.15.112:0/3311173525 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c0007290 con 0x7f57b0004d50 2023-10-06T04:39:14.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.708+0000 7f57c6ffd700 1 -- 172.21.15.112:0/3311173525 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c0007650 con 0x7f57b0004d50 2023-10-06T04:39:14.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.709+0000 7f57ce43a700 1 -- 172.21.15.112:0/3311173525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57b0004d50 msgr2=0x7f57b00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:14.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.709+0000 7f57ce43a700 1 --2- 172.21.15.112:0/3311173525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57b0004d50 0x7f57b00051c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f57c000a830 tx=0x7f57c0002100 comp rx=0 tx=0).stop 2023-10-06T04:39:14.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.709+0000 7f57cc9d7700 1 -- 172.21.15.112:0/3311173525 reap_dead start 2023-10-06T04:39:14.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.709+0000 7f57ce43a700 1 -- 172.21.15.112:0/3311173525 shutdown_connections 2023-10-06T04:39:14.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.709+0000 7f57ce43a700 1 -- 172.21.15.112:0/3311173525 >> 172.21.15.112:0/3311173525 conn(0x7f57c806cfb0 msgr2=0x7f57c80d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:14.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.709+0000 7f57ce43a700 1 -- 172.21.15.112:0/3311173525 shutdown_connections 2023-10-06T04:39:14.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.709+0000 7f57ce43a700 1 -- 172.21.15.112:0/3311173525 wait complete. 2023-10-06T04:39:14.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.710+0000 7f57ce43a700 1 Processor -- start 2023-10-06T04:39:14.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.710+0000 7f57ce43a700 1 -- start start 2023-10-06T04:39:14.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57ce43a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57b0004d50 0x7f57c80b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:14.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57ce43a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57c814e020 0x7f57c80b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:14.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57ce43a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57c814e6f0 0x7f57c814eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:14.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57ce43a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c8150bd0 con 0x7f57c814e6f0 2023-10-06T04:39:14.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57ce43a700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c8150e50 con 0x7f57b0004d50 2023-10-06T04:39:14.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57ce43a700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c8151110 con 0x7f57c814e020 2023-10-06T04:39:14.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57cc9d7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57c814e6f0 0x7f57c814eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:14.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57cc9d7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57c814e6f0 0x7f57c814eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57008/0 (socket says 172.21.15.112:57008) 2023-10-06T04:39:14.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57cc9d7700 1 -- 172.21.15.112:0/3629415445 learned_addr learned my addr 172.21.15.112:0/3629415445 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:14.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57c7fff700 1 --2- 172.21.15.112:0/3629415445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57b0004d50 0x7f57c80b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:14.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57c77fe700 1 --2- 172.21.15.112:0/3629415445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57c814e020 0x7f57c80b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:14.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57cc9d7700 1 -- 172.21.15.112:0/3629415445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57c814e020 msgr2=0x7f57c80b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:14.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57cc9d7700 1 --2- 172.21.15.112:0/3629415445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57c814e020 0x7f57c80b5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:14.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57cc9d7700 1 -- 172.21.15.112:0/3629415445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57b0004d50 msgr2=0x7f57c80b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:14.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57cc9d7700 1 --2- 172.21.15.112:0/3629415445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57b0004d50 0x7f57c80b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:14.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57cc9d7700 1 -- 172.21.15.112:0/3629415445 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c81513f0 con 0x7f57c814e6f0 2023-10-06T04:39:14.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57cc9d7700 1 --2- 172.21.15.112:0/3629415445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57c814e6f0 0x7f57c814eb90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f57c0001220 tx=0x7f57c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:14.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57affff700 1 -- 172.21.15.112:0/3629415445 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c0001ee0 con 0x7f57c814e6f0 2023-10-06T04:39:14.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57affff700 1 -- 172.21.15.112:0/3629415445 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c0012e60 con 0x7f57c814e6f0 2023-10-06T04:39:14.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57ce43a700 1 -- 172.21.15.112:0/3629415445 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c81516d0 con 0x7f57c814e6f0 2023-10-06T04:39:14.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57affff700 1 -- 172.21.15.112:0/3629415445 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c0007070 con 0x7f57c814e6f0 2023-10-06T04:39:14.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.711+0000 7f57ce43a700 1 -- 172.21.15.112:0/3629415445 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c8151ed0 con 0x7f57c814e6f0 2023-10-06T04:39:14.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.712+0000 7f57ce43a700 1 -- 172.21.15.112:0/3629415445 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c8151bf0 con 0x7f57c814e6f0 2023-10-06T04:39:14.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.713+0000 7f57affff700 1 -- 172.21.15.112:0/3629415445 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f57c001f440 con 0x7f57c814e6f0 2023-10-06T04:39:14.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.713+0000 7f57affff700 1 --2- 172.21.15.112:0/3629415445 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f57b4066ea0 0x7f57b4069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:14.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.713+0000 7f57affff700 1 -- 172.21.15.112:0/3629415445 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 5184+0+0 (secure 0 0 0) 0x7f57c0086a50 con 0x7f57c814e6f0 2023-10-06T04:39:14.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.713+0000 7f57c7fff700 1 --2- 172.21.15.112:0/3629415445 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f57b4066ea0 0x7f57b4069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:14.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.714+0000 7f57c7fff700 1 --2- 172.21.15.112:0/3629415445 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f57b4066ea0 0x7f57b4069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f57bc006f00 tx=0x7f57bc0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:14.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.718+0000 7f57affff700 1 -- 172.21.15.112:0/3629415445 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57c8151bf0 con 0x7f57c814e6f0 2023-10-06T04:39:14.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:14.901+0000 7f57ce43a700 1 -- 172.21.15.112:0/3629415445 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f57c8151bf0 con 0x7f57c814e6f0 2023-10-06T04:39:15.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.580+0000 7f57affff700 1 -- 172.21.15.112:0/3629415445 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f57c8151bf0 con 0x7f57c814e6f0 2023-10-06T04:39:15.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.583+0000 7f57ce43a700 1 -- 172.21.15.112:0/3629415445 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f57b4066ea0 msgr2=0x7f57b4069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:15.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.583+0000 7f57ce43a700 1 --2- 172.21.15.112:0/3629415445 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f57b4066ea0 0x7f57b4069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f57bc006f00 tx=0x7f57bc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:15.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.583+0000 7f57ce43a700 1 -- 172.21.15.112:0/3629415445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57c814e6f0 msgr2=0x7f57c814eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:15.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.583+0000 7f57ce43a700 1 --2- 172.21.15.112:0/3629415445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57c814e6f0 0x7f57c814eb90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f57c0001220 tx=0x7f57c0016000 comp rx=0 tx=0).stop 2023-10-06T04:39:15.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.583+0000 7f57ce43a700 1 -- 172.21.15.112:0/3629415445 shutdown_connections 2023-10-06T04:39:15.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.583+0000 7f57ce43a700 1 --2- 172.21.15.112:0/3629415445 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f57b4066ea0 0x7f57b4069350 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:15.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.583+0000 7f57ce43a700 1 --2- 172.21.15.112:0/3629415445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57c814e6f0 0x7f57c814eb90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:15.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.583+0000 7f57ce43a700 1 --2- 172.21.15.112:0/3629415445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57b0004d50 0x7f57c80b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:15.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.583+0000 7f57ce43a700 1 --2- 172.21.15.112:0/3629415445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57c814e020 0x7f57c80b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:15.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.583+0000 7f57ce43a700 1 -- 172.21.15.112:0/3629415445 >> 172.21.15.112:0/3629415445 conn(0x7f57c806cfb0 msgr2=0x7f57c8153410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:15.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.584+0000 7f57ce43a700 1 -- 172.21.15.112:0/3629415445 shutdown_connections 2023-10-06T04:39:15.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.584+0000 7f57ce43a700 1 -- 172.21.15.112:0/3629415445 wait complete. 2023-10-06T04:39:15.587 INFO:teuthology.orchestra.run.smithi112.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T04:39:15.599 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T04:39:15.599 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T04:39:15.600 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T04:39:15.601 INFO:tasks.ceph.mds.a:Started 2023-10-06T04:39:15.602 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T04:39:15.602 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T04:39:15.604 INFO:tasks.ceph.mds.c:Started 2023-10-06T04:39:15.604 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T04:39:15.604 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T04:39:15.606 INFO:tasks.ceph.mds.b:Started 2023-10-06T04:39:15.606 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T04:39:15.606 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T04:39:15.608 INFO:tasks.ceph.mds.d:Started 2023-10-06T04:39:15.609 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T04:39:15.609 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:15.683 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2023-10-06T04:39:15.684 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2023-10-06T04:39:15.693 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-06T04:39:15.694 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-06T04:39:15.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.738+0000 7f0491836700 1 Processor -- start 2023-10-06T04:39:15.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.738+0000 7f0491836700 1 -- start start 2023-10-06T04:39:15.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.739+0000 7f0491836700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f048c06dea0 0x7f048c06e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:15.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.739+0000 7f0491836700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f048c157330 con 0x7f048c15a820 2023-10-06T04:39:15.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.739+0000 7f0491836700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f048c157610 con 0x7f048c0aee90 2023-10-06T04:39:15.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.739+0000 7f0491836700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048c0af300 con 0x7f048c06dea0 2023-10-06T04:39:15.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.739+0000 7f048b7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f048c15a820 0x7f048c156070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34504/0 (socket says 172.21.15.112:34504) 2023-10-06T04:39:15.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.739+0000 7f048b7fe700 1 -- 172.21.15.112:0/1589079980 learned_addr learned my addr 172.21.15.112:0/1589079980 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:15.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.740+0000 7f048affd700 1 --2- 172.21.15.112:0/1589079980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f048c06dea0 0x7f048c06e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:15.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.740+0000 7f0489ffb700 1 -- 172.21.15.112:0/1589079980 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055050534 0 0) 0x7f048c157330 con 0x7f048c15a820 2023-10-06T04:39:15.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.740+0000 7f0489ffb700 1 -- 172.21.15.112:0/1589079980 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0478003570 con 0x7f048c15a820 2023-10-06T04:39:15.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.740+0000 7f048affd700 1 -- 172.21.15.112:0/1589079980 >> v1:172.21.15.179:6789/0 conn(0x7f048c0aee90 legacy=0x7f048c0ac9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:15.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.740+0000 7f048affd700 1 -- 172.21.15.112:0/1589079980 >> v1:172.21.15.112:6789/0 conn(0x7f048c15a820 legacy=0x7f048c156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:15.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.740+0000 7f048affd700 1 -- 172.21.15.112:0/1589079980 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048c1578f0 con 0x7f048c06dea0 2023-10-06T04:39:15.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.740+0000 7f048affd700 1 --2- 172.21.15.112:0/1589079980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f048c06dea0 0x7f048c06e270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0484009910 tx=0x7f04840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe6c1145d817a758 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:15.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.740+0000 7f0489ffb700 1 -- 172.21.15.112:0/1589079980 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048400b680 con 0x7f048c06dea0 2023-10-06T04:39:15.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.740+0000 7f0489ffb700 1 -- 172.21.15.112:0/1589079980 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048400b7e0 con 0x7f048c06dea0 2023-10-06T04:39:15.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.740+0000 7f0489ffb700 1 -- 172.21.15.112:0/1589079980 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048400bba0 con 0x7f048c06dea0 2023-10-06T04:39:15.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.741+0000 7f0491836700 1 -- 172.21.15.112:0/1589079980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f048c06dea0 msgr2=0x7f048c06e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:15.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.741+0000 7f0491836700 1 --2- 172.21.15.112:0/1589079980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f048c06dea0 0x7f048c06e270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0484009910 tx=0x7f04840091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:15.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.741+0000 7f0491836700 1 -- 172.21.15.112:0/1589079980 shutdown_connections 2023-10-06T04:39:15.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.741+0000 7f0491836700 1 --2- 172.21.15.112:0/1589079980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f048c06dea0 0x7f048c06e270 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:15.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.741+0000 7f0491836700 1 -- 172.21.15.112:0/1589079980 >> 172.21.15.112:0/1589079980 conn(0x7f048c06d8e0 msgr2=0x7f048c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:15.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.741+0000 7f0491836700 1 -- 172.21.15.112:0/1589079980 shutdown_connections 2023-10-06T04:39:15.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.741+0000 7f0491836700 1 -- 172.21.15.112:0/1589079980 wait complete. 2023-10-06T04:39:15.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.742+0000 7f0491836700 1 Processor -- start 2023-10-06T04:39:15.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.742+0000 7f0491836700 1 -- start start 2023-10-06T04:39:15.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.743+0000 7f0491836700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f048c06dea0 0x7f048c150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:15.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.743+0000 7f0491836700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f048c0aee90 0x7f048c0c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:15.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.743+0000 7f0491836700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f048c15a820 0x7f048c0c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:15.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.743+0000 7f0491836700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048c0ca560 con 0x7f048c06dea0 2023-10-06T04:39:15.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.743+0000 7f0491836700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048c0ca7b0 con 0x7f048c15a820 2023-10-06T04:39:15.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.743+0000 7f0491836700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048c0caa90 con 0x7f048c0aee90 2023-10-06T04:39:15.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.743+0000 7f048affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f048c06dea0 0x7f048c150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:15.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.743+0000 7f048affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f048c06dea0 0x7f048c150490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57068/0 (socket says 172.21.15.112:57068) 2023-10-06T04:39:15.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.743+0000 7f048affd700 1 -- 172.21.15.112:0/2082883940 learned_addr learned my addr 172.21.15.112:0/2082883940 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:15.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.743+0000 7f048a7fc700 1 --2- 172.21.15.112:0/2082883940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f048c0aee90 0x7f048c0c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:15.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.743+0000 7f048b7fe700 1 --2- 172.21.15.112:0/2082883940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f048c15a820 0x7f048c0c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:15.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.743+0000 7f048affd700 1 -- 172.21.15.112:0/2082883940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f048c0aee90 msgr2=0x7f048c0c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:15.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.743+0000 7f048affd700 1 --2- 172.21.15.112:0/2082883940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f048c0aee90 0x7f048c0c2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:15.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.743+0000 7f048affd700 1 -- 172.21.15.112:0/2082883940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f048c15a820 msgr2=0x7f048c0c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:15.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.743+0000 7f048affd700 1 --2- 172.21.15.112:0/2082883940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f048c15a820 0x7f048c0c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:15.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.743+0000 7f048affd700 1 -- 172.21.15.112:0/2082883940 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0484009420 con 0x7f048c06dea0 2023-10-06T04:39:15.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.743+0000 7f048a7fc700 1 --2- 172.21.15.112:0/2082883940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f048c0aee90 0x7f048c0c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:15.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.743+0000 7f048affd700 1 --2- 172.21.15.112:0/2082883940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f048c06dea0 0x7f048c150490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f048c071a00 tx=0x7f0484017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:15.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.744+0000 7f0482ffd700 1 -- 172.21.15.112:0/2082883940 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048400bb60 con 0x7f048c06dea0 2023-10-06T04:39:15.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.744+0000 7f0482ffd700 1 -- 172.21.15.112:0/2082883940 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0484000c90 con 0x7f048c06dea0 2023-10-06T04:39:15.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.744+0000 7f0491836700 1 -- 172.21.15.112:0/2082883940 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f048c0cad70 con 0x7f048c06dea0 2023-10-06T04:39:15.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.744+0000 7f0482ffd700 1 -- 172.21.15.112:0/2082883940 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048401a660 con 0x7f048c06dea0 2023-10-06T04:39:15.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.744+0000 7f0491836700 1 -- 172.21.15.112:0/2082883940 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f048c1509d0 con 0x7f048c06dea0 2023-10-06T04:39:15.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.745+0000 7f0491836700 1 -- 172.21.15.112:0/2082883940 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f048c0cb290 con 0x7f048c06dea0 2023-10-06T04:39:15.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.745+0000 7f0482ffd700 1 -- 172.21.15.112:0/2082883940 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f048401aa10 con 0x7f048c06dea0 2023-10-06T04:39:15.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.745+0000 7f0482ffd700 1 --2- 172.21.15.112:0/2082883940 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f046c066ea0 0x7f046c069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:15.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.746+0000 7f0482ffd700 1 -- 172.21.15.112:0/2082883940 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0484085f10 con 0x7f048c06dea0 2023-10-06T04:39:15.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.746+0000 7f048a7fc700 1 --2- 172.21.15.112:0/2082883940 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f046c066ea0 0x7f046c069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:15.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.746+0000 7f048a7fc700 1 --2- 172.21.15.112:0/2082883940 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f046c066ea0 0x7f046c069350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f048c1571b0 tx=0x7f0474009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:15.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.750+0000 7f0482ffd700 1 -- 172.21.15.112:0/2082883940 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f048c0cb290 con 0x7f048c06dea0 2023-10-06T04:39:15.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.958+0000 7f0491836700 1 -- 172.21.15.112:0/2082883940 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f048c0cb290 con 0x7f048c06dea0 2023-10-06T04:39:15.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.959+0000 7f0482ffd700 1 -- 172.21.15.112:0/2082883940 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+13722 (secure 0 0 0) 0x7f0484053450 con 0x7f048c06dea0 2023-10-06T04:39:15.962 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:15.962 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":15,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:39:15.574379+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:15.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.961+0000 7f0491836700 1 -- 172.21.15.112:0/2082883940 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f046c066ea0 msgr2=0x7f046c069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:15.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.961+0000 7f0491836700 1 --2- 172.21.15.112:0/2082883940 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f046c066ea0 0x7f046c069350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f048c1571b0 tx=0x7f0474009040 comp rx=0 tx=0).stop 2023-10-06T04:39:15.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.961+0000 7f0491836700 1 -- 172.21.15.112:0/2082883940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f048c06dea0 msgr2=0x7f048c150490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:15.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.961+0000 7f0491836700 1 --2- 172.21.15.112:0/2082883940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f048c06dea0 0x7f048c150490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f048c071a00 tx=0x7f0484017000 comp rx=0 tx=0).stop 2023-10-06T04:39:15.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.961+0000 7f0491836700 1 -- 172.21.15.112:0/2082883940 shutdown_connections 2023-10-06T04:39:15.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.961+0000 7f0491836700 1 --2- 172.21.15.112:0/2082883940 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f046c066ea0 0x7f046c069350 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:15.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.961+0000 7f0491836700 1 --2- 172.21.15.112:0/2082883940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f048c15a820 0x7f048c0c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:15.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.961+0000 7f0491836700 1 --2- 172.21.15.112:0/2082883940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f048c06dea0 0x7f048c150490 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:15.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.961+0000 7f0491836700 1 --2- 172.21.15.112:0/2082883940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f048c0aee90 0x7f048c0c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:15.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.961+0000 7f0491836700 1 -- 172.21.15.112:0/2082883940 >> 172.21.15.112:0/2082883940 conn(0x7f048c06d8e0 msgr2=0x7f048c155e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:15.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.961+0000 7f0491836700 1 -- 172.21.15.112:0/2082883940 shutdown_connections 2023-10-06T04:39:15.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:15.962+0000 7f0491836700 1 -- 172.21.15.112:0/2082883940 wait complete. 2023-10-06T04:39:15.976 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:13.929254+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:39:14.321892+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T04:39:15.976 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:39:16.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.095+0000 7f49eb59e700 1 Processor -- start 2023-10-06T04:39:16.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.095+0000 7f49eb59e700 1 -- start start 2023-10-06T04:39:16.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.096+0000 7f49eb59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f49ec0d0c40 0x7f49ec0c7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.096+0000 7f49eb59e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ec0cab40 con 0x7f49ec0c7bd0 2023-10-06T04:39:16.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.096+0000 7f49eb59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ec0cceb0 con 0x7f49ec157220 2023-10-06T04:39:16.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.096+0000 7f49eb59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49ec0cd100 con 0x7f49ec0d0c40 2023-10-06T04:39:16.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.096+0000 7f49ead9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f49ec0c7bd0 0x7f49ec0c97a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34518/0 (socket says 172.21.15.112:34518) 2023-10-06T04:39:16.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.096+0000 7f49ead9d700 1 -- 172.21.15.112:0/1910158403 learned_addr learned my addr 172.21.15.112:0/1910158403 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:16.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.096+0000 7f49e9d9b700 1 --2- 172.21.15.112:0/1910158403 >> v2:172.21.15.179:3300/0 conn(0x7f49ec0d0c40 0x7f49ec0c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.096+0000 7f49e959a700 1 -- 172.21.15.112:0/1910158403 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669329765 0 0) 0x7f49ec0cab40 con 0x7f49ec0c7bd0 2023-10-06T04:39:16.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.096+0000 7f49e959a700 1 -- 172.21.15.112:0/1910158403 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49d4003570 con 0x7f49ec0c7bd0 2023-10-06T04:39:16.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.096+0000 7f49e9d9b700 1 -- 172.21.15.112:0/1910158403 >> v1:172.21.15.179:6789/0 conn(0x7f49ec157220 legacy=0x7f49ec0d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:16.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.096+0000 7f49e9d9b700 1 -- 172.21.15.112:0/1910158403 >> v1:172.21.15.112:6789/0 conn(0x7f49ec0c7bd0 legacy=0x7f49ec0c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.096+0000 7f49e9d9b700 1 -- 172.21.15.112:0/1910158403 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ec0cd3e0 con 0x7f49ec0d0c40 2023-10-06T04:39:16.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.096+0000 7f49e9d9b700 1 --2- 172.21.15.112:0/1910158403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49ec0d0c40 0x7f49ec0c7690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f49e00098d0 tx=0x7f49e0009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4a3ecfe79ab7323 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:16.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.097+0000 7f49e959a700 1 -- 172.21.15.112:0/1910158403 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e0005c10 con 0x7f49ec0d0c40 2023-10-06T04:39:16.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.097+0000 7f49e959a700 1 -- 172.21.15.112:0/1910158403 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e0005d70 con 0x7f49ec0d0c40 2023-10-06T04:39:16.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.097+0000 7f49e959a700 1 -- 172.21.15.112:0/1910158403 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e0006280 con 0x7f49ec0d0c40 2023-10-06T04:39:16.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.097+0000 7f49eb59e700 1 -- 172.21.15.112:0/1910158403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49ec0d0c40 msgr2=0x7f49ec0c7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.097+0000 7f49eb59e700 1 --2- 172.21.15.112:0/1910158403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49ec0d0c40 0x7f49ec0c7690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f49e00098d0 tx=0x7f49e0009120 comp rx=0 tx=0).stop 2023-10-06T04:39:16.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.097+0000 7f49eb59e700 1 -- 172.21.15.112:0/1910158403 shutdown_connections 2023-10-06T04:39:16.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.097+0000 7f49eb59e700 1 --2- 172.21.15.112:0/1910158403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49ec0d0c40 0x7f49ec0c7690 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.097+0000 7f49eb59e700 1 -- 172.21.15.112:0/1910158403 >> 172.21.15.112:0/1910158403 conn(0x7f49ec06c7d0 msgr2=0x7f49ec06cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:16.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.097+0000 7f49eb59e700 1 -- 172.21.15.112:0/1910158403 shutdown_connections 2023-10-06T04:39:16.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.097+0000 7f49eb59e700 1 -- 172.21.15.112:0/1910158403 wait complete. 2023-10-06T04:39:16.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.098+0000 7f49eb59e700 1 Processor -- start 2023-10-06T04:39:16.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.098+0000 7f49eb59e700 1 -- start start 2023-10-06T04:39:16.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.099+0000 7f49eb59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49ec0c7bd0 0x7f49ec144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.099+0000 7f49eb59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49ec0d0c40 0x7f49ec145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.099+0000 7f49eb59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49ec157220 0x7f49ec16d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.099+0000 7f49eb59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec145290 con 0x7f49ec157220 2023-10-06T04:39:16.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.099+0000 7f49eb59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec146a70 con 0x7f49ec0d0c40 2023-10-06T04:39:16.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.099+0000 7f49eb59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec145e60 con 0x7f49ec0c7bd0 2023-10-06T04:39:16.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.099+0000 7f49ead9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49ec157220 0x7f49ec16d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.099+0000 7f49ead9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49ec157220 0x7f49ec16d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57080/0 (socket says 172.21.15.112:57080) 2023-10-06T04:39:16.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.099+0000 7f49ead9d700 1 -- 172.21.15.112:0/4217422983 learned_addr learned my addr 172.21.15.112:0/4217422983 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:16.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.099+0000 7f49e9d9b700 1 --2- 172.21.15.112:0/4217422983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49ec0d0c40 0x7f49ec145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.099+0000 7f49ea59c700 1 --2- 172.21.15.112:0/4217422983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49ec0c7bd0 0x7f49ec144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.099+0000 7f49ead9d700 1 -- 172.21.15.112:0/4217422983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49ec0c7bd0 msgr2=0x7f49ec144d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.099+0000 7f49ead9d700 1 --2- 172.21.15.112:0/4217422983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49ec0c7bd0 0x7f49ec144d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.100+0000 7f49ead9d700 1 -- 172.21.15.112:0/4217422983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49ec0d0c40 msgr2=0x7f49ec145610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.100+0000 7f49ead9d700 1 --2- 172.21.15.112:0/4217422983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49ec0d0c40 0x7f49ec145610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.100+0000 7f49ead9d700 1 -- 172.21.15.112:0/4217422983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e00093c0 con 0x7f49ec157220 2023-10-06T04:39:16.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.100+0000 7f49ead9d700 1 --2- 172.21.15.112:0/4217422983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49ec157220 0x7f49ec16d2c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f49e4001460 tx=0x7f49e4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:16.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.100+0000 7f49da7fc700 1 -- 172.21.15.112:0/4217422983 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e400a870 con 0x7f49ec157220 2023-10-06T04:39:16.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.100+0000 7f49da7fc700 1 -- 172.21.15.112:0/4217422983 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e400a9d0 con 0x7f49ec157220 2023-10-06T04:39:16.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.100+0000 7f49eb59e700 1 -- 172.21.15.112:0/4217422983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ec146140 con 0x7f49ec157220 2023-10-06T04:39:16.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.100+0000 7f49da7fc700 1 -- 172.21.15.112:0/4217422983 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e400ad50 con 0x7f49ec157220 2023-10-06T04:39:16.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.100+0000 7f49eb59e700 1 -- 172.21.15.112:0/4217422983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ec146700 con 0x7f49ec157220 2023-10-06T04:39:16.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.101+0000 7f49eb59e700 1 -- 172.21.15.112:0/4217422983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ec146be0 con 0x7f49ec157220 2023-10-06T04:39:16.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.101+0000 7f49da7fc700 1 -- 172.21.15.112:0/4217422983 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f49e4007300 con 0x7f49ec157220 2023-10-06T04:39:16.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.101+0000 7f49da7fc700 1 --2- 172.21.15.112:0/4217422983 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f49cc066ea0 0x7f49cc069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.102+0000 7f49da7fc700 1 -- 172.21.15.112:0/4217422983 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f49e4084550 con 0x7f49ec157220 2023-10-06T04:39:16.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.105+0000 7f49da7fc700 1 -- 172.21.15.112:0/4217422983 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49e4051a80 con 0x7f49ec157220 2023-10-06T04:39:16.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.110+0000 7f49ea59c700 1 --2- 172.21.15.112:0/4217422983 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f49cc066ea0 0x7f49cc069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.110+0000 7f49ea59c700 1 --2- 172.21.15.112:0/4217422983 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f49cc066ea0 0x7f49cc069350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009af0 tx=0x7f49dc009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:16.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.301+0000 7f49eb59e700 1 -- 172.21.15.112:0/4217422983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f49ec05f230 con 0x7f49ec157220 2023-10-06T04:39:16.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.301+0000 7f49da7fc700 1 -- 172.21.15.112:0/4217422983 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f49e40550a0 con 0x7f49ec157220 2023-10-06T04:39:16.303 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-10-06T04:39:16.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.303+0000 7f49eb59e700 1 -- 172.21.15.112:0/4217422983 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f49cc066ea0 msgr2=0x7f49cc069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.303+0000 7f49eb59e700 1 --2- 172.21.15.112:0/4217422983 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f49cc066ea0 0x7f49cc069350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009af0 tx=0x7f49dc009060 comp rx=0 tx=0).stop 2023-10-06T04:39:16.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.303+0000 7f49eb59e700 1 -- 172.21.15.112:0/4217422983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49ec157220 msgr2=0x7f49ec16d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.303+0000 7f49eb59e700 1 --2- 172.21.15.112:0/4217422983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49ec157220 0x7f49ec16d2c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f49e4001460 tx=0x7f49e4001a40 comp rx=0 tx=0).stop 2023-10-06T04:39:16.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.303+0000 7f49eb59e700 1 -- 172.21.15.112:0/4217422983 shutdown_connections 2023-10-06T04:39:16.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.303+0000 7f49eb59e700 1 --2- 172.21.15.112:0/4217422983 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f49cc066ea0 0x7f49cc069350 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.303+0000 7f49eb59e700 1 --2- 172.21.15.112:0/4217422983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49ec157220 0x7f49ec16d2c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.303+0000 7f49eb59e700 1 --2- 172.21.15.112:0/4217422983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49ec0c7bd0 0x7f49ec144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.303+0000 7f49eb59e700 1 --2- 172.21.15.112:0/4217422983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49ec0d0c40 0x7f49ec145610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.303+0000 7f49eb59e700 1 -- 172.21.15.112:0/4217422983 >> 172.21.15.112:0/4217422983 conn(0x7f49ec06c7d0 msgr2=0x7f49ec0c9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:16.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.303+0000 7f49eb59e700 1 -- 172.21.15.112:0/4217422983 shutdown_connections 2023-10-06T04:39:16.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.303+0000 7f49eb59e700 1 -- 172.21.15.112:0/4217422983 wait complete. 2023-10-06T04:39:16.317 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:39:16.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.434+0000 7f0eea825700 1 Processor -- start 2023-10-06T04:39:16.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.434+0000 7f0eea825700 1 -- start start 2023-10-06T04:39:16.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.435+0000 7f0eea825700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0ee4159a20 0x7f0ee40cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.435+0000 7f0eea825700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0ee415c720 0x7f0ee40cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.435+0000 7f0eea825700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee415af50 con 0x7f0ee406d3b0 2023-10-06T04:39:16.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.435+0000 7f0eea825700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee40cca70 con 0x7f0ee4159a20 2023-10-06T04:39:16.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.435+0000 7f0eea825700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee408a080 con 0x7f0ee415c720 2023-10-06T04:39:16.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.436+0000 7f0ee3fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0ee4159a20 0x7f0ee40cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.436+0000 7f0ee3fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0ee4159a20 0x7f0ee40cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57104/0 (socket says 172.21.15.112:57104) 2023-10-06T04:39:16.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.436+0000 7f0ee8dc2700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0ee415c720 0x7f0ee40cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.436+0000 7f0ee3fff700 1 -- 172.21.15.112:0/2206655808 learned_addr learned my addr 172.21.15.112:0/2206655808 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:16.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.436+0000 7f0ee37fe700 1 --1- 172.21.15.112:0/2206655808 >> v1:172.21.15.112:6789/0 conn(0x7f0ee406d3b0 0x7f0ee415d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34532/0 (socket says 172.21.15.112:34532) 2023-10-06T04:39:16.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.436+0000 7f0ee8dc2700 1 -- 172.21.15.112:0/2206655808 >> v2:172.21.15.112:3300/0 conn(0x7f0ee4159a20 msgr2=0x7f0ee40cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:16.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.436+0000 7f0ee8dc2700 1 --2- 172.21.15.112:0/2206655808 >> v2:172.21.15.112:3300/0 conn(0x7f0ee4159a20 0x7f0ee40cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.436+0000 7f0ee8dc2700 1 -- 172.21.15.112:0/2206655808 >> v1:172.21.15.112:6789/0 conn(0x7f0ee406d3b0 legacy=0x7f0ee415d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.436+0000 7f0ee8dc2700 1 -- 172.21.15.112:0/2206655808 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee40cae50 con 0x7f0ee415c720 2023-10-06T04:39:16.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.436+0000 7f0ee8dc2700 1 --2- 172.21.15.112:0/2206655808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ee415c720 0x7f0ee40cbd30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4088a30 tx=0x7f0edc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba24e76eb11b7f37 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:16.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.436+0000 7f0ee2ffd700 1 -- 172.21.15.112:0/2206655808 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc00e070 con 0x7f0ee415c720 2023-10-06T04:39:16.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.437+0000 7f0ee2ffd700 1 -- 172.21.15.112:0/2206655808 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc00bb60 con 0x7f0ee415c720 2023-10-06T04:39:16.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.437+0000 7f0ee2ffd700 1 -- 172.21.15.112:0/2206655808 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc012430 con 0x7f0ee415c720 2023-10-06T04:39:16.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.437+0000 7f0eea825700 1 -- 172.21.15.112:0/2206655808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ee415c720 msgr2=0x7f0ee40cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.437+0000 7f0eea825700 1 --2- 172.21.15.112:0/2206655808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ee415c720 0x7f0ee40cbd30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4088a30 tx=0x7f0edc009780 comp rx=0 tx=0).stop 2023-10-06T04:39:16.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.437+0000 7f0eea825700 1 -- 172.21.15.112:0/2206655808 shutdown_connections 2023-10-06T04:39:16.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.437+0000 7f0eea825700 1 --2- 172.21.15.112:0/2206655808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ee415c720 0x7f0ee40cbd30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.437+0000 7f0eea825700 1 --2- 172.21.15.112:0/2206655808 >> v2:172.21.15.112:3300/0 conn(0x7f0ee4159a20 0x7f0ee40cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.437+0000 7f0eea825700 1 -- 172.21.15.112:0/2206655808 >> 172.21.15.112:0/2206655808 conn(0x7f0ee406cfb0 msgr2=0x7f0ee40d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:16.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.437+0000 7f0eea825700 1 -- 172.21.15.112:0/2206655808 shutdown_connections 2023-10-06T04:39:16.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.437+0000 7f0eea825700 1 -- 172.21.15.112:0/2206655808 wait complete. 2023-10-06T04:39:16.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.439+0000 7f0eea825700 1 Processor -- start 2023-10-06T04:39:16.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.439+0000 7f0eea825700 1 -- start start 2023-10-06T04:39:16.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.440+0000 7f0eea825700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ee406d3b0 0x7f0ee40b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.440+0000 7f0eea825700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee4159a20 0x7f0ee41524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.440+0000 7f0eea825700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ee415c720 0x7f0ee40b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.440+0000 7f0eea825700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40b4400 con 0x7f0ee4159a20 2023-10-06T04:39:16.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.440+0000 7f0eea825700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40b4890 con 0x7f0ee415c720 2023-10-06T04:39:16.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.440+0000 7f0eea825700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee4152a00 con 0x7f0ee406d3b0 2023-10-06T04:39:16.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.440+0000 7f0ee37fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee4159a20 0x7f0ee41524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.440+0000 7f0ee37fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee4159a20 0x7f0ee41524c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57112/0 (socket says 172.21.15.112:57112) 2023-10-06T04:39:16.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.440+0000 7f0ee37fe700 1 -- 172.21.15.112:0/3049439090 learned_addr learned my addr 172.21.15.112:0/3049439090 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:16.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.440+0000 7f0ee8dc2700 1 --2- 172.21.15.112:0/3049439090 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ee415c720 0x7f0ee40b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.440+0000 7f0ee3fff700 1 --2- 172.21.15.112:0/3049439090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ee406d3b0 0x7f0ee40b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.440+0000 7f0ee37fe700 1 -- 172.21.15.112:0/3049439090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ee406d3b0 msgr2=0x7f0ee40b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.440+0000 7f0ee37fe700 1 --2- 172.21.15.112:0/3049439090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ee406d3b0 0x7f0ee40b5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.440+0000 7f0ee37fe700 1 -- 172.21.15.112:0/3049439090 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ee415c720 msgr2=0x7f0ee40b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.440+0000 7f0ee37fe700 1 --2- 172.21.15.112:0/3049439090 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ee415c720 0x7f0ee40b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.440+0000 7f0ee37fe700 1 -- 172.21.15.112:0/3049439090 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0edc009a20 con 0x7f0ee4159a20 2023-10-06T04:39:16.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.440+0000 7f0ee8dc2700 1 --2- 172.21.15.112:0/3049439090 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ee415c720 0x7f0ee40b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:16.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.441+0000 7f0ee37fe700 1 --2- 172.21.15.112:0/3049439090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee4159a20 0x7f0ee41524c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400c7c0 tx=0x7f0ed4007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:16.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.459+0000 7f0ecbfff700 1 -- 172.21.15.112:0/3049439090 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4005a70 con 0x7f0ee4159a20 2023-10-06T04:39:16.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.459+0000 7f0eea825700 1 -- 172.21.15.112:0/3049439090 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee40b3810 con 0x7f0ee4159a20 2023-10-06T04:39:16.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.459+0000 7f0eea825700 1 -- 172.21.15.112:0/3049439090 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee40b3db0 con 0x7f0ee4159a20 2023-10-06T04:39:16.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.459+0000 7f0ecbfff700 1 -- 172.21.15.112:0/3049439090 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed4005de0 con 0x7f0ee4159a20 2023-10-06T04:39:16.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.459+0000 7f0ecbfff700 1 -- 172.21.15.112:0/3049439090 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40070d0 con 0x7f0ee4159a20 2023-10-06T04:39:16.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.460+0000 7f0eea825700 1 -- 172.21.15.112:0/3049439090 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec40052b0 con 0x7f0ee4159a20 2023-10-06T04:39:16.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.460+0000 7f0ecbfff700 1 -- 172.21.15.112:0/3049439090 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f0ed4007500 con 0x7f0ee4159a20 2023-10-06T04:39:16.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.461+0000 7f0ecbfff700 1 --2- 172.21.15.112:0/3049439090 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0ed0066ea0 0x7f0ed0069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.461+0000 7f0ecbfff700 1 -- 172.21.15.112:0/3049439090 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0ed4083ef0 con 0x7f0ee4159a20 2023-10-06T04:39:16.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.461+0000 7f0ee3fff700 1 --2- 172.21.15.112:0/3049439090 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0ed0066ea0 0x7f0ed0069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.461+0000 7f0ee3fff700 1 --2- 172.21.15.112:0/3049439090 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0ed0066ea0 0x7f0ed0069350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8006fd0 tx=0x7f0ed8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:16.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.465+0000 7f0ecbfff700 1 -- 172.21.15.112:0/3049439090 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ed40514e0 con 0x7f0ee4159a20 2023-10-06T04:39:16.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.650+0000 7f0eea825700 1 -- 172.21.15.112:0/3049439090 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0ec4005ae0 con 0x7f0ee4159a20 2023-10-06T04:39:16.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.651+0000 7f0ecbfff700 1 -- 172.21.15.112:0/3049439090 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ed4021020 con 0x7f0ee4159a20 2023-10-06T04:39:16.653 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-10-06T04:39:16.655 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.653+0000 7f0eea825700 1 -- 172.21.15.112:0/3049439090 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0ed0066ea0 msgr2=0x7f0ed0069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.655 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.653+0000 7f0eea825700 1 --2- 172.21.15.112:0/3049439090 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0ed0066ea0 0x7f0ed0069350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8006fd0 tx=0x7f0ed8008040 comp rx=0 tx=0).stop 2023-10-06T04:39:16.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.653+0000 7f0eea825700 1 -- 172.21.15.112:0/3049439090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee4159a20 msgr2=0x7f0ee41524c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.653+0000 7f0eea825700 1 --2- 172.21.15.112:0/3049439090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee4159a20 0x7f0ee41524c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400c7c0 tx=0x7f0ed4007f40 comp rx=0 tx=0).stop 2023-10-06T04:39:16.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.653+0000 7f0eea825700 1 -- 172.21.15.112:0/3049439090 shutdown_connections 2023-10-06T04:39:16.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.653+0000 7f0eea825700 1 --2- 172.21.15.112:0/3049439090 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0ed0066ea0 0x7f0ed0069350 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.653+0000 7f0eea825700 1 --2- 172.21.15.112:0/3049439090 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ee415c720 0x7f0ee40b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.653+0000 7f0eea825700 1 --2- 172.21.15.112:0/3049439090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ee406d3b0 0x7f0ee40b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.653+0000 7f0eea825700 1 --2- 172.21.15.112:0/3049439090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee4159a20 0x7f0ee41524c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.653+0000 7f0eea825700 1 -- 172.21.15.112:0/3049439090 >> 172.21.15.112:0/3049439090 conn(0x7f0ee406cfb0 msgr2=0x7f0ee4153270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:16.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.653+0000 7f0eea825700 1 -- 172.21.15.112:0/3049439090 shutdown_connections 2023-10-06T04:39:16.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.653+0000 7f0eea825700 1 -- 172.21.15.112:0/3049439090 wait complete. 2023-10-06T04:39:16.667 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:39:16.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.780+0000 7fae08823700 1 Processor -- start 2023-10-06T04:39:16.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.780+0000 7fae08823700 1 -- start start 2023-10-06T04:39:16.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.781+0000 7fae08823700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fae04159ab0 0x7fae0406d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.781+0000 7fae08823700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fae0406ddb0 0x7fae0406e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.781+0000 7fae08823700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0406d3e0 con 0x7fae0406eba0 2023-10-06T04:39:16.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.781+0000 7fae08823700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae0406efe0 con 0x7fae04159ab0 2023-10-06T04:39:16.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.781+0000 7fae08823700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae0406c7d0 con 0x7fae0406ddb0 2023-10-06T04:39:16.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.781+0000 7fae0259c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fae04159ab0 0x7fae0406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.781+0000 7fae0259c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fae04159ab0 0x7fae0406d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57120/0 (socket says 172.21.15.112:57120) 2023-10-06T04:39:16.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.781+0000 7fae0259c700 1 -- 172.21.15.112:0/1937176590 learned_addr learned my addr 172.21.15.112:0/1937176590 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:16.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.781+0000 7fae0259c700 1 -- 172.21.15.112:0/1937176590 >> v2:172.21.15.179:3300/0 conn(0x7fae0406ddb0 msgr2=0x7fae0406e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:16.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.781+0000 7fae0259c700 1 --2- 172.21.15.112:0/1937176590 >> v2:172.21.15.179:3300/0 conn(0x7fae0406ddb0 0x7fae0406e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.781+0000 7fae0259c700 1 -- 172.21.15.112:0/1937176590 >> v1:172.21.15.179:6789/0 conn(0x7fae0406eba0 legacy=0x7fae0406a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:16.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.781+0000 7fae0259c700 1 -- 172.21.15.112:0/1937176590 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0406cab0 con 0x7fae04159ab0 2023-10-06T04:39:16.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.782+0000 7fae0259c700 1 --2- 172.21.15.112:0/1937176590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae04159ab0 0x7fae0406d870 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fae040af960 tx=0x7fadf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482e6c2e1ec81fef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:16.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.782+0000 7fae01d9b700 1 -- 172.21.15.112:0/1937176590 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf400b820 con 0x7fae04159ab0 2023-10-06T04:39:16.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.782+0000 7fae01d9b700 1 -- 172.21.15.112:0/1937176590 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf400b980 con 0x7fae04159ab0 2023-10-06T04:39:16.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.782+0000 7fae01d9b700 1 -- 172.21.15.112:0/1937176590 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf400bd20 con 0x7fae04159ab0 2023-10-06T04:39:16.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.782+0000 7fae08823700 1 -- 172.21.15.112:0/1937176590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae04159ab0 msgr2=0x7fae0406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.782+0000 7fae08823700 1 --2- 172.21.15.112:0/1937176590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae04159ab0 0x7fae0406d870 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fae040af960 tx=0x7fadf4009250 comp rx=0 tx=0).stop 2023-10-06T04:39:16.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.782+0000 7fae08823700 1 -- 172.21.15.112:0/1937176590 shutdown_connections 2023-10-06T04:39:16.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.782+0000 7fae08823700 1 --2- 172.21.15.112:0/1937176590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae04159ab0 0x7fae0406d870 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.782+0000 7fae08823700 1 --2- 172.21.15.112:0/1937176590 >> v2:172.21.15.179:3300/0 conn(0x7fae0406ddb0 0x7fae0406e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.782+0000 7fae08823700 1 -- 172.21.15.112:0/1937176590 >> 172.21.15.112:0/1937176590 conn(0x7fae04068750 msgr2=0x7fae040ae7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:16.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.782+0000 7fae08823700 1 -- 172.21.15.112:0/1937176590 shutdown_connections 2023-10-06T04:39:16.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.782+0000 7fae08823700 1 -- 172.21.15.112:0/1937176590 wait complete. 2023-10-06T04:39:16.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.784+0000 7fae08823700 1 Processor -- start 2023-10-06T04:39:16.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.784+0000 7fae08823700 1 -- start start 2023-10-06T04:39:16.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.784+0000 7fae08823700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0406ddb0 0x7fae04155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.784+0000 7fae08823700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae0406eba0 0x7fae0416cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.784+0000 7fae08823700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae04159ab0 0x7fae04149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.784+0000 7fae08823700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae040cc2d0 con 0x7fae0406ddb0 2023-10-06T04:39:16.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.784+0000 7fae08823700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0416c8b0 con 0x7fae04159ab0 2023-10-06T04:39:16.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.784+0000 7fae08823700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0416bce0 con 0x7fae0406eba0 2023-10-06T04:39:16.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.784+0000 7fae0259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0406ddb0 0x7fae04155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.784+0000 7fae0259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0406ddb0 0x7fae04155770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57122/0 (socket says 172.21.15.112:57122) 2023-10-06T04:39:16.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.784+0000 7fae0259c700 1 -- 172.21.15.112:0/3988202000 learned_addr learned my addr 172.21.15.112:0/3988202000 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:16.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.785+0000 7fae02d9d700 1 --2- 172.21.15.112:0/3988202000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae04159ab0 0x7fae04149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.785+0000 7fadf9d9b700 1 --2- 172.21.15.112:0/3988202000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae0406eba0 0x7fae0416cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.785+0000 7fae0259c700 1 -- 172.21.15.112:0/3988202000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae0406eba0 msgr2=0x7fae0416cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.785+0000 7fae0259c700 1 --2- 172.21.15.112:0/3988202000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae0406eba0 0x7fae0416cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.785+0000 7fae0259c700 1 -- 172.21.15.112:0/3988202000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae04159ab0 msgr2=0x7fae04149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:16.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.785+0000 7fae0259c700 1 --2- 172.21.15.112:0/3988202000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae04159ab0 0x7fae04149a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:16.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.785+0000 7fae0259c700 1 -- 172.21.15.112:0/3988202000 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf40094f0 con 0x7fae0406ddb0 2023-10-06T04:39:16.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.785+0000 7fadf9d9b700 1 --2- 172.21.15.112:0/3988202000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae0406eba0 0x7fae0416cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:16.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.785+0000 7fae0259c700 1 --2- 172.21.15.112:0/3988202000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0406ddb0 0x7fae04155770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fadf4009290 tx=0x7fadf4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:16.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.785+0000 7fadfaffd700 1 -- 172.21.15.112:0/3988202000 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf4026480 con 0x7fae0406ddb0 2023-10-06T04:39:16.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.785+0000 7fadfaffd700 1 -- 172.21.15.112:0/3988202000 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf401f070 con 0x7fae0406ddb0 2023-10-06T04:39:16.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.785+0000 7fadfaffd700 1 -- 172.21.15.112:0/3988202000 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf4026850 con 0x7fae0406ddb0 2023-10-06T04:39:16.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.785+0000 7fae08823700 1 -- 172.21.15.112:0/3988202000 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0416bf80 con 0x7fae0406ddb0 2023-10-06T04:39:16.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.785+0000 7fae08823700 1 -- 172.21.15.112:0/3988202000 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0416c540 con 0x7fae0406ddb0 2023-10-06T04:39:16.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.786+0000 7fae08823700 1 -- 172.21.15.112:0/3988202000 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae0405f230 con 0x7fae0406ddb0 2023-10-06T04:39:16.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.786+0000 7fadfaffd700 1 -- 172.21.15.112:0/3988202000 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fadf401a440 con 0x7fae0406ddb0 2023-10-06T04:39:16.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.787+0000 7fadfaffd700 1 --2- 172.21.15.112:0/3988202000 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fade4066ea0 0x7fade4069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:16.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.787+0000 7fadfaffd700 1 -- 172.21.15.112:0/3988202000 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fadf4021070 con 0x7fae0406ddb0 2023-10-06T04:39:16.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.787+0000 7fadf9d9b700 1 --2- 172.21.15.112:0/3988202000 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fade4066ea0 0x7fade4069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:16.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.787+0000 7fadf9d9b700 1 --2- 172.21.15.112:0/3988202000 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fade4066ea0 0x7fade4069350 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fae04156060 tx=0x7fadec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:16.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:16.791+0000 7fadfaffd700 1 -- 172.21.15.112:0/3988202000 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fadf40537f0 con 0x7fae0406ddb0 2023-10-06T04:39:17.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.013+0000 7fae08823700 1 -- 172.21.15.112:0/3988202000 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae04063f10 con 0x7fae0406ddb0 2023-10-06T04:39:17.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.014+0000 7fadfaffd700 1 -- 172.21.15.112:0/3988202000 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3533 (secure 0 0 0) 0x7fadf402bde0 con 0x7fae0406ddb0 2023-10-06T04:39:17.017 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:17.017 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1694304040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1694304040},{"type":"v1","addr":"172.21.15.112:6837","nonce":1694304040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3750383657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3750383657},{"type":"v1","addr":"172.21.15.112:6835","nonce":3750383657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2217480877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2217480877},{"type":"v1","addr":"172.21.15.179:6834","nonce":2217480877}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/140836226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":140836226},{"type":"v1","addr":"172.21.15.179:6835","nonce":140836226}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-06T04:39:17.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.016+0000 7fae08823700 1 -- 172.21.15.112:0/3988202000 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fade4066ea0 msgr2=0x7fade4069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.016+0000 7fae08823700 1 --2- 172.21.15.112:0/3988202000 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fade4066ea0 0x7fade4069350 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fae04156060 tx=0x7fadec008040 comp rx=0 tx=0).stop 2023-10-06T04:39:17.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.016+0000 7fae08823700 1 -- 172.21.15.112:0/3988202000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0406ddb0 msgr2=0x7fae04155770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.016+0000 7fae08823700 1 --2- 172.21.15.112:0/3988202000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0406ddb0 0x7fae04155770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fadf4009290 tx=0x7fadf4016000 comp rx=0 tx=0).stop 2023-10-06T04:39:17.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.016+0000 7fae08823700 1 -- 172.21.15.112:0/3988202000 shutdown_connections 2023-10-06T04:39:17.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.016+0000 7fae08823700 1 --2- 172.21.15.112:0/3988202000 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fade4066ea0 0x7fade4069350 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.016+0000 7fae08823700 1 --2- 172.21.15.112:0/3988202000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae04159ab0 0x7fae04149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.016+0000 7fae08823700 1 --2- 172.21.15.112:0/3988202000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0406ddb0 0x7fae04155770 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.016+0000 7fae08823700 1 --2- 172.21.15.112:0/3988202000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae0406eba0 0x7fae0416cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.016+0000 7fae08823700 1 -- 172.21.15.112:0/3988202000 >> 172.21.15.112:0/3988202000 conn(0x7fae04068750 msgr2=0x7fae04157730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:17.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.016+0000 7fae08823700 1 -- 172.21.15.112:0/3988202000 shutdown_connections 2023-10-06T04:39:17.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.016+0000 7fae08823700 1 -- 172.21.15.112:0/3988202000 wait complete. 2023-10-06T04:39:17.020 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 3 2023-10-06T04:39:17.031 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:17.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.142+0000 7ff37cc71700 1 Processor -- start 2023-10-06T04:39:17.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.142+0000 7ff37cc71700 1 -- start start 2023-10-06T04:39:17.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.143+0000 7ff37cc71700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff378159d50 0x7ff3780b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.143+0000 7ff37cc71700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff37815a120 0x7ff3780cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.143+0000 7ff37cc71700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3780cd740 con 0x7ff3780b0e70 2023-10-06T04:39:17.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.143+0000 7ff37cc71700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3780ccb30 con 0x7ff37815a120 2023-10-06T04:39:17.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.143+0000 7ff37cc71700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3780cce10 con 0x7ff378159d50 2023-10-06T04:39:17.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.143+0000 7ff36dd9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff37815a120 0x7ff3780cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:17.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.143+0000 7ff36dd9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff37815a120 0x7ff3780cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57128/0 (socket says 172.21.15.112:57128) 2023-10-06T04:39:17.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.143+0000 7ff36dd9b700 1 -- 172.21.15.112:0/777274212 learned_addr learned my addr 172.21.15.112:0/777274212 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:17.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.143+0000 7ff37659c700 1 --2- 172.21.15.112:0/777274212 >> v2:172.21.15.179:3300/0 conn(0x7ff378159d50 0x7ff3780b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:17.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.143+0000 7ff36dd9b700 1 -- 172.21.15.112:0/777274212 >> v2:172.21.15.179:3300/0 conn(0x7ff378159d50 msgr2=0x7ff3780b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:17.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.143+0000 7ff36dd9b700 1 --2- 172.21.15.112:0/777274212 >> v2:172.21.15.179:3300/0 conn(0x7ff378159d50 0x7ff3780b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.143+0000 7ff36dd9b700 1 -- 172.21.15.112:0/777274212 >> v1:172.21.15.179:6789/0 conn(0x7ff3780b0e70 legacy=0x7ff3780b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:17.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.143+0000 7ff36dd9b700 1 -- 172.21.15.112:0/777274212 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3780cd0f0 con 0x7ff37815a120 2023-10-06T04:39:17.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.144+0000 7ff36dd9b700 1 --2- 172.21.15.112:0/777274212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff37815a120 0x7ff3780cdbd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff378088770 tx=0x7ff360009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448b7ea332215106 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:17.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.144+0000 7ff375d9b700 1 -- 172.21.15.112:0/777274212 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36000b820 con 0x7ff37815a120 2023-10-06T04:39:17.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.144+0000 7ff375d9b700 1 -- 172.21.15.112:0/777274212 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36000b980 con 0x7ff37815a120 2023-10-06T04:39:17.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.144+0000 7ff375d9b700 1 -- 172.21.15.112:0/777274212 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36000bd20 con 0x7ff37815a120 2023-10-06T04:39:17.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.144+0000 7ff37cc71700 1 -- 172.21.15.112:0/777274212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff37815a120 msgr2=0x7ff3780cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.144+0000 7ff37cc71700 1 --2- 172.21.15.112:0/777274212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff37815a120 0x7ff3780cdbd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff378088770 tx=0x7ff360009250 comp rx=0 tx=0).stop 2023-10-06T04:39:17.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.144+0000 7ff37cc71700 1 -- 172.21.15.112:0/777274212 shutdown_connections 2023-10-06T04:39:17.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.144+0000 7ff37cc71700 1 --2- 172.21.15.112:0/777274212 >> v2:172.21.15.179:3300/0 conn(0x7ff378159d50 0x7ff3780b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.144+0000 7ff37cc71700 1 --2- 172.21.15.112:0/777274212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff37815a120 0x7ff3780cdbd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.144+0000 7ff37cc71700 1 -- 172.21.15.112:0/777274212 >> 172.21.15.112:0/777274212 conn(0x7ff378099b60 msgr2=0x7ff37806cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:17.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.144+0000 7ff37cc71700 1 -- 172.21.15.112:0/777274212 shutdown_connections 2023-10-06T04:39:17.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.144+0000 7ff37cc71700 1 -- 172.21.15.112:0/777274212 wait complete. 2023-10-06T04:39:17.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.146+0000 7ff37cc71700 1 Processor -- start 2023-10-06T04:39:17.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.146+0000 7ff37cc71700 1 -- start start 2023-10-06T04:39:17.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.146+0000 7ff37cc71700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3780b0e70 0x7ff3780af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.146+0000 7ff37cc71700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff378159d50 0x7ff37815e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.146+0000 7ff37cc71700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff37815a120 0x7ff37806e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.146+0000 7ff37cc71700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff378155f00 con 0x7ff37815a120 2023-10-06T04:39:17.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.146+0000 7ff37cc71700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3781552f0 con 0x7ff378159d50 2023-10-06T04:39:17.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.146+0000 7ff37cc71700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3781555d0 con 0x7ff3780b0e70 2023-10-06T04:39:17.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.146+0000 7ff376d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff37815a120 0x7ff37806e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:17.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.146+0000 7ff376d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff37815a120 0x7ff37806e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57142/0 (socket says 172.21.15.112:57142) 2023-10-06T04:39:17.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.146+0000 7ff376d9d700 1 -- 172.21.15.112:0/1270671796 learned_addr learned my addr 172.21.15.112:0/1270671796 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:17.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.147+0000 7ff37659c700 1 --2- 172.21.15.112:0/1270671796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3780b0e70 0x7ff3780af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:17.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.147+0000 7ff36dd9b700 1 --2- 172.21.15.112:0/1270671796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff378159d50 0x7ff37815e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:17.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.147+0000 7ff376d9d700 1 -- 172.21.15.112:0/1270671796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3780b0e70 msgr2=0x7ff3780af4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.147+0000 7ff376d9d700 1 --2- 172.21.15.112:0/1270671796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3780b0e70 0x7ff3780af4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.147+0000 7ff376d9d700 1 -- 172.21.15.112:0/1270671796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff378159d50 msgr2=0x7ff37815e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.147+0000 7ff376d9d700 1 --2- 172.21.15.112:0/1270671796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff378159d50 0x7ff37815e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.147+0000 7ff376d9d700 1 -- 172.21.15.112:0/1270671796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3600094f0 con 0x7ff37815a120 2023-10-06T04:39:17.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.147+0000 7ff36dd9b700 1 --2- 172.21.15.112:0/1270671796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff378159d50 0x7ff37815e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:17.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.147+0000 7ff376d9d700 1 --2- 172.21.15.112:0/1270671796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff37815a120 0x7ff37806e120 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff37000bc30 tx=0x7ff370009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:17.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.147+0000 7ff36effd700 1 -- 172.21.15.112:0/1270671796 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37000c9b0 con 0x7ff37815a120 2023-10-06T04:39:17.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.147+0000 7ff36effd700 1 -- 172.21.15.112:0/1270671796 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37000cb50 con 0x7ff37815a120 2023-10-06T04:39:17.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.147+0000 7ff37cc71700 1 -- 172.21.15.112:0/1270671796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3781558b0 con 0x7ff37815a120 2023-10-06T04:39:17.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.147+0000 7ff36effd700 1 -- 172.21.15.112:0/1270671796 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370014410 con 0x7ff37815a120 2023-10-06T04:39:17.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.147+0000 7ff37cc71700 1 -- 172.21.15.112:0/1270671796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3780af9f0 con 0x7ff37815a120 2023-10-06T04:39:17.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.148+0000 7ff37cc71700 1 -- 172.21.15.112:0/1270671796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff378156070 con 0x7ff37815a120 2023-10-06T04:39:17.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.148+0000 7ff36effd700 1 -- 172.21.15.112:0/1270671796 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7ff370014800 con 0x7ff37815a120 2023-10-06T04:39:17.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.149+0000 7ff36effd700 1 --2- 172.21.15.112:0/1270671796 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff358066ea0 0x7ff358069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.149+0000 7ff37659c700 1 --2- 172.21.15.112:0/1270671796 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff358066ea0 0x7ff358069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:17.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.149+0000 7ff36effd700 1 -- 172.21.15.112:0/1270671796 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff370084310 con 0x7ff37815a120 2023-10-06T04:39:17.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.149+0000 7ff37659c700 1 --2- 172.21.15.112:0/1270671796 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff358066ea0 0x7ff358069350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff368006fd0 tx=0x7ff368008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:17.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.153+0000 7ff36effd700 1 -- 172.21.15.112:0/1270671796 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff370051850 con 0x7ff37815a120 2023-10-06T04:39:17.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.180+0000 7ff36effd700 1 -- 172.21.15.112:0/1270671796 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff370051c20 con 0x7ff37815a120 2023-10-06T04:39:17.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.339+0000 7ff37cc71700 1 -- 172.21.15.112:0/1270671796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff37805f230 con 0x7ff37815a120 2023-10-06T04:39:17.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.339+0000 7ff36effd700 1 -- 172.21.15.112:0/1270671796 <== mon.0 v2:172.21.15.112:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13696 (secure 0 0 0) 0x7ff3700823d0 con 0x7ff37815a120 2023-10-06T04:39:17.342 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:17.342 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":16,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:39:16.580281+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:17.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.342+0000 7ff37cc71700 1 -- 172.21.15.112:0/1270671796 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff358066ea0 msgr2=0x7ff358069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.342+0000 7ff37cc71700 1 --2- 172.21.15.112:0/1270671796 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff358066ea0 0x7ff358069350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff368006fd0 tx=0x7ff368008040 comp rx=0 tx=0).stop 2023-10-06T04:39:17.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.342+0000 7ff37cc71700 1 -- 172.21.15.112:0/1270671796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff37815a120 msgr2=0x7ff37806e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.342+0000 7ff37cc71700 1 --2- 172.21.15.112:0/1270671796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff37815a120 0x7ff37806e120 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff37000bc30 tx=0x7ff370009820 comp rx=0 tx=0).stop 2023-10-06T04:39:17.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.342+0000 7ff37cc71700 1 -- 172.21.15.112:0/1270671796 shutdown_connections 2023-10-06T04:39:17.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.342+0000 7ff37cc71700 1 --2- 172.21.15.112:0/1270671796 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff358066ea0 0x7ff358069350 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.342+0000 7ff37cc71700 1 --2- 172.21.15.112:0/1270671796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff37815a120 0x7ff37806e120 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.342+0000 7ff37cc71700 1 --2- 172.21.15.112:0/1270671796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3780b0e70 0x7ff3780af4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.342+0000 7ff37cc71700 1 --2- 172.21.15.112:0/1270671796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff378159d50 0x7ff37815e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.342+0000 7ff37cc71700 1 -- 172.21.15.112:0/1270671796 >> 172.21.15.112:0/1270671796 conn(0x7ff378099b60 msgr2=0x7ff37815a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:17.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.342+0000 7ff37cc71700 1 -- 172.21.15.112:0/1270671796 shutdown_connections 2023-10-06T04:39:17.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.342+0000 7ff37cc71700 1 -- 172.21.15.112:0/1270671796 wait complete. 2023-10-06T04:39:17.356 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:13.929254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:39:14.321892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T04:39:17.357 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:39:17.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.472+0000 7f0323fff700 1 Processor -- start 2023-10-06T04:39:17.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.472+0000 7f0323fff700 1 -- start start 2023-10-06T04:39:17.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.473+0000 7f0323fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f03240afe70 0x7f03240caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.473+0000 7f0323fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0324156c30 0x7f03240cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.473+0000 7f0323fff700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03240cc1c0 con 0x7f03240ccb00 2023-10-06T04:39:17.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.473+0000 7f0323fff700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0324157f30 con 0x7f03240afe70 2023-10-06T04:39:17.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.473+0000 7f0323fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03240ccf40 con 0x7f0324156c30 2023-10-06T04:39:17.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.473+0000 7f0322ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f03240afe70 0x7f03240caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:17.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.473+0000 7f03237fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f03240ccb00 0x7f032406aa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34548/0 (socket says 172.21.15.112:34548) 2023-10-06T04:39:17.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.473+0000 7f03237fe700 1 -- 172.21.15.112:0/3147566730 learned_addr learned my addr 172.21.15.112:0/3147566730 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:17.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.473+0000 7f031a7fc700 1 --2- 172.21.15.112:0/3147566730 >> v2:172.21.15.179:3300/0 conn(0x7f0324156c30 0x7f03240cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:17.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.473+0000 7f0322ffd700 1 -- 172.21.15.112:0/3147566730 >> v2:172.21.15.179:3300/0 conn(0x7f0324156c30 msgr2=0x7f03240cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.473+0000 7f0322ffd700 1 --2- 172.21.15.112:0/3147566730 >> v2:172.21.15.179:3300/0 conn(0x7f0324156c30 0x7f03240cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.473+0000 7f0322ffd700 1 -- 172.21.15.112:0/3147566730 >> v1:172.21.15.112:6789/0 conn(0x7f03240ccb00 legacy=0x7f032406aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.473+0000 7f0322ffd700 1 -- 172.21.15.112:0/3147566730 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03241570a0 con 0x7f03240afe70 2023-10-06T04:39:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.473+0000 7f03227fc700 1 -- 172.21.15.112:0/3147566730 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978944175 0 0) 0x7f03240cc1c0 con 0x7f03240ccb00 2023-10-06T04:39:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.474+0000 7f031a7fc700 1 --2- 172.21.15.112:0/3147566730 >> v2:172.21.15.179:3300/0 conn(0x7f0324156c30 0x7f03240cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.474+0000 7f0322ffd700 1 --2- 172.21.15.112:0/3147566730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03240afe70 0x7f03240caeb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f032406a890 tx=0x7f03140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af9c4951bccb7a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.474+0000 7f03227fc700 1 -- 172.21.15.112:0/3147566730 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031400b6b0 con 0x7f03240afe70 2023-10-06T04:39:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.474+0000 7f03227fc700 1 -- 172.21.15.112:0/3147566730 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031400b810 con 0x7f03240afe70 2023-10-06T04:39:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.474+0000 7f03227fc700 1 -- 172.21.15.112:0/3147566730 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031400bbb0 con 0x7f03240afe70 2023-10-06T04:39:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.474+0000 7f0323fff700 1 -- 172.21.15.112:0/3147566730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03240afe70 msgr2=0x7f03240caeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.474+0000 7f0323fff700 1 --2- 172.21.15.112:0/3147566730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03240afe70 0x7f03240caeb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f032406a890 tx=0x7f03140091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.474+0000 7f0323fff700 1 -- 172.21.15.112:0/3147566730 shutdown_connections 2023-10-06T04:39:17.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.474+0000 7f0323fff700 1 --2- 172.21.15.112:0/3147566730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03240afe70 0x7f03240caeb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.474+0000 7f0323fff700 1 --2- 172.21.15.112:0/3147566730 >> v2:172.21.15.179:3300/0 conn(0x7f0324156c30 0x7f03240cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.474+0000 7f0323fff700 1 -- 172.21.15.112:0/3147566730 >> 172.21.15.112:0/3147566730 conn(0x7f032406d8e0 msgr2=0x7f032406dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:17.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.474+0000 7f0323fff700 1 -- 172.21.15.112:0/3147566730 shutdown_connections 2023-10-06T04:39:17.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.474+0000 7f0323fff700 1 -- 172.21.15.112:0/3147566730 wait complete. 2023-10-06T04:39:17.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.475+0000 7f0323fff700 1 Processor -- start 2023-10-06T04:39:17.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.476+0000 7f0323fff700 1 -- start start 2023-10-06T04:39:17.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.476+0000 7f0323fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03240afe70 0x7f032414ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.476+0000 7f0323fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03240ccb00 0x7f032414b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.476+0000 7f0323fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0324156c30 0x7f0324155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.476+0000 7f0323fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032414ea60 con 0x7f03240afe70 2023-10-06T04:39:17.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.476+0000 7f0323fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032414f230 con 0x7f03240ccb00 2023-10-06T04:39:17.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.476+0000 7f0323fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f032414c370 con 0x7f0324156c30 2023-10-06T04:39:17.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.476+0000 7f0322ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03240afe70 0x7f032414ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:17.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.476+0000 7f0322ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03240afe70 0x7f032414ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57164/0 (socket says 172.21.15.112:57164) 2023-10-06T04:39:17.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.476+0000 7f0322ffd700 1 -- 172.21.15.112:0/530472841 learned_addr learned my addr 172.21.15.112:0/530472841 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:17.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.477+0000 7f0322ffd700 1 -- 172.21.15.112:0/530472841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0324156c30 msgr2=0x7f0324155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.477+0000 7f0322ffd700 1 --2- 172.21.15.112:0/530472841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0324156c30 0x7f0324155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.477+0000 7f0322ffd700 1 -- 172.21.15.112:0/530472841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03240ccb00 msgr2=0x7f032414b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.477+0000 7f0322ffd700 1 --2- 172.21.15.112:0/530472841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03240ccb00 0x7f032414b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.477+0000 7f0322ffd700 1 -- 172.21.15.112:0/530472841 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0314009420 con 0x7f03240afe70 2023-10-06T04:39:17.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.477+0000 7f0322ffd700 1 --2- 172.21.15.112:0/530472841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03240afe70 0x7f032414ecf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f03240b0580 tx=0x7f0314017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:17.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.477+0000 7f031b7fe700 1 -- 172.21.15.112:0/530472841 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0314011420 con 0x7f03240afe70 2023-10-06T04:39:17.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.477+0000 7f031b7fe700 1 -- 172.21.15.112:0/530472841 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0314011580 con 0x7f03240afe70 2023-10-06T04:39:17.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.477+0000 7f0323fff700 1 -- 172.21.15.112:0/530472841 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f032416b150 con 0x7f03240afe70 2023-10-06T04:39:17.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.477+0000 7f031b7fe700 1 -- 172.21.15.112:0/530472841 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0314011920 con 0x7f03240afe70 2023-10-06T04:39:17.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.477+0000 7f0323fff700 1 -- 172.21.15.112:0/530472841 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f032416b710 con 0x7f03240afe70 2023-10-06T04:39:17.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.478+0000 7f0323fff700 1 -- 172.21.15.112:0/530472841 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f032405f230 con 0x7f03240afe70 2023-10-06T04:39:17.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.478+0000 7f031b7fe700 1 -- 172.21.15.112:0/530472841 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0314011d10 con 0x7f03240afe70 2023-10-06T04:39:17.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.478+0000 7f031b7fe700 1 --2- 172.21.15.112:0/530472841 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0304066f30 0x7f03040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.479+0000 7f031b7fe700 1 -- 172.21.15.112:0/530472841 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0314085fb0 con 0x7f03240afe70 2023-10-06T04:39:17.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.479+0000 7f031a7fc700 1 --2- 172.21.15.112:0/530472841 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0304066f30 0x7f03040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:17.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.479+0000 7f031a7fc700 1 --2- 172.21.15.112:0/530472841 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0304066f30 0x7f03040693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f030c006fd0 tx=0x7f030c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:17.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.483+0000 7f031b7fe700 1 -- 172.21.15.112:0/530472841 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03140b75a0 con 0x7f03240afe70 2023-10-06T04:39:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.666+0000 7f0323fff700 1 -- 172.21.15.112:0/530472841 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0324155860 con 0x7f03240afe70 2023-10-06T04:39:17.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.667+0000 7f031b7fe700 1 -- 172.21.15.112:0/530472841 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f03140150a0 con 0x7f03240afe70 2023-10-06T04:39:17.670 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-10-06T04:39:17.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.669+0000 7f0323fff700 1 -- 172.21.15.112:0/530472841 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0304066f30 msgr2=0x7f03040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.669+0000 7f0323fff700 1 --2- 172.21.15.112:0/530472841 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0304066f30 0x7f03040693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f030c006fd0 tx=0x7f030c008040 comp rx=0 tx=0).stop 2023-10-06T04:39:17.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.669+0000 7f0323fff700 1 -- 172.21.15.112:0/530472841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03240afe70 msgr2=0x7f032414ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.669+0000 7f0323fff700 1 --2- 172.21.15.112:0/530472841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03240afe70 0x7f032414ecf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f03240b0580 tx=0x7f0314017000 comp rx=0 tx=0).stop 2023-10-06T04:39:17.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.669+0000 7f0323fff700 1 -- 172.21.15.112:0/530472841 shutdown_connections 2023-10-06T04:39:17.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.669+0000 7f0323fff700 1 --2- 172.21.15.112:0/530472841 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0304066f30 0x7f03040693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.669+0000 7f0323fff700 1 --2- 172.21.15.112:0/530472841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0324156c30 0x7f0324155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.669+0000 7f0323fff700 1 --2- 172.21.15.112:0/530472841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03240afe70 0x7f032414ecf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.669+0000 7f0323fff700 1 --2- 172.21.15.112:0/530472841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03240ccb00 0x7f032414b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.669+0000 7f0323fff700 1 -- 172.21.15.112:0/530472841 >> 172.21.15.112:0/530472841 conn(0x7f032406d8e0 msgr2=0x7f032414f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:17.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.669+0000 7f0323fff700 1 -- 172.21.15.112:0/530472841 shutdown_connections 2023-10-06T04:39:17.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.669+0000 7f0323fff700 1 -- 172.21.15.112:0/530472841 wait complete. 2023-10-06T04:39:17.683 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:39:17.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.797+0000 7fca9a0af700 1 Processor -- start 2023-10-06T04:39:17.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.797+0000 7fca9a0af700 1 -- start start 2023-10-06T04:39:17.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.797+0000 7fca9a0af700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fca9406d3b0 0x7fca9415be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.797+0000 7fca9a0af700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca9415af50 con 0x7fca940cbf00 2023-10-06T04:39:17.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.797+0000 7fca9a0af700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca940cae50 con 0x7fca94159a20 2023-10-06T04:39:17.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.797+0000 7fca9a0af700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca940cca70 con 0x7fca9406d3b0 2023-10-06T04:39:17.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.798+0000 7fca92ffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fca940cbf00 0x7fca9415b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34562/0 (socket says 172.21.15.112:34562) 2023-10-06T04:39:17.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.798+0000 7fca92ffd700 1 -- 172.21.15.112:0/3990590766 learned_addr learned my addr 172.21.15.112:0/3990590766 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:17.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.798+0000 7fca93fff700 1 --2- 172.21.15.112:0/3990590766 >> v2:172.21.15.112:3300/0 conn(0x7fca9406d3b0 0x7fca9415be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:17.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.798+0000 7fca927fc700 1 -- 172.21.15.112:0/3990590766 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261136276 0 0) 0x7fca9415af50 con 0x7fca940cbf00 2023-10-06T04:39:17.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.798+0000 7fca927fc700 1 -- 172.21.15.112:0/3990590766 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca7c003570 con 0x7fca940cbf00 2023-10-06T04:39:17.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.798+0000 7fca93fff700 1 -- 172.21.15.112:0/3990590766 >> v1:172.21.15.179:6789/0 conn(0x7fca94159a20 legacy=0x7fca940cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.798+0000 7fca93fff700 1 -- 172.21.15.112:0/3990590766 >> v1:172.21.15.112:6789/0 conn(0x7fca940cbf00 legacy=0x7fca9415b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.798+0000 7fca93fff700 1 -- 172.21.15.112:0/3990590766 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca940cb0f0 con 0x7fca9406d3b0 2023-10-06T04:39:17.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.798+0000 7fca93fff700 1 --2- 172.21.15.112:0/3990590766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca9406d3b0 0x7fca9415be20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0098e0 tx=0x7fca8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba98a49a8c5d70c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:17.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.798+0000 7fca927fc700 1 -- 172.21.15.112:0/3990590766 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c00b640 con 0x7fca9406d3b0 2023-10-06T04:39:17.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.798+0000 7fca927fc700 1 -- 172.21.15.112:0/3990590766 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8c00b7a0 con 0x7fca9406d3b0 2023-10-06T04:39:17.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.798+0000 7fca927fc700 1 -- 172.21.15.112:0/3990590766 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c00bb40 con 0x7fca9406d3b0 2023-10-06T04:39:17.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.799+0000 7fca9a0af700 1 -- 172.21.15.112:0/3990590766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca9406d3b0 msgr2=0x7fca9415be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.799+0000 7fca9a0af700 1 --2- 172.21.15.112:0/3990590766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca9406d3b0 0x7fca9415be20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0098e0 tx=0x7fca8c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.799+0000 7fca9a0af700 1 -- 172.21.15.112:0/3990590766 shutdown_connections 2023-10-06T04:39:17.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.799+0000 7fca9a0af700 1 --2- 172.21.15.112:0/3990590766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca9406d3b0 0x7fca9415be20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.799+0000 7fca9a0af700 1 -- 172.21.15.112:0/3990590766 >> 172.21.15.112:0/3990590766 conn(0x7fca9406cfb0 msgr2=0x7fca940d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:17.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.799+0000 7fca9a0af700 1 -- 172.21.15.112:0/3990590766 shutdown_connections 2023-10-06T04:39:17.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.799+0000 7fca9a0af700 1 -- 172.21.15.112:0/3990590766 wait complete. 2023-10-06T04:39:17.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.800+0000 7fca9a0af700 1 Processor -- start 2023-10-06T04:39:17.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.800+0000 7fca9a0af700 1 -- start start 2023-10-06T04:39:17.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca9a0af700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca9406d3b0 0x7fca94147170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca9a0af700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca940cbf00 0x7fca94158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca9a0af700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca94159a20 0x7fca940ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca9a0af700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca940b4990 con 0x7fca940cbf00 2023-10-06T04:39:17.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca9a0af700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca940b3d80 con 0x7fca94159a20 2023-10-06T04:39:17.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca9a0af700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca940b4060 con 0x7fca9406d3b0 2023-10-06T04:39:17.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca92ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca940cbf00 0x7fca94158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:17.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca92ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca940cbf00 0x7fca94158c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57174/0 (socket says 172.21.15.112:57174) 2023-10-06T04:39:17.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca92ffd700 1 -- 172.21.15.112:0/2534666166 learned_addr learned my addr 172.21.15.112:0/2534666166 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:17.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca93fff700 1 --2- 172.21.15.112:0/2534666166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca94159a20 0x7fca940ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:17.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca937fe700 1 --2- 172.21.15.112:0/2534666166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca9406d3b0 0x7fca94147170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:17.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca92ffd700 1 -- 172.21.15.112:0/2534666166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca9406d3b0 msgr2=0x7fca94147170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca92ffd700 1 --2- 172.21.15.112:0/2534666166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca9406d3b0 0x7fca94147170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca92ffd700 1 -- 172.21.15.112:0/2534666166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca94159a20 msgr2=0x7fca940ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca92ffd700 1 --2- 172.21.15.112:0/2534666166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca94159a20 0x7fca940ae340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca92ffd700 1 -- 172.21.15.112:0/2534666166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c009420 con 0x7fca940cbf00 2023-10-06T04:39:17.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca93fff700 1 --2- 172.21.15.112:0/2534666166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca94159a20 0x7fca940ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:17.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca92ffd700 1 --2- 172.21.15.112:0/2534666166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca940cbf00 0x7fca94158c10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca8800c7c0 tx=0x7fca88007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca7b7fe700 1 -- 172.21.15.112:0/2534666166 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88005c00 con 0x7fca940cbf00 2023-10-06T04:39:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca7b7fe700 1 -- 172.21.15.112:0/2534666166 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca88005d60 con 0x7fca940cbf00 2023-10-06T04:39:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca9a0af700 1 -- 172.21.15.112:0/2534666166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca940b4340 con 0x7fca940cbf00 2023-10-06T04:39:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca7b7fe700 1 -- 172.21.15.112:0/2534666166 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88007320 con 0x7fca940cbf00 2023-10-06T04:39:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.801+0000 7fca9a0af700 1 -- 172.21.15.112:0/2534666166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca941476b0 con 0x7fca940cbf00 2023-10-06T04:39:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.802+0000 7fca9a0af700 1 -- 172.21.15.112:0/2534666166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9405f230 con 0x7fca940cbf00 2023-10-06T04:39:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.803+0000 7fca7b7fe700 1 -- 172.21.15.112:0/2534666166 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca88007690 con 0x7fca940cbf00 2023-10-06T04:39:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.803+0000 7fca7b7fe700 1 --2- 172.21.15.112:0/2534666166 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fca80066f30 0x7fca800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.803+0000 7fca7b7fe700 1 -- 172.21.15.112:0/2534666166 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fca88083e60 con 0x7fca940cbf00 2023-10-06T04:39:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.803+0000 7fca937fe700 1 --2- 172.21.15.112:0/2534666166 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fca80066f30 0x7fca800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.803+0000 7fca937fe700 1 --2- 172.21.15.112:0/2534666166 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fca80066f30 0x7fca800693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fca84007fd0 tx=0x7fca84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:17.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.807+0000 7fca7b7fe700 1 -- 172.21.15.112:0/2534666166 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca88051340 con 0x7fca940cbf00 2023-10-06T04:39:17.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.987+0000 7fca9a0af700 1 -- 172.21.15.112:0/2534666166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca9409e400 con 0x7fca940cbf00 2023-10-06T04:39:17.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.988+0000 7fca7b7fe700 1 -- 172.21.15.112:0/2534666166 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca88054960 con 0x7fca940cbf00 2023-10-06T04:39:17.990 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-10-06T04:39:17.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.990+0000 7fca9a0af700 1 -- 172.21.15.112:0/2534666166 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fca80066f30 msgr2=0x7fca800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.990+0000 7fca9a0af700 1 --2- 172.21.15.112:0/2534666166 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fca80066f30 0x7fca800693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fca84007fd0 tx=0x7fca84009040 comp rx=0 tx=0).stop 2023-10-06T04:39:17.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.990+0000 7fca9a0af700 1 -- 172.21.15.112:0/2534666166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca940cbf00 msgr2=0x7fca94158c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:17.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.990+0000 7fca9a0af700 1 --2- 172.21.15.112:0/2534666166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca940cbf00 0x7fca94158c10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca8800c7c0 tx=0x7fca88007dd0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.990+0000 7fca9a0af700 1 -- 172.21.15.112:0/2534666166 shutdown_connections 2023-10-06T04:39:17.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.990+0000 7fca9a0af700 1 --2- 172.21.15.112:0/2534666166 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fca80066f30 0x7fca800693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.990+0000 7fca9a0af700 1 --2- 172.21.15.112:0/2534666166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca94159a20 0x7fca940ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.990+0000 7fca9a0af700 1 --2- 172.21.15.112:0/2534666166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca9406d3b0 0x7fca94147170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.990+0000 7fca9a0af700 1 --2- 172.21.15.112:0/2534666166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca940cbf00 0x7fca94158c10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:17.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.990+0000 7fca9a0af700 1 -- 172.21.15.112:0/2534666166 >> 172.21.15.112:0/2534666166 conn(0x7fca9406cfb0 msgr2=0x7fca941551a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:17.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.990+0000 7fca9a0af700 1 -- 172.21.15.112:0/2534666166 shutdown_connections 2023-10-06T04:39:17.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:17.990+0000 7fca9a0af700 1 -- 172.21.15.112:0/2534666166 wait complete. 2023-10-06T04:39:18.004 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T04:39:18.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.115+0000 7efcf6381700 1 Processor -- start 2023-10-06T04:39:18.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.115+0000 7efcf6381700 1 -- start start 2023-10-06T04:39:18.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.116+0000 7efcf6381700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efcf00cdd40 0x7efcf0158660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.116+0000 7efcf6381700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf0069b30 con 0x7efcf015b460 2023-10-06T04:39:18.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.116+0000 7efcf6381700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf015c370 con 0x7efcf0067f50 2023-10-06T04:39:18.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.116+0000 7efcf6381700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf006a6d0 con 0x7efcf00cdd40 2023-10-06T04:39:18.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.116+0000 7efcef7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efcf00cdd40 0x7efcf0158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.116+0000 7efcf491e700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7efcf015b460 0x7efcf0069fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34572/0 (socket says 172.21.15.112:34572) 2023-10-06T04:39:18.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.116+0000 7efcf491e700 1 -- 172.21.15.112:0/433465061 learned_addr learned my addr 172.21.15.112:0/433465061 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:18.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.117+0000 7efcef7fe700 1 -- 172.21.15.112:0/433465061 >> v1:172.21.15.179:6789/0 conn(0x7efcf0067f50 legacy=0x7efcf0068320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.117+0000 7efcef7fe700 1 -- 172.21.15.112:0/433465061 >> v1:172.21.15.112:6789/0 conn(0x7efcf015b460 legacy=0x7efcf0069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.117+0000 7efcef7fe700 1 -- 172.21.15.112:0/433465061 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf015bdb0 con 0x7efcf00cdd40 2023-10-06T04:39:18.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.117+0000 7efceeffd700 1 -- 172.21.15.112:0/433465061 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172639550 0 0) 0x7efcf0069b30 con 0x7efcf015b460 2023-10-06T04:39:18.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.117+0000 7efcef7fe700 1 --2- 172.21.15.112:0/433465061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcf00cdd40 0x7efcf0158660 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efce40098e0 tx=0x7efce40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5609a99cd097bd3c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:18.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.117+0000 7efceeffd700 1 -- 172.21.15.112:0/433465061 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4009e80 con 0x7efcf00cdd40 2023-10-06T04:39:18.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.117+0000 7efceeffd700 1 -- 172.21.15.112:0/433465061 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce400b860 con 0x7efcf00cdd40 2023-10-06T04:39:18.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.117+0000 7efceeffd700 1 -- 172.21.15.112:0/433465061 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce400bbe0 con 0x7efcf00cdd40 2023-10-06T04:39:18.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.117+0000 7efcf6381700 1 -- 172.21.15.112:0/433465061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcf00cdd40 msgr2=0x7efcf0158660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.117+0000 7efcf6381700 1 --2- 172.21.15.112:0/433465061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcf00cdd40 0x7efcf0158660 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efce40098e0 tx=0x7efce40091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.117+0000 7efcf6381700 1 -- 172.21.15.112:0/433465061 shutdown_connections 2023-10-06T04:39:18.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.117+0000 7efcf6381700 1 --2- 172.21.15.112:0/433465061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcf00cdd40 0x7efcf0158660 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.117+0000 7efcf6381700 1 -- 172.21.15.112:0/433465061 >> 172.21.15.112:0/433465061 conn(0x7efcf00ce5c0 msgr2=0x7efcf00ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:18.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.117+0000 7efcf6381700 1 -- 172.21.15.112:0/433465061 shutdown_connections 2023-10-06T04:39:18.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.117+0000 7efcf6381700 1 -- 172.21.15.112:0/433465061 wait complete. 2023-10-06T04:39:18.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.118+0000 7efcf6381700 1 Processor -- start 2023-10-06T04:39:18.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.119+0000 7efcf6381700 1 -- start start 2023-10-06T04:39:18.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.119+0000 7efcf6381700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcf0067f50 0x7efcf014bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.119+0000 7efcf6381700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcf00cdd40 0x7efcf00b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.119+0000 7efcf6381700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcf015b460 0x7efcf00a6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.119+0000 7efcf6381700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf00b2960 con 0x7efcf015b460 2023-10-06T04:39:18.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.119+0000 7efcf6381700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf00b2c40 con 0x7efcf0067f50 2023-10-06T04:39:18.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.119+0000 7efcf6381700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf00b17a0 con 0x7efcf00cdd40 2023-10-06T04:39:18.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.119+0000 7efcf491e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcf015b460 0x7efcf00a6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.119+0000 7efcf491e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcf015b460 0x7efcf00a6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57206/0 (socket says 172.21.15.112:57206) 2023-10-06T04:39:18.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.119+0000 7efcf491e700 1 -- 172.21.15.112:0/3314775874 learned_addr learned my addr 172.21.15.112:0/3314775874 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:18.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.120+0000 7efceffff700 1 --2- 172.21.15.112:0/3314775874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcf0067f50 0x7efcf014bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.120+0000 7efcef7fe700 1 --2- 172.21.15.112:0/3314775874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcf00cdd40 0x7efcf00b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.120+0000 7efcf491e700 1 -- 172.21.15.112:0/3314775874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcf00cdd40 msgr2=0x7efcf00b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.120+0000 7efcf491e700 1 --2- 172.21.15.112:0/3314775874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcf00cdd40 0x7efcf00b0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.120+0000 7efcf491e700 1 -- 172.21.15.112:0/3314775874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcf0067f50 msgr2=0x7efcf014bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.120+0000 7efcf491e700 1 --2- 172.21.15.112:0/3314775874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcf0067f50 0x7efcf014bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.120+0000 7efcf491e700 1 -- 172.21.15.112:0/3314775874 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce4009420 con 0x7efcf015b460 2023-10-06T04:39:18.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.120+0000 7efceffff700 1 --2- 172.21.15.112:0/3314775874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcf0067f50 0x7efcf014bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:18.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.120+0000 7efcef7fe700 1 --2- 172.21.15.112:0/3314775874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcf00cdd40 0x7efcf00b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:18.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.120+0000 7efcf491e700 1 --2- 172.21.15.112:0/3314775874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcf015b460 0x7efcf00a6040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efce800ccc0 tx=0x7efce8001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:18.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.120+0000 7efcd7fff700 1 -- 172.21.15.112:0/3314775874 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce800ab30 con 0x7efcf015b460 2023-10-06T04:39:18.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.120+0000 7efcd7fff700 1 -- 172.21.15.112:0/3314775874 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce800ac90 con 0x7efcf015b460 2023-10-06T04:39:18.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.120+0000 7efcf6381700 1 -- 172.21.15.112:0/3314775874 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf00b1a80 con 0x7efcf015b460 2023-10-06T04:39:18.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.120+0000 7efcd7fff700 1 -- 172.21.15.112:0/3314775874 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce8007340 con 0x7efcf015b460 2023-10-06T04:39:18.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.120+0000 7efcf6381700 1 -- 172.21.15.112:0/3314775874 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf014c1f0 con 0x7efcf015b460 2023-10-06T04:39:18.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.121+0000 7efcf6381700 1 -- 172.21.15.112:0/3314775874 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf00b2dd0 con 0x7efcf015b460 2023-10-06T04:39:18.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.121+0000 7efcd7fff700 1 -- 172.21.15.112:0/3314775874 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efce80076f0 con 0x7efcf015b460 2023-10-06T04:39:18.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.122+0000 7efcd7fff700 1 --2- 172.21.15.112:0/3314775874 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7efcdc066f30 0x7efcdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.122+0000 7efcd7fff700 1 -- 172.21.15.112:0/3314775874 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7efce80847f0 con 0x7efcf015b460 2023-10-06T04:39:18.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.122+0000 7efceffff700 1 --2- 172.21.15.112:0/3314775874 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7efcdc066f30 0x7efcdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.122+0000 7efceffff700 1 --2- 172.21.15.112:0/3314775874 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7efcdc066f30 0x7efcdc0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efce00017a0 tx=0x7efce0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:18.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.126+0000 7efcd7fff700 1 -- 172.21.15.112:0/3314775874 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efce8051cd0 con 0x7efcf015b460 2023-10-06T04:39:18.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.310+0000 7efcf6381700 1 -- 172.21.15.112:0/3314775874 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efcf005f230 con 0x7efcf015b460 2023-10-06T04:39:18.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.311+0000 7efcd7fff700 1 -- 172.21.15.112:0/3314775874 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+126 (secure 0 0 0) 0x7efce80552f0 con 0x7efcf015b460 2023-10-06T04:39:18.314 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:18.315 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2023-10-06T04:39:18.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:39:18.315 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2023-10-06T04:39:18.315 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": "rbd" 2023-10-06T04:39:18.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:39:18.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:39:18.315 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 2, 2023-10-06T04:39:18.315 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2023-10-06T04:39:18.315 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:39:18.315 INFO:teuthology.orchestra.run.smithi112.stdout:] 2023-10-06T04:39:18.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.313+0000 7efcf6381700 1 -- 172.21.15.112:0/3314775874 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7efcdc066f30 msgr2=0x7efcdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.313+0000 7efcf6381700 1 --2- 172.21.15.112:0/3314775874 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7efcdc066f30 0x7efcdc0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efce00017a0 tx=0x7efce0009040 comp rx=0 tx=0).stop 2023-10-06T04:39:18.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.313+0000 7efcf6381700 1 -- 172.21.15.112:0/3314775874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcf015b460 msgr2=0x7efcf00a6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.313+0000 7efcf6381700 1 --2- 172.21.15.112:0/3314775874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcf015b460 0x7efcf00a6040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efce800ccc0 tx=0x7efce8001a80 comp rx=0 tx=0).stop 2023-10-06T04:39:18.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.313+0000 7efcf6381700 1 -- 172.21.15.112:0/3314775874 shutdown_connections 2023-10-06T04:39:18.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.313+0000 7efcf6381700 1 --2- 172.21.15.112:0/3314775874 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7efcdc066f30 0x7efcdc0693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.313+0000 7efcf6381700 1 --2- 172.21.15.112:0/3314775874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcf015b460 0x7efcf00a6040 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.313+0000 7efcf6381700 1 --2- 172.21.15.112:0/3314775874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcf0067f50 0x7efcf014bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.313+0000 7efcf6381700 1 --2- 172.21.15.112:0/3314775874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcf00cdd40 0x7efcf00b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.313+0000 7efcf6381700 1 -- 172.21.15.112:0/3314775874 >> 172.21.15.112:0/3314775874 conn(0x7efcf00ce5c0 msgr2=0x7efcf00ae980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:18.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.313+0000 7efcf6381700 1 -- 172.21.15.112:0/3314775874 shutdown_connections 2023-10-06T04:39:18.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.313+0000 7efcf6381700 1 -- 172.21.15.112:0/3314775874 wait complete. 2023-10-06T04:39:18.328 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T04:39:18.328 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T04:39:18.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.443+0000 7ff544142700 1 Processor -- start 2023-10-06T04:39:18.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.443+0000 7ff544142700 1 -- start start 2023-10-06T04:39:18.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.443+0000 7ff544142700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff53c159a20 0x7ff53c0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.444+0000 7ff544142700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff53c06d3b0 0x7ff53c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.444+0000 7ff544142700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53c15af50 con 0x7ff53c15a9f0 2023-10-06T04:39:18.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.444+0000 7ff544142700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff53c0cca70 con 0x7ff53c06d3b0 2023-10-06T04:39:18.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.444+0000 7ff544142700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff53c08a080 con 0x7ff53c159a20 2023-10-06T04:39:18.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.444+0000 7ff5416dd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff53c06d3b0 0x7ff53c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.444+0000 7ff5416dd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff53c06d3b0 0x7ff53c0cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50990/0 (socket says 172.21.15.112:50990) 2023-10-06T04:39:18.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.444+0000 7ff5416dd700 1 -- 172.21.15.112:0/246481540 learned_addr learned my addr 172.21.15.112:0/246481540 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:18.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.444+0000 7ff541ede700 1 --2- 172.21.15.112:0/246481540 >> v2:172.21.15.179:3300/0 conn(0x7ff53c159a20 0x7ff53c0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.444+0000 7ff5416dd700 1 -- 172.21.15.112:0/246481540 >> v2:172.21.15.179:3300/0 conn(0x7ff53c159a20 msgr2=0x7ff53c0cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:18.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.444+0000 7ff5416dd700 1 --2- 172.21.15.112:0/246481540 >> v2:172.21.15.179:3300/0 conn(0x7ff53c159a20 0x7ff53c0cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.444+0000 7ff5416dd700 1 -- 172.21.15.112:0/246481540 >> v1:172.21.15.179:6789/0 conn(0x7ff53c15a9f0 legacy=0x7ff53c15d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.444+0000 7ff5416dd700 1 -- 172.21.15.112:0/246481540 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c0cae50 con 0x7ff53c06d3b0 2023-10-06T04:39:18.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.444+0000 7ff5416dd700 1 --2- 172.21.15.112:0/246481540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff53c06d3b0 0x7ff53c0cbd30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff53c088260 tx=0x7ff52c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ab49ac9837362c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:18.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.444+0000 7ff540edc700 1 -- 172.21.15.112:0/246481540 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c00b820 con 0x7ff53c06d3b0 2023-10-06T04:39:18.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.444+0000 7ff540edc700 1 -- 172.21.15.112:0/246481540 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c00b980 con 0x7ff53c06d3b0 2023-10-06T04:39:18.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.444+0000 7ff540edc700 1 -- 172.21.15.112:0/246481540 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c00bd20 con 0x7ff53c06d3b0 2023-10-06T04:39:18.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.445+0000 7ff544142700 1 -- 172.21.15.112:0/246481540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff53c06d3b0 msgr2=0x7ff53c0cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.445+0000 7ff544142700 1 --2- 172.21.15.112:0/246481540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff53c06d3b0 0x7ff53c0cbd30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff53c088260 tx=0x7ff52c009250 comp rx=0 tx=0).stop 2023-10-06T04:39:18.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.445+0000 7ff544142700 1 -- 172.21.15.112:0/246481540 shutdown_connections 2023-10-06T04:39:18.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.445+0000 7ff544142700 1 --2- 172.21.15.112:0/246481540 >> v2:172.21.15.179:3300/0 conn(0x7ff53c159a20 0x7ff53c0cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.445+0000 7ff544142700 1 --2- 172.21.15.112:0/246481540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff53c06d3b0 0x7ff53c0cbd30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.445+0000 7ff544142700 1 -- 172.21.15.112:0/246481540 >> 172.21.15.112:0/246481540 conn(0x7ff53c06cfb0 msgr2=0x7ff53c0d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:18.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.445+0000 7ff544142700 1 -- 172.21.15.112:0/246481540 shutdown_connections 2023-10-06T04:39:18.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.445+0000 7ff544142700 1 -- 172.21.15.112:0/246481540 wait complete. 2023-10-06T04:39:18.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.446+0000 7ff544142700 1 Processor -- start 2023-10-06T04:39:18.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.446+0000 7ff544142700 1 -- start start 2023-10-06T04:39:18.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.447+0000 7ff544142700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff53c06d3b0 0x7ff53c0b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.447+0000 7ff544142700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff53c159a20 0x7ff53c0b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.447+0000 7ff544142700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff53c15a9f0 0x7ff53c0b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.447+0000 7ff544142700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0b4730 con 0x7ff53c15a9f0 2023-10-06T04:39:18.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.447+0000 7ff544142700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0b5f00 con 0x7ff53c06d3b0 2023-10-06T04:39:18.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.447+0000 7ff544142700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0b4920 con 0x7ff53c159a20 2023-10-06T04:39:18.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.447+0000 7ff5426df700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff53c15a9f0 0x7ff53c0b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.447+0000 7ff5426df700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff53c15a9f0 0x7ff53c0b59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50994/0 (socket says 172.21.15.112:50994) 2023-10-06T04:39:18.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.447+0000 7ff5426df700 1 -- 172.21.15.112:0/1339941286 learned_addr learned my addr 172.21.15.112:0/1339941286 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:18.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.447+0000 7ff541ede700 1 --2- 172.21.15.112:0/1339941286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff53c06d3b0 0x7ff53c0b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.447+0000 7ff5426df700 1 -- 172.21.15.112:0/1339941286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff53c159a20 msgr2=0x7ff53c0b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.447+0000 7ff5426df700 1 --2- 172.21.15.112:0/1339941286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff53c159a20 0x7ff53c0b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.447+0000 7ff5426df700 1 -- 172.21.15.112:0/1339941286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff53c06d3b0 msgr2=0x7ff53c0b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:18.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.447+0000 7ff5426df700 1 --2- 172.21.15.112:0/1339941286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff53c06d3b0 0x7ff53c0b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:18.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.447+0000 7ff5426df700 1 -- 172.21.15.112:0/1339941286 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c0094f0 con 0x7ff53c15a9f0 2023-10-06T04:39:18.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.447+0000 7ff5426df700 1 --2- 172.21.15.112:0/1339941286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff53c15a9f0 0x7ff53c0b59c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff53400c840 tx=0x7ff534001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:18.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.447+0000 7ff531ffb700 1 -- 172.21.15.112:0/1339941286 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff534012630 con 0x7ff53c15a9f0 2023-10-06T04:39:18.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.448+0000 7ff531ffb700 1 -- 172.21.15.112:0/1339941286 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5340127b0 con 0x7ff53c15a9f0 2023-10-06T04:39:18.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.448+0000 7ff544142700 1 -- 172.21.15.112:0/1339941286 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53c0b4c00 con 0x7ff53c15a9f0 2023-10-06T04:39:18.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.448+0000 7ff531ffb700 1 -- 172.21.15.112:0/1339941286 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff534012b70 con 0x7ff53c15a9f0 2023-10-06T04:39:18.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.448+0000 7ff544142700 1 -- 172.21.15.112:0/1339941286 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53c0b4f90 con 0x7ff53c15a9f0 2023-10-06T04:39:18.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.449+0000 7ff544142700 1 -- 172.21.15.112:0/1339941286 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53c05f230 con 0x7ff53c15a9f0 2023-10-06T04:39:18.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.449+0000 7ff531ffb700 1 -- 172.21.15.112:0/1339941286 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff534003030 con 0x7ff53c15a9f0 2023-10-06T04:39:18.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.449+0000 7ff531ffb700 1 --2- 172.21.15.112:0/1339941286 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff520066f30 0x7ff5200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:18.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.449+0000 7ff531ffb700 1 -- 172.21.15.112:0/1339941286 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff534084240 con 0x7ff53c15a9f0 2023-10-06T04:39:18.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.450+0000 7ff541ede700 1 --2- 172.21.15.112:0/1339941286 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff520066f30 0x7ff5200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:18.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.450+0000 7ff541ede700 1 --2- 172.21.15.112:0/1339941286 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff520066f30 0x7ff5200693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff538006fd0 tx=0x7ff538008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:18.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.454+0000 7ff531ffb700 1 -- 172.21.15.112:0/1339941286 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff534055130 con 0x7ff53c15a9f0 2023-10-06T04:39:18.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:18.639+0000 7ff544142700 1 -- 172.21.15.112:0/1339941286 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff53c0cb0f0 con 0x7ff53c15a9f0 2023-10-06T04:39:19.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.619+0000 7ff531ffb700 1 -- 172.21.15.112:0/1339941286 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff534054cc0 con 0x7ff53c15a9f0 2023-10-06T04:39:19.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.622+0000 7ff544142700 1 -- 172.21.15.112:0/1339941286 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff520066f30 msgr2=0x7ff5200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:19.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.622+0000 7ff544142700 1 --2- 172.21.15.112:0/1339941286 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff520066f30 0x7ff5200693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff538006fd0 tx=0x7ff538008040 comp rx=0 tx=0).stop 2023-10-06T04:39:19.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.622+0000 7ff544142700 1 -- 172.21.15.112:0/1339941286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff53c15a9f0 msgr2=0x7ff53c0b59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:19.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.622+0000 7ff544142700 1 --2- 172.21.15.112:0/1339941286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff53c15a9f0 0x7ff53c0b59c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff53400c840 tx=0x7ff534001670 comp rx=0 tx=0).stop 2023-10-06T04:39:19.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.622+0000 7ff544142700 1 -- 172.21.15.112:0/1339941286 shutdown_connections 2023-10-06T04:39:19.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.622+0000 7ff544142700 1 --2- 172.21.15.112:0/1339941286 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff520066f30 0x7ff5200693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:19.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.622+0000 7ff544142700 1 --2- 172.21.15.112:0/1339941286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff53c15a9f0 0x7ff53c0b59c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:19.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.622+0000 7ff544142700 1 --2- 172.21.15.112:0/1339941286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff53c06d3b0 0x7ff53c0b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:19.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.622+0000 7ff544142700 1 --2- 172.21.15.112:0/1339941286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff53c159a20 0x7ff53c0b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:19.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.622+0000 7ff544142700 1 -- 172.21.15.112:0/1339941286 >> 172.21.15.112:0/1339941286 conn(0x7ff53c06cfb0 msgr2=0x7ff53c155110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:19.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.622+0000 7ff544142700 1 -- 172.21.15.112:0/1339941286 shutdown_connections 2023-10-06T04:39:19.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.622+0000 7ff544142700 1 -- 172.21.15.112:0/1339941286 wait complete. 2023-10-06T04:39:19.626 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2023-10-06T04:39:19.639 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T04:39:19.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.758+0000 7fe8bf0ce700 1 Processor -- start 2023-10-06T04:39:19.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.758+0000 7fe8bf0ce700 1 -- start start 2023-10-06T04:39:19.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.759+0000 7fe8bf0ce700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b80c98c0 0x7fe8b806ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:19.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.759+0000 7fe8bf0ce700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b806b2b0 con 0x7fe8b8156700 2023-10-06T04:39:19.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.759+0000 7fe8bf0ce700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b806a8e0 con 0x7fe8b8156330 2023-10-06T04:39:19.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.759+0000 7fe8bf0ce700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80cd510 con 0x7fe8b80c98c0 2023-10-06T04:39:19.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.759+0000 7fe8bd66b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe8b8156700 0x7fe8b80cc7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54684/0 (socket says 172.21.15.112:54684) 2023-10-06T04:39:19.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.759+0000 7fe8bd66b700 1 -- 172.21.15.112:0/2000521842 learned_addr learned my addr 172.21.15.112:0/2000521842 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:19.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.759+0000 7fe8affff700 1 --2- 172.21.15.112:0/2000521842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b80c98c0 0x7fe8b806ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:19.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.759+0000 7fe8af7fe700 1 -- 172.21.15.112:0/2000521842 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277901094 0 0) 0x7fe8b0001110 con 0x7fe8b8156700 2023-10-06T04:39:19.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8af7fe700 1 -- 172.21.15.112:0/2000521842 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8a0003570 con 0x7fe8b8156700 2023-10-06T04:39:19.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8af7fe700 1 -- 172.21.15.112:0/2000521842 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728411259 0 0) 0x7fe8b806a8e0 con 0x7fe8b8156330 2023-10-06T04:39:19.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8af7fe700 1 -- 172.21.15.112:0/2000521842 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8b0001110 con 0x7fe8b8156330 2023-10-06T04:39:19.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8af7fe700 1 -- 172.21.15.112:0/2000521842 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 389839578 0 0) 0x7fe8a0003570 con 0x7fe8b8156700 2023-10-06T04:39:19.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8af7fe700 1 -- 172.21.15.112:0/2000521842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b80c98c0 msgr2=0x7fe8b806ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:19.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8af7fe700 1 --2- 172.21.15.112:0/2000521842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b80c98c0 0x7fe8b806ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:19.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8af7fe700 1 -- 172.21.15.112:0/2000521842 >> v1:172.21.15.179:6789/0 conn(0x7fe8b8156330 legacy=0x7fe8b80c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:19.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8af7fe700 1 -- 172.21.15.112:0/2000521842 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b8069fb0 con 0x7fe8b8156700 2023-10-06T04:39:19.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8af7fe700 1 -- 172.21.15.112:0/2000521842 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7fe8b0001600 con 0x7fe8b8156700 2023-10-06T04:39:19.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8af7fe700 1 -- 172.21.15.112:0/2000521842 >> v1:172.21.15.112:6789/0 conn(0x7fe8b8156700 legacy=0x7fe8b80cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:19.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8af7fe700 1 --2- 172.21.15.112:0/2000521842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8a0003c20 0x7fe8a0003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:19.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8af7fe700 1 --2- 172.21.15.112:0/2000521842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8a0004810 0x7fe8a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:19.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8af7fe700 1 --2- 172.21.15.112:0/2000521842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b80c98c0 0x7fe8a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:19.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8af7fe700 1 -- 172.21.15.112:0/2000521842 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80cd510 con 0x7fe8a0004810 2023-10-06T04:39:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8af7fe700 1 -- 172.21.15.112:0/2000521842 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a000bb70 con 0x7fe8a0003c20 2023-10-06T04:39:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8af7fe700 1 -- 172.21.15.112:0/2000521842 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a000bd30 con 0x7fe8b80c98c0 2023-10-06T04:39:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8affff700 1 --2- 172.21.15.112:0/2000521842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8a0004810 0x7fe8a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8bd66b700 1 --2- 172.21.15.112:0/2000521842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b80c98c0 0x7fe8a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8bce6a700 1 --2- 172.21.15.112:0/2000521842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8a0003c20 0x7fe8a0003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8affff700 1 -- 172.21.15.112:0/2000521842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b80c98c0 msgr2=0x7fe8a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8affff700 1 --2- 172.21.15.112:0/2000521842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b80c98c0 0x7fe8a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8affff700 1 -- 172.21.15.112:0/2000521842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8a0003c20 msgr2=0x7fe8a0003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8affff700 1 --2- 172.21.15.112:0/2000521842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8a0003c20 0x7fe8a0003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8affff700 1 -- 172.21.15.112:0/2000521842 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a0003570 con 0x7fe8a0004810 2023-10-06T04:39:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.760+0000 7fe8affff700 1 --2- 172.21.15.112:0/2000521842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8a0004810 0x7fe8a0004c80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80c9cc0 tx=0x7fe8a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36760790a3fddc6e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:19.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.761+0000 7fe8af7fe700 1 -- 172.21.15.112:0/2000521842 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a800e710 con 0x7fe8a0004810 2023-10-06T04:39:19.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.761+0000 7fe8af7fe700 1 -- 172.21.15.112:0/2000521842 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a800e870 con 0x7fe8a0004810 2023-10-06T04:39:19.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.761+0000 7fe8af7fe700 1 -- 172.21.15.112:0/2000521842 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a800ec30 con 0x7fe8a0004810 2023-10-06T04:39:19.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.761+0000 7fe8bf0ce700 1 -- 172.21.15.112:0/2000521842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8a0004810 msgr2=0x7fe8a0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:19.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.761+0000 7fe8bf0ce700 1 --2- 172.21.15.112:0/2000521842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8a0004810 0x7fe8a0004c80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80c9cc0 tx=0x7fe8a80091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:19.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.761+0000 7fe8bd66b700 1 -- 172.21.15.112:0/2000521842 reap_dead start 2023-10-06T04:39:19.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.761+0000 7fe8bf0ce700 1 -- 172.21.15.112:0/2000521842 shutdown_connections 2023-10-06T04:39:19.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.761+0000 7fe8bf0ce700 1 -- 172.21.15.112:0/2000521842 >> 172.21.15.112:0/2000521842 conn(0x7fe8b8067d90 msgr2=0x7fe8b8068190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:19.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.761+0000 7fe8bf0ce700 1 -- 172.21.15.112:0/2000521842 shutdown_connections 2023-10-06T04:39:19.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.761+0000 7fe8bf0ce700 1 -- 172.21.15.112:0/2000521842 wait complete. 2023-10-06T04:39:19.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.762+0000 7fe8bf0ce700 1 Processor -- start 2023-10-06T04:39:19.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.762+0000 7fe8bf0ce700 1 -- start start 2023-10-06T04:39:19.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.763+0000 7fe8bf0ce700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8a0004810 0x7fe8b80aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:19.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.763+0000 7fe8bf0ce700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8b80aa660 0x7fe8b813b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:19.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.763+0000 7fe8bf0ce700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b8141ff0 0x7fe8b8142490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:19.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.763+0000 7fe8bf0ce700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b813b770 con 0x7fe8a0004810 2023-10-06T04:39:19.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.763+0000 7fe8bf0ce700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b81539a0 con 0x7fe8b80aa660 2023-10-06T04:39:19.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.763+0000 7fe8bf0ce700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80ac300 con 0x7fe8b8141ff0 2023-10-06T04:39:19.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.763+0000 7fe8bce6a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8a0004810 0x7fe8b80aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:19.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.763+0000 7fe8bce6a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8a0004810 0x7fe8b80aaff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51002/0 (socket says 172.21.15.112:51002) 2023-10-06T04:39:19.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.763+0000 7fe8bce6a700 1 -- 172.21.15.112:0/867877266 learned_addr learned my addr 172.21.15.112:0/867877266 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:19.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.763+0000 7fe8affff700 1 --2- 172.21.15.112:0/867877266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8b80aa660 0x7fe8b813b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:19.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.763+0000 7fe8bd66b700 1 --2- 172.21.15.112:0/867877266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b8141ff0 0x7fe8b8142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:19.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.763+0000 7fe8bce6a700 1 -- 172.21.15.112:0/867877266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b8141ff0 msgr2=0x7fe8b8142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:19.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.763+0000 7fe8bce6a700 1 --2- 172.21.15.112:0/867877266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b8141ff0 0x7fe8b8142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:19.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.763+0000 7fe8bce6a700 1 -- 172.21.15.112:0/867877266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8b80aa660 msgr2=0x7fe8b813b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:19.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.763+0000 7fe8bce6a700 1 --2- 172.21.15.112:0/867877266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8b80aa660 0x7fe8b813b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:19.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.763+0000 7fe8bce6a700 1 -- 172.21.15.112:0/867877266 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b81429d0 con 0x7fe8a0004810 2023-10-06T04:39:19.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.764+0000 7fe8bce6a700 1 --2- 172.21.15.112:0/867877266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8a0004810 0x7fe8b80aaff0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400eb90 tx=0x7fe8b4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:19.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.764+0000 7fe8acff9700 1 -- 172.21.15.112:0/867877266 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40032e0 con 0x7fe8a0004810 2023-10-06T04:39:19.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.764+0000 7fe8acff9700 1 -- 172.21.15.112:0/867877266 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b4003460 con 0x7fe8a0004810 2023-10-06T04:39:19.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.764+0000 7fe8bf0ce700 1 -- 172.21.15.112:0/867877266 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b80ab6f0 con 0x7fe8a0004810 2023-10-06T04:39:19.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.764+0000 7fe8acff9700 1 -- 172.21.15.112:0/867877266 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4001930 con 0x7fe8a0004810 2023-10-06T04:39:19.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.764+0000 7fe8bf0ce700 1 -- 172.21.15.112:0/867877266 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b80abcb0 con 0x7fe8a0004810 2023-10-06T04:39:19.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.765+0000 7fe8bf0ce700 1 -- 172.21.15.112:0/867877266 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b805f230 con 0x7fe8a0004810 2023-10-06T04:39:19.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.765+0000 7fe8acff9700 1 -- 172.21.15.112:0/867877266 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe8b4001ca0 con 0x7fe8a0004810 2023-10-06T04:39:19.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.765+0000 7fe8acff9700 1 --2- 172.21.15.112:0/867877266 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe8a4066f30 0x7fe8a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:19.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.766+0000 7fe8acff9700 1 -- 172.21.15.112:0/867877266 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5576+0+0 (secure 0 0 0) 0x7fe8b40847f0 con 0x7fe8a0004810 2023-10-06T04:39:19.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.766+0000 7fe8affff700 1 --2- 172.21.15.112:0/867877266 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe8a4066f30 0x7fe8a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:19.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.766+0000 7fe8affff700 1 --2- 172.21.15.112:0/867877266 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe8a4066f30 0x7fe8a40693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe8b81450f0 tx=0x7fe8a801a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:19.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.770+0000 7fe8acff9700 1 -- 172.21.15.112:0/867877266 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8b4051ae0 con 0x7fe8a0004810 2023-10-06T04:39:19.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:19.954+0000 7fe8bf0ce700 1 -- 172.21.15.112:0/867877266 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe8b806a290 con 0x7fe8a0004810 2023-10-06T04:39:20.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.625+0000 7fe8acff9700 1 -- 172.21.15.112:0/867877266 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe8b4055100 con 0x7fe8a0004810 2023-10-06T04:39:20.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.632+0000 7fe8bf0ce700 1 -- 172.21.15.112:0/867877266 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe8a4066f30 msgr2=0x7fe8a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:20.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.632+0000 7fe8bf0ce700 1 --2- 172.21.15.112:0/867877266 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe8a4066f30 0x7fe8a40693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe8b81450f0 tx=0x7fe8a801a000 comp rx=0 tx=0).stop 2023-10-06T04:39:20.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.632+0000 7fe8bf0ce700 1 -- 172.21.15.112:0/867877266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8a0004810 msgr2=0x7fe8b80aaff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:20.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.632+0000 7fe8bf0ce700 1 --2- 172.21.15.112:0/867877266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8a0004810 0x7fe8b80aaff0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400eb90 tx=0x7fe8b4009040 comp rx=0 tx=0).stop 2023-10-06T04:39:20.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.632+0000 7fe8bf0ce700 1 -- 172.21.15.112:0/867877266 shutdown_connections 2023-10-06T04:39:20.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.632+0000 7fe8bf0ce700 1 --2- 172.21.15.112:0/867877266 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe8a4066f30 0x7fe8a40693e0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe8b81450f0 tx=0x7fe8a801a000 comp rx=0 tx=0).stop 2023-10-06T04:39:20.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.632+0000 7fe8bf0ce700 1 --2- 172.21.15.112:0/867877266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b8141ff0 0x7fe8b8142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:20.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.632+0000 7fe8bf0ce700 1 --2- 172.21.15.112:0/867877266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8a0004810 0x7fe8b80aaff0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400eb90 tx=0x7fe8b4009040 comp rx=0 tx=0).stop 2023-10-06T04:39:20.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.632+0000 7fe8bf0ce700 1 --2- 172.21.15.112:0/867877266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8b80aa660 0x7fe8b813b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:20.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.632+0000 7fe8bf0ce700 1 -- 172.21.15.112:0/867877266 >> 172.21.15.112:0/867877266 conn(0x7fe8b8067d90 msgr2=0x7fe8b81551d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:20.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.634+0000 7fe8bf0ce700 1 -- 172.21.15.112:0/867877266 shutdown_connections 2023-10-06T04:39:20.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.634+0000 7fe8bf0ce700 1 -- 172.21.15.112:0/867877266 wait complete. 2023-10-06T04:39:20.639 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2023-10-06T04:39:20.656 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T04:39:20.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.772+0000 7f6580ba4700 1 Processor -- start 2023-10-06T04:39:20.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.772+0000 7f6580ba4700 1 -- start start 2023-10-06T04:39:20.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.773+0000 7f6580ba4700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f657c15d620 0x7f657c068050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:20.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.773+0000 7f6580ba4700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f657c068590 0x7f657c06df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:20.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.773+0000 7f6580ba4700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f657c06daf0 con 0x7f657c159a50 2023-10-06T04:39:20.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.773+0000 7f6580ba4700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f657c0b3fc0 con 0x7f657c068590 2023-10-06T04:39:20.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.773+0000 7f6580ba4700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f657c0689b0 con 0x7f657c15d620 2023-10-06T04:39:20.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.773+0000 7f657ad9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f657c068590 0x7f657c06df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:20.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.773+0000 7f657ad9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f657c068590 0x7f657c06df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51012/0 (socket says 172.21.15.112:51012) 2023-10-06T04:39:20.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.773+0000 7f657ad9d700 1 -- 172.21.15.112:0/2782799725 learned_addr learned my addr 172.21.15.112:0/2782799725 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:20.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.773+0000 7f657ad9d700 1 -- 172.21.15.112:0/2782799725 >> v2:172.21.15.179:3300/0 conn(0x7f657c15d620 msgr2=0x7f657c068050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:20.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.773+0000 7f6571d9b700 1 --2- 172.21.15.112:0/2782799725 >> v2:172.21.15.179:3300/0 conn(0x7f657c15d620 0x7f657c068050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:20.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.773+0000 7f657ad9d700 1 --2- 172.21.15.112:0/2782799725 >> v2:172.21.15.179:3300/0 conn(0x7f657c15d620 0x7f657c068050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:20.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.773+0000 7f657ad9d700 1 -- 172.21.15.112:0/2782799725 >> v1:172.21.15.179:6789/0 conn(0x7f657c159a50 legacy=0x7f657c0b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:20.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.774+0000 7f657ad9d700 1 -- 172.21.15.112:0/2782799725 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657c15db20 con 0x7f657c068590 2023-10-06T04:39:20.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.774+0000 7f657ad9d700 1 --2- 172.21.15.112:0/2782799725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f657c068590 0x7f657c06df80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f657c04c460 tx=0x7f6574009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d47d8db5abdb3b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:20.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.774+0000 7f6579d9b700 1 -- 172.21.15.112:0/2782799725 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657400e070 con 0x7f657c068590 2023-10-06T04:39:20.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.774+0000 7f6579d9b700 1 -- 172.21.15.112:0/2782799725 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657400ba10 con 0x7f657c068590 2023-10-06T04:39:20.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.774+0000 7f6579d9b700 1 -- 172.21.15.112:0/2782799725 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65740092e0 con 0x7f657c068590 2023-10-06T04:39:20.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.774+0000 7f6580ba4700 1 -- 172.21.15.112:0/2782799725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f657c068590 msgr2=0x7f657c06df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:20.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.774+0000 7f6580ba4700 1 --2- 172.21.15.112:0/2782799725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f657c068590 0x7f657c06df80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f657c04c460 tx=0x7f6574009840 comp rx=0 tx=0).stop 2023-10-06T04:39:20.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.774+0000 7f6580ba4700 1 -- 172.21.15.112:0/2782799725 shutdown_connections 2023-10-06T04:39:20.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.774+0000 7f6580ba4700 1 --2- 172.21.15.112:0/2782799725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f657c068590 0x7f657c06df80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:20.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.774+0000 7f6580ba4700 1 --2- 172.21.15.112:0/2782799725 >> v2:172.21.15.179:3300/0 conn(0x7f657c15d620 0x7f657c068050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:20.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.774+0000 7f6580ba4700 1 -- 172.21.15.112:0/2782799725 >> 172.21.15.112:0/2782799725 conn(0x7f657c0631f0 msgr2=0x7f657c0635f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:20.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.774+0000 7f6580ba4700 1 -- 172.21.15.112:0/2782799725 shutdown_connections 2023-10-06T04:39:20.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.774+0000 7f6580ba4700 1 -- 172.21.15.112:0/2782799725 wait complete. 2023-10-06T04:39:20.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.776+0000 7f6580ba4700 1 Processor -- start 2023-10-06T04:39:20.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.776+0000 7f6580ba4700 1 -- start start 2023-10-06T04:39:20.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.776+0000 7f6580ba4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f657c068590 0x7f657c150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:20.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.776+0000 7f6580ba4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f657c159a50 0x7f657c157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:20.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.776+0000 7f6580ba4700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f657c15d620 0x7f657c14d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:20.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.776+0000 7f6580ba4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c158bb0 con 0x7f657c159a50 2023-10-06T04:39:20.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.776+0000 7f6580ba4700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c1583c0 con 0x7f657c068590 2023-10-06T04:39:20.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.776+0000 7f6580ba4700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657c14dfb0 con 0x7f657c15d620 2023-10-06T04:39:20.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.776+0000 7f6571d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f657c159a50 0x7f657c157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:20.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.776+0000 7f6571d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f657c159a50 0x7f657c157e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51014/0 (socket says 172.21.15.112:51014) 2023-10-06T04:39:20.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.776+0000 7f6571d9b700 1 -- 172.21.15.112:0/3271986854 learned_addr learned my addr 172.21.15.112:0/3271986854 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:20.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.777+0000 7f657ad9d700 1 --2- 172.21.15.112:0/3271986854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f657c15d620 0x7f657c14d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:20.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.777+0000 7f657a59c700 1 --2- 172.21.15.112:0/3271986854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f657c068590 0x7f657c150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:20.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.777+0000 7f6571d9b700 1 -- 172.21.15.112:0/3271986854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f657c15d620 msgr2=0x7f657c14d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:20.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.777+0000 7f6571d9b700 1 --2- 172.21.15.112:0/3271986854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f657c15d620 0x7f657c14d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:20.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.777+0000 7f6571d9b700 1 -- 172.21.15.112:0/3271986854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f657c068590 msgr2=0x7f657c150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:20.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.777+0000 7f6571d9b700 1 --2- 172.21.15.112:0/3271986854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f657c068590 0x7f657c150c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:20.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.777+0000 7f6571d9b700 1 -- 172.21.15.112:0/3271986854 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6574009ae0 con 0x7f657c159a50 2023-10-06T04:39:20.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.777+0000 7f6571d9b700 1 --2- 172.21.15.112:0/3271986854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f657c159a50 0x7f657c157e80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f656400c880 tx=0x7f6564008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:20.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.777+0000 7f6572ffd700 1 -- 172.21.15.112:0/3271986854 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6564011600 con 0x7f657c159a50 2023-10-06T04:39:20.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.777+0000 7f6572ffd700 1 -- 172.21.15.112:0/3271986854 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6564011780 con 0x7f657c159a50 2023-10-06T04:39:20.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.777+0000 7f6580ba4700 1 -- 172.21.15.112:0/3271986854 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657c1585f0 con 0x7f657c159a50 2023-10-06T04:39:20.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.777+0000 7f6572ffd700 1 -- 172.21.15.112:0/3271986854 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6564011b40 con 0x7f657c159a50 2023-10-06T04:39:20.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.777+0000 7f6580ba4700 1 -- 172.21.15.112:0/3271986854 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657c14e250 con 0x7f657c159a50 2023-10-06T04:39:20.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.778+0000 7f6580ba4700 1 -- 172.21.15.112:0/3271986854 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657c14de10 con 0x7f657c159a50 2023-10-06T04:39:20.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.778+0000 7f6572ffd700 1 -- 172.21.15.112:0/3271986854 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6564018360 con 0x7f657c159a50 2023-10-06T04:39:20.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.779+0000 7f6572ffd700 1 --2- 172.21.15.112:0/3271986854 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f655c066f30 0x7f655c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:20.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.779+0000 7f6572ffd700 1 -- 172.21.15.112:0/3271986854 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f6564084390 con 0x7f657c159a50 2023-10-06T04:39:20.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.779+0000 7f657a59c700 1 --2- 172.21.15.112:0/3271986854 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f655c066f30 0x7f655c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:20.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.779+0000 7f657a59c700 1 --2- 172.21.15.112:0/3271986854 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f655c066f30 0x7f655c0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f656c0027e0 tx=0x7f656c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:20.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:20.783+0000 7f6572ffd700 1 -- 172.21.15.112:0/3271986854 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f657c14de10 con 0x7f657c159a50 2023-10-06T04:39:21.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.013+0000 7f6580ba4700 1 -- 172.21.15.112:0/3271986854 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f657c14de10 con 0x7f657c159a50 2023-10-06T04:39:21.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.627+0000 7f6572ffd700 1 -- 172.21.15.112:0/3271986854 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f657c14de10 con 0x7f657c159a50 2023-10-06T04:39:21.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.633+0000 7f6580ba4700 1 -- 172.21.15.112:0/3271986854 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f655c066f30 msgr2=0x7f655c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:21.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.633+0000 7f6580ba4700 1 --2- 172.21.15.112:0/3271986854 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f655c066f30 0x7f655c0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f656c0027e0 tx=0x7f656c009040 comp rx=0 tx=0).stop 2023-10-06T04:39:21.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.633+0000 7f6580ba4700 1 -- 172.21.15.112:0/3271986854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f657c159a50 msgr2=0x7f657c157e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:21.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.633+0000 7f6580ba4700 1 --2- 172.21.15.112:0/3271986854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f657c159a50 0x7f657c157e80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f656400c880 tx=0x7f6564008040 comp rx=0 tx=0).stop 2023-10-06T04:39:21.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.634+0000 7f6580ba4700 1 -- 172.21.15.112:0/3271986854 shutdown_connections 2023-10-06T04:39:21.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.634+0000 7f6580ba4700 1 --2- 172.21.15.112:0/3271986854 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f655c066f30 0x7f655c0693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:21.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.634+0000 7f6580ba4700 1 --2- 172.21.15.112:0/3271986854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f657c15d620 0x7f657c14d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:21.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.634+0000 7f6580ba4700 1 --2- 172.21.15.112:0/3271986854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f657c068590 0x7f657c150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:21.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.634+0000 7f6580ba4700 1 --2- 172.21.15.112:0/3271986854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f657c159a50 0x7f657c157e80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:21.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.634+0000 7f6580ba4700 1 -- 172.21.15.112:0/3271986854 >> 172.21.15.112:0/3271986854 conn(0x7f657c0631f0 msgr2=0x7f657c0ad720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:21.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.635+0000 7f6580ba4700 1 -- 172.21.15.112:0/3271986854 shutdown_connections 2023-10-06T04:39:21.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.635+0000 7f6580ba4700 1 -- 172.21.15.112:0/3271986854 wait complete. 2023-10-06T04:39:21.649 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T04:39:21.660 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:21.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.772+0000 7fd59bfff700 1 Processor -- start 2023-10-06T04:39:21.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.772+0000 7fd59bfff700 1 -- start start 2023-10-06T04:39:21.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd59bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd59c0b11a0 0x7fd59c0d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:21.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd59bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd59c06d3b0 0x7fd59c0b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:21.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd59bfff700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59c0afed0 con 0x7fd59c0b3810 2023-10-06T04:39:21.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd59bfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59c0b1ab0 con 0x7fd59c06d3b0 2023-10-06T04:39:21.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd59bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c0b6170 con 0x7fd59c0b11a0 2023-10-06T04:39:21.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd59b7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd59c0b3810 0x7fd59c0b3cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54698/0 (socket says 172.21.15.112:54698) 2023-10-06T04:39:21.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd59b7fe700 1 -- 172.21.15.112:0/1098099446 learned_addr learned my addr 172.21.15.112:0/1098099446 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:21.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd599ffb700 1 -- 172.21.15.112:0/1098099446 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918370927 0 0) 0x7fd59c0afed0 con 0x7fd59c0b3810 2023-10-06T04:39:21.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd59a7fc700 1 --2- 172.21.15.112:0/1098099446 >> v2:172.21.15.179:3300/0 conn(0x7fd59c06d3b0 0x7fd59c0b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:21.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd599ffb700 1 -- 172.21.15.112:0/1098099446 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd588003570 con 0x7fd59c0b3810 2023-10-06T04:39:21.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd59affd700 1 --2- 172.21.15.112:0/1098099446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd59c0b11a0 0x7fd59c0d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:21.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd599ffb700 1 -- 172.21.15.112:0/1098099446 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1839397333 0 0) 0x7fd588003570 con 0x7fd59c0b3810 2023-10-06T04:39:21.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd599ffb700 1 -- 172.21.15.112:0/1098099446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd59c0b11a0 msgr2=0x7fd59c0d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:21.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd599ffb700 1 --2- 172.21.15.112:0/1098099446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd59c0b11a0 0x7fd59c0d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:21.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd599ffb700 1 -- 172.21.15.112:0/1098099446 >> v2:172.21.15.179:3300/0 conn(0x7fd59c06d3b0 msgr2=0x7fd59c0b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:21.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd599ffb700 1 --2- 172.21.15.112:0/1098099446 >> v2:172.21.15.179:3300/0 conn(0x7fd59c06d3b0 0x7fd59c0b1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:21.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd599ffb700 1 -- 172.21.15.112:0/1098099446 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c0b6450 con 0x7fd59c0b3810 2023-10-06T04:39:21.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd599ffb700 1 -- 172.21.15.112:0/1098099446 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7fd58c0017f0 con 0x7fd59c0b3810 2023-10-06T04:39:21.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd599ffb700 1 -- 172.21.15.112:0/1098099446 >> v1:172.21.15.112:6789/0 conn(0x7fd59c0b3810 legacy=0x7fd59c0b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:21.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd599ffb700 1 --2- 172.21.15.112:0/1098099446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd588003a60 0x7fd588003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:21.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd599ffb700 1 --2- 172.21.15.112:0/1098099446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd588004810 0x7fd588004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:21.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd599ffb700 1 --2- 172.21.15.112:0/1098099446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd59c0b11a0 0x7fd5880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:21.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd599ffb700 1 -- 172.21.15.112:0/1098099446 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c0b1ab0 con 0x7fd588003a60 2023-10-06T04:39:21.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd599ffb700 1 -- 172.21.15.112:0/1098099446 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c0b6170 con 0x7fd588004810 2023-10-06T04:39:21.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd599ffb700 1 -- 172.21.15.112:0/1098099446 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58800ba60 con 0x7fd59c0b11a0 2023-10-06T04:39:21.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.773+0000 7fd59affd700 1 --2- 172.21.15.112:0/1098099446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd588003a60 0x7fd588003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:21.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.774+0000 7fd59b7fe700 1 --2- 172.21.15.112:0/1098099446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd59c0b11a0 0x7fd5880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:21.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.774+0000 7fd59a7fc700 1 --2- 172.21.15.112:0/1098099446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd588004810 0x7fd588004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:21.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.774+0000 7fd59affd700 1 -- 172.21.15.112:0/1098099446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd59c0b11a0 msgr2=0x7fd5880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:21.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.774+0000 7fd59affd700 1 --2- 172.21.15.112:0/1098099446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd59c0b11a0 0x7fd5880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:21.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.774+0000 7fd59affd700 1 -- 172.21.15.112:0/1098099446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd588004810 msgr2=0x7fd588004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:21.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.774+0000 7fd59affd700 1 --2- 172.21.15.112:0/1098099446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd588004810 0x7fd588004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:21.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.774+0000 7fd59affd700 1 -- 172.21.15.112:0/1098099446 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd588003570 con 0x7fd588003a60 2023-10-06T04:39:21.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.774+0000 7fd59a7fc700 1 --2- 172.21.15.112:0/1098099446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd588004810 0x7fd588004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:21.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.774+0000 7fd59affd700 1 --2- 172.21.15.112:0/1098099446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd588003a60 0x7fd588003e70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd594009c30 tx=0x7fd5940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1358d74c8ddab71c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:21.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.774+0000 7fd599ffb700 1 -- 172.21.15.112:0/1098099446 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59400e710 con 0x7fd588003a60 2023-10-06T04:39:21.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.774+0000 7fd599ffb700 1 -- 172.21.15.112:0/1098099446 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59400e870 con 0x7fd588003a60 2023-10-06T04:39:21.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.774+0000 7fd599ffb700 1 -- 172.21.15.112:0/1098099446 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59400ec30 con 0x7fd588003a60 2023-10-06T04:39:21.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.774+0000 7fd59bfff700 1 -- 172.21.15.112:0/1098099446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd588003a60 msgr2=0x7fd588003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:21.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.774+0000 7fd59bfff700 1 --2- 172.21.15.112:0/1098099446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd588003a60 0x7fd588003e70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd594009c30 tx=0x7fd5940091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:21.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.774+0000 7fd59b7fe700 1 -- 172.21.15.112:0/1098099446 reap_dead start 2023-10-06T04:39:21.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.774+0000 7fd59bfff700 1 -- 172.21.15.112:0/1098099446 shutdown_connections 2023-10-06T04:39:21.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.774+0000 7fd59bfff700 1 -- 172.21.15.112:0/1098099446 >> 172.21.15.112:0/1098099446 conn(0x7fd59c06cfb0 msgr2=0x7fd59c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:21.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.775+0000 7fd59bfff700 1 -- 172.21.15.112:0/1098099446 shutdown_connections 2023-10-06T04:39:21.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.775+0000 7fd59bfff700 1 -- 172.21.15.112:0/1098099446 wait complete. 2023-10-06T04:39:21.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.776+0000 7fd59bfff700 1 Processor -- start 2023-10-06T04:39:21.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.776+0000 7fd59bfff700 1 -- start start 2023-10-06T04:39:21.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.776+0000 7fd59bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd588003a60 0x7fd59c0ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:21.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.776+0000 7fd59bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd59c0ca740 0x7fd59c09d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:21.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.777+0000 7fd59bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd59c15d050 0x7fd59c09d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:21.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.777+0000 7fd59bfff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c09cd80 con 0x7fd588003a60 2023-10-06T04:39:21.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.777+0000 7fd59bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c0c7070 con 0x7fd59c15d050 2023-10-06T04:39:21.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.777+0000 7fd59bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c09dc90 con 0x7fd59c0ca740 2023-10-06T04:39:21.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.777+0000 7fd59affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd588003a60 0x7fd59c0ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:21.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.777+0000 7fd59affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd588003a60 0x7fd59c0ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51028/0 (socket says 172.21.15.112:51028) 2023-10-06T04:39:21.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.777+0000 7fd59affd700 1 -- 172.21.15.112:0/4126564036 learned_addr learned my addr 172.21.15.112:0/4126564036 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:21.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.777+0000 7fd59a7fc700 1 --2- 172.21.15.112:0/4126564036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd59c0ca740 0x7fd59c09d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:21.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.777+0000 7fd59b7fe700 1 --2- 172.21.15.112:0/4126564036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd59c15d050 0x7fd59c09d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:21.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.777+0000 7fd59affd700 1 -- 172.21.15.112:0/4126564036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd59c0ca740 msgr2=0x7fd59c09d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:21.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.777+0000 7fd59affd700 1 --2- 172.21.15.112:0/4126564036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd59c0ca740 0x7fd59c09d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:21.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.777+0000 7fd59affd700 1 -- 172.21.15.112:0/4126564036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd59c15d050 msgr2=0x7fd59c09d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:21.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.777+0000 7fd59affd700 1 --2- 172.21.15.112:0/4126564036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd59c15d050 0x7fd59c09d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:21.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.777+0000 7fd59affd700 1 -- 172.21.15.112:0/4126564036 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c09c450 con 0x7fd588003a60 2023-10-06T04:39:21.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.777+0000 7fd59b7fe700 1 --2- 172.21.15.112:0/4126564036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd59c15d050 0x7fd59c09d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:21.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.777+0000 7fd59affd700 1 --2- 172.21.15.112:0/4126564036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd588003a60 0x7fd59c0ca200 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd59400e4b0 tx=0x7fd59401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:21.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.777+0000 7fd592ffd700 1 -- 172.21.15.112:0/4126564036 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd594023070 con 0x7fd588003a60 2023-10-06T04:39:21.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.777+0000 7fd592ffd700 1 -- 172.21.15.112:0/4126564036 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59400ec10 con 0x7fd588003a60 2023-10-06T04:39:21.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.777+0000 7fd59bfff700 1 -- 172.21.15.112:0/4126564036 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd59c09c730 con 0x7fd588003a60 2023-10-06T04:39:21.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.777+0000 7fd592ffd700 1 -- 172.21.15.112:0/4126564036 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59400e710 con 0x7fd588003a60 2023-10-06T04:39:21.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.777+0000 7fd59bfff700 1 -- 172.21.15.112:0/4126564036 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59c0c6310 con 0x7fd588003a60 2023-10-06T04:39:21.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.778+0000 7fd59bfff700 1 -- 172.21.15.112:0/4126564036 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59c05f230 con 0x7fd588003a60 2023-10-06T04:39:21.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.778+0000 7fd592ffd700 1 -- 172.21.15.112:0/4126564036 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd594013680 con 0x7fd588003a60 2023-10-06T04:39:21.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.779+0000 7fd592ffd700 1 --2- 172.21.15.112:0/4126564036 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd57c066f30 0x7fd57c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:21.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.779+0000 7fd592ffd700 1 -- 172.21.15.112:0/4126564036 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd594085e00 con 0x7fd588003a60 2023-10-06T04:39:21.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.779+0000 7fd59a7fc700 1 --2- 172.21.15.112:0/4126564036 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd57c066f30 0x7fd57c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:21.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.779+0000 7fd59a7fc700 1 --2- 172.21.15.112:0/4126564036 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd57c066f30 0x7fd57c0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0af390 tx=0x7fd584008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:21.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.783+0000 7fd592ffd700 1 -- 172.21.15.112:0/4126564036 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd594052f10 con 0x7fd588003a60 2023-10-06T04:39:21.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.967+0000 7fd59bfff700 1 -- 172.21.15.112:0/4126564036 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd59c08a050 con 0x7fd588003a60 2023-10-06T04:39:21.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.968+0000 7fd592ffd700 1 -- 172.21.15.112:0/4126564036 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16927 (secure 0 0 0) 0x7fd594056530 con 0x7fd588003a60 2023-10-06T04:39:21.970 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:21.971 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":19,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:39:21.014878+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:18.657040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:19.972295+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:21.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.970+0000 7fd59bfff700 1 -- 172.21.15.112:0/4126564036 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd57c066f30 msgr2=0x7fd57c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:21.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.970+0000 7fd59bfff700 1 --2- 172.21.15.112:0/4126564036 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd57c066f30 0x7fd57c0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0af390 tx=0x7fd584008040 comp rx=0 tx=0).stop 2023-10-06T04:39:21.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.970+0000 7fd59bfff700 1 -- 172.21.15.112:0/4126564036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd588003a60 msgr2=0x7fd59c0ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:21.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.970+0000 7fd59bfff700 1 --2- 172.21.15.112:0/4126564036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd588003a60 0x7fd59c0ca200 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd59400e4b0 tx=0x7fd59401a000 comp rx=0 tx=0).stop 2023-10-06T04:39:21.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.970+0000 7fd59bfff700 1 -- 172.21.15.112:0/4126564036 shutdown_connections 2023-10-06T04:39:21.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.970+0000 7fd59bfff700 1 --2- 172.21.15.112:0/4126564036 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd57c066f30 0x7fd57c0693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:21.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.970+0000 7fd59bfff700 1 --2- 172.21.15.112:0/4126564036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd59c15d050 0x7fd59c09d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:21.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.970+0000 7fd59bfff700 1 --2- 172.21.15.112:0/4126564036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd588003a60 0x7fd59c0ca200 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:21.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.970+0000 7fd59bfff700 1 --2- 172.21.15.112:0/4126564036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd59c0ca740 0x7fd59c09d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:21.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.970+0000 7fd59bfff700 1 -- 172.21.15.112:0/4126564036 >> 172.21.15.112:0/4126564036 conn(0x7fd59c06cfb0 msgr2=0x7fd59c15eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:21.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.970+0000 7fd59bfff700 1 -- 172.21.15.112:0/4126564036 shutdown_connections 2023-10-06T04:39:21.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:21.970+0000 7fd59bfff700 1 -- 172.21.15.112:0/4126564036 wait complete. 2023-10-06T04:39:21.984 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:22.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.095+0000 7f921a52d700 1 Processor -- start 2023-10-06T04:39:22.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.095+0000 7f921a52d700 1 -- start start 2023-10-06T04:39:22.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.096+0000 7f921a52d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9214159780 0x7f92140b2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:22.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.096+0000 7f921a52d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f921406dff0 0x7f92140b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:22.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.096+0000 7f921a52d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92140ca240 con 0x7f92140ca6d0 2023-10-06T04:39:22.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.096+0000 7f921a52d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92140c9f10 con 0x7f9214159780 2023-10-06T04:39:22.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.096+0000 7f921a52d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92140b2f40 con 0x7f921406dff0 2023-10-06T04:39:22.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.096+0000 7f9213fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9214159780 0x7f92140b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:22.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.096+0000 7f9213fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9214159780 0x7f92140b2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51042/0 (socket says 172.21.15.112:51042) 2023-10-06T04:39:22.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.096+0000 7f9213fff700 1 -- 172.21.15.112:0/1985966351 learned_addr learned my addr 172.21.15.112:0/1985966351 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:22.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.097+0000 7f92137fe700 1 --2- 172.21.15.112:0/1985966351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f921406dff0 0x7f92140b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:22.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.097+0000 7f9213fff700 1 -- 172.21.15.112:0/1985966351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f921406dff0 msgr2=0x7f92140b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:22.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.097+0000 7f9213fff700 1 --2- 172.21.15.112:0/1985966351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f921406dff0 0x7f92140b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:22.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.097+0000 7f9213fff700 1 -- 172.21.15.112:0/1985966351 >> v1:172.21.15.179:6789/0 conn(0x7f92140ca6d0 legacy=0x7f921406c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:22.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.097+0000 7f9213fff700 1 -- 172.21.15.112:0/1985966351 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92140b3220 con 0x7f9214159780 2023-10-06T04:39:22.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.097+0000 7f9213fff700 1 --2- 172.21.15.112:0/1985966351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9214159780 0x7f92140b2940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f92040099b0 tx=0x7f9204009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c692820a5eeebbf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:22.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.097+0000 7f9212ffd700 1 -- 172.21.15.112:0/1985966351 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920400b860 con 0x7f9214159780 2023-10-06T04:39:22.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.097+0000 7f9212ffd700 1 -- 172.21.15.112:0/1985966351 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920400b9c0 con 0x7f9214159780 2023-10-06T04:39:22.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.097+0000 7f9212ffd700 1 -- 172.21.15.112:0/1985966351 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920400bd60 con 0x7f9214159780 2023-10-06T04:39:22.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.097+0000 7f921a52d700 1 -- 172.21.15.112:0/1985966351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9214159780 msgr2=0x7f92140b2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:22.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.097+0000 7f921a52d700 1 --2- 172.21.15.112:0/1985966351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9214159780 0x7f92140b2940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f92040099b0 tx=0x7f9204009250 comp rx=0 tx=0).stop 2023-10-06T04:39:22.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.097+0000 7f921a52d700 1 -- 172.21.15.112:0/1985966351 shutdown_connections 2023-10-06T04:39:22.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.097+0000 7f921a52d700 1 --2- 172.21.15.112:0/1985966351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9214159780 0x7f92140b2940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:22.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.097+0000 7f921a52d700 1 --2- 172.21.15.112:0/1985966351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f921406dff0 0x7f92140b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:22.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.097+0000 7f921a52d700 1 -- 172.21.15.112:0/1985966351 >> 172.21.15.112:0/1985966351 conn(0x7f9214068650 msgr2=0x7f921406d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:22.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.097+0000 7f921a52d700 1 -- 172.21.15.112:0/1985966351 shutdown_connections 2023-10-06T04:39:22.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.097+0000 7f921a52d700 1 -- 172.21.15.112:0/1985966351 wait complete. 2023-10-06T04:39:22.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.099+0000 7f921a52d700 1 Processor -- start 2023-10-06T04:39:22.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.099+0000 7f921a52d700 1 -- start start 2023-10-06T04:39:22.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.099+0000 7f921a52d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f921406dff0 0x7f921415e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:22.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.099+0000 7f921a52d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92140ca6d0 0x7f9214158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:22.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.099+0000 7f921a52d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9214159780 0x7f921416ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:22.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.099+0000 7f921a52d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9214158a70 con 0x7f9214159780 2023-10-06T04:39:22.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.099+0000 7f921a52d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921416b1b0 con 0x7f92140ca6d0 2023-10-06T04:39:22.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.099+0000 7f921a52d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921415d850 con 0x7f921406dff0 2023-10-06T04:39:22.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.100+0000 7f9218aca700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9214159780 0x7f921416ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:22.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.100+0000 7f9218aca700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9214159780 0x7f921416ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51052/0 (socket says 172.21.15.112:51052) 2023-10-06T04:39:22.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.100+0000 7f9218aca700 1 -- 172.21.15.112:0/2634129628 learned_addr learned my addr 172.21.15.112:0/2634129628 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:22.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.100+0000 7f9218aca700 1 -- 172.21.15.112:0/2634129628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f921406dff0 msgr2=0x7f921415e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:22.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.100+0000 7f9218aca700 1 --2- 172.21.15.112:0/2634129628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f921406dff0 0x7f921415e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:22.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.100+0000 7f9218aca700 1 -- 172.21.15.112:0/2634129628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92140ca6d0 msgr2=0x7f9214158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:22.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.100+0000 7f9218aca700 1 --2- 172.21.15.112:0/2634129628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92140ca6d0 0x7f9214158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:22.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.100+0000 7f9218aca700 1 -- 172.21.15.112:0/2634129628 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92040094f0 con 0x7f9214159780 2023-10-06T04:39:22.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.100+0000 7f9218aca700 1 --2- 172.21.15.112:0/2634129628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9214159780 0x7f921416ac70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f920c00c8e0 tx=0x7f920c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:22.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.100+0000 7f91fbfff700 1 -- 172.21.15.112:0/2634129628 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c00ce80 con 0x7f9214159780 2023-10-06T04:39:22.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.100+0000 7f91fbfff700 1 -- 172.21.15.112:0/2634129628 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920c00a7e0 con 0x7f9214159780 2023-10-06T04:39:22.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.100+0000 7f91fbfff700 1 -- 172.21.15.112:0/2634129628 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c00ab80 con 0x7f9214159780 2023-10-06T04:39:22.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.100+0000 7f921a52d700 1 -- 172.21.15.112:0/2634129628 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921415db30 con 0x7f9214159780 2023-10-06T04:39:22.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.100+0000 7f921a52d700 1 -- 172.21.15.112:0/2634129628 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921415e0f0 con 0x7f9214159780 2023-10-06T04:39:22.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.101+0000 7f921a52d700 1 -- 172.21.15.112:0/2634129628 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921405f230 con 0x7f9214159780 2023-10-06T04:39:22.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.101+0000 7f91fbfff700 1 -- 172.21.15.112:0/2634129628 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f920c012420 con 0x7f9214159780 2023-10-06T04:39:22.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.102+0000 7f91fbfff700 1 --2- 172.21.15.112:0/2634129628 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9200066f30 0x7f92000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:22.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.102+0000 7f9213fff700 1 --2- 172.21.15.112:0/2634129628 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9200066f30 0x7f92000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:22.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.102+0000 7f91fbfff700 1 -- 172.21.15.112:0/2634129628 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f920c084980 con 0x7f9214159780 2023-10-06T04:39:22.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.102+0000 7f9213fff700 1 --2- 172.21.15.112:0/2634129628 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9200066f30 0x7f92000693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f92040099b0 tx=0x7f9204017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:22.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.106+0000 7f91fbfff700 1 -- 172.21.15.112:0/2634129628 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f920c051a90 con 0x7f9214159780 2023-10-06T04:39:22.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.290+0000 7f921a52d700 1 -- 172.21.15.112:0/2634129628 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92140b3500 con 0x7f9214159780 2023-10-06T04:39:22.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.291+0000 7f91fbfff700 1 -- 172.21.15.112:0/2634129628 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16927 (secure 0 0 0) 0x7f920c0550b0 con 0x7f9214159780 2023-10-06T04:39:22.294 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:22.295 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":19,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:39:21.014878+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:18.657040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:19.972295+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:22.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.293+0000 7f921a52d700 1 -- 172.21.15.112:0/2634129628 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9200066f30 msgr2=0x7f92000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:22.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.293+0000 7f921a52d700 1 --2- 172.21.15.112:0/2634129628 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9200066f30 0x7f92000693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f92040099b0 tx=0x7f9204017000 comp rx=0 tx=0).stop 2023-10-06T04:39:22.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.293+0000 7f921a52d700 1 -- 172.21.15.112:0/2634129628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9214159780 msgr2=0x7f921416ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:22.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.293+0000 7f921a52d700 1 --2- 172.21.15.112:0/2634129628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9214159780 0x7f921416ac70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f920c00c8e0 tx=0x7f920c001710 comp rx=0 tx=0).stop 2023-10-06T04:39:22.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.293+0000 7f921a52d700 1 -- 172.21.15.112:0/2634129628 shutdown_connections 2023-10-06T04:39:22.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.293+0000 7f921a52d700 1 --2- 172.21.15.112:0/2634129628 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9200066f30 0x7f92000693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:22.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.293+0000 7f921a52d700 1 --2- 172.21.15.112:0/2634129628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9214159780 0x7f921416ac70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:22.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.293+0000 7f921a52d700 1 --2- 172.21.15.112:0/2634129628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f921406dff0 0x7f921415e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:22.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.293+0000 7f921a52d700 1 --2- 172.21.15.112:0/2634129628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92140ca6d0 0x7f9214158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:22.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.293+0000 7f921a52d700 1 -- 172.21.15.112:0/2634129628 >> 172.21.15.112:0/2634129628 conn(0x7f9214068650 msgr2=0x7f92140cc920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:22.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.293+0000 7f921a52d700 1 -- 172.21.15.112:0/2634129628 shutdown_connections 2023-10-06T04:39:22.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.293+0000 7f921a52d700 1 -- 172.21.15.112:0/2634129628 wait complete. 2023-10-06T04:39:22.310 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T04:39:22.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.428+0000 7f773e8b6700 1 Processor -- start 2023-10-06T04:39:22.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.428+0000 7f773e8b6700 1 -- start start 2023-10-06T04:39:22.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.429+0000 7f773e8b6700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7738157220 0x7f77380d0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:22.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.429+0000 7f773e8b6700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77380c7da0 0x7f77380c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:22.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.429+0000 7f773e8b6700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77380cab40 con 0x7f77380d0a70 2023-10-06T04:39:22.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.429+0000 7f773e8b6700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77380c81e0 con 0x7f7738157220 2023-10-06T04:39:22.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.429+0000 7f773e8b6700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77380cceb0 con 0x7f77380c7da0 2023-10-06T04:39:22.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.429+0000 7f773d8b4700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7738157220 0x7f77380d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:22.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.429+0000 7f773e0b5700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77380c7da0 0x7f77380c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:22.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.429+0000 7f773d0b3700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f77380d0a70 0x7f77380c7690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.112:58738/0 (socket says 172.21.15.112:58738) 2023-10-06T04:39:22.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.429+0000 7f773d0b3700 1 -- 172.21.15.112:0/2639199786 learned_addr learned my addr 172.21.15.112:0/2639199786 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:22.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.430+0000 7f773d8b4700 1 -- 172.21.15.112:0/2639199786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77380c7da0 msgr2=0x7f77380c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:22.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.430+0000 7f773d8b4700 1 --2- 172.21.15.112:0/2639199786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77380c7da0 0x7f77380c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:22.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.430+0000 7f773d8b4700 1 -- 172.21.15.112:0/2639199786 >> v1:172.21.15.179:6789/0 conn(0x7f77380d0a70 legacy=0x7f77380c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:22.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.430+0000 7f773d8b4700 1 -- 172.21.15.112:0/2639199786 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77380d0ee0 con 0x7f7738157220 2023-10-06T04:39:22.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.430+0000 7f773c8b2700 1 -- 172.21.15.112:0/2639199786 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656799677 0 0) 0x7f77380cab40 con 0x7f77380d0a70 2023-10-06T04:39:22.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.430+0000 7f773d8b4700 1 --2- 172.21.15.112:0/2639199786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7738157220 0x7f77380d0530 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f77340098e0 tx=0x7f77340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c78d7ba3152d834c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:22.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.430+0000 7f773c8b2700 1 -- 172.21.15.112:0/2639199786 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773400b640 con 0x7f7738157220 2023-10-06T04:39:22.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.430+0000 7f773c8b2700 1 -- 172.21.15.112:0/2639199786 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773400b7a0 con 0x7f7738157220 2023-10-06T04:39:22.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.430+0000 7f773c8b2700 1 -- 172.21.15.112:0/2639199786 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773400bb40 con 0x7f7738157220 2023-10-06T04:39:22.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.430+0000 7f773e8b6700 1 -- 172.21.15.112:0/2639199786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7738157220 msgr2=0x7f77380d0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:22.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.430+0000 7f773e8b6700 1 --2- 172.21.15.112:0/2639199786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7738157220 0x7f77380d0530 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f77340098e0 tx=0x7f77340091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:22.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.431+0000 7f773e8b6700 1 -- 172.21.15.112:0/2639199786 shutdown_connections 2023-10-06T04:39:22.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.431+0000 7f773e8b6700 1 --2- 172.21.15.112:0/2639199786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77380c7da0 0x7f77380c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:22.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.431+0000 7f773e8b6700 1 --2- 172.21.15.112:0/2639199786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7738157220 0x7f77380d0530 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:22.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.431+0000 7f773e8b6700 1 -- 172.21.15.112:0/2639199786 >> 172.21.15.112:0/2639199786 conn(0x7f773806c7d0 msgr2=0x7f773806cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:22.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.431+0000 7f773e8b6700 1 -- 172.21.15.112:0/2639199786 shutdown_connections 2023-10-06T04:39:22.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.431+0000 7f773e8b6700 1 -- 172.21.15.112:0/2639199786 wait complete. 2023-10-06T04:39:22.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.432+0000 7f773e8b6700 1 Processor -- start 2023-10-06T04:39:22.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.432+0000 7f773e8b6700 1 -- start start 2023-10-06T04:39:22.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.432+0000 7f773e8b6700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77380c7da0 0x7f773815f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:22.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.432+0000 7f773e8b6700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77380d0a70 0x7f7738146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:22.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.432+0000 7f773e8b6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7738157220 0x7f7738146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:22.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.432+0000 7f773e8b6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773815eff0 con 0x7f7738157220 2023-10-06T04:39:22.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.432+0000 7f773e8b6700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773815e3b0 con 0x7f77380d0a70 2023-10-06T04:39:22.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.432+0000 7f773e8b6700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773815e650 con 0x7f77380c7da0 2023-10-06T04:39:22.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.432+0000 7f773e0b5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7738157220 0x7f7738146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:22.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.432+0000 7f773e0b5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7738157220 0x7f7738146d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51068/0 (socket says 172.21.15.112:51068) 2023-10-06T04:39:22.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.433+0000 7f773e0b5700 1 -- 172.21.15.112:0/223254153 learned_addr learned my addr 172.21.15.112:0/223254153 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:22.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.433+0000 7f773d8b4700 1 --2- 172.21.15.112:0/223254153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77380c7da0 0x7f773815f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:22.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.433+0000 7f773d0b3700 1 --2- 172.21.15.112:0/223254153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77380d0a70 0x7f7738146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:22.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.433+0000 7f773e0b5700 1 -- 172.21.15.112:0/223254153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77380c7da0 msgr2=0x7f773815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:22.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.433+0000 7f773e0b5700 1 --2- 172.21.15.112:0/223254153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77380c7da0 0x7f773815f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:22.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.433+0000 7f773e0b5700 1 -- 172.21.15.112:0/223254153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77380d0a70 msgr2=0x7f7738146810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:22.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.433+0000 7f773e0b5700 1 --2- 172.21.15.112:0/223254153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77380d0a70 0x7f7738146810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:22.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.433+0000 7f773e0b5700 1 -- 172.21.15.112:0/223254153 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7734009420 con 0x7f7738157220 2023-10-06T04:39:22.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.433+0000 7f773d0b3700 1 --2- 172.21.15.112:0/223254153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77380d0a70 0x7f7738146810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:22.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.433+0000 7f773d8b4700 1 --2- 172.21.15.112:0/223254153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77380c7da0 0x7f773815f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:22.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.433+0000 7f773e0b5700 1 --2- 172.21.15.112:0/223254153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7738157220 0x7f7738146d50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7730009df0 tx=0x7f773000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:22.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.433+0000 7f772dffb700 1 -- 172.21.15.112:0/223254153 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773000cb50 con 0x7f7738157220 2023-10-06T04:39:22.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.433+0000 7f772dffb700 1 -- 172.21.15.112:0/223254153 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773000f040 con 0x7f7738157220 2023-10-06T04:39:22.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.433+0000 7f773e8b6700 1 -- 172.21.15.112:0/223254153 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f773815e930 con 0x7f7738157220 2023-10-06T04:39:22.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.433+0000 7f772dffb700 1 -- 172.21.15.112:0/223254153 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730014480 con 0x7f7738157220 2023-10-06T04:39:22.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.433+0000 7f773e8b6700 1 -- 172.21.15.112:0/223254153 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773815fc10 con 0x7f7738157220 2023-10-06T04:39:22.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.434+0000 7f773e8b6700 1 -- 172.21.15.112:0/223254153 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f773815f130 con 0x7f7738157220 2023-10-06T04:39:22.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.435+0000 7f772dffb700 1 -- 172.21.15.112:0/223254153 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7730014830 con 0x7f7738157220 2023-10-06T04:39:22.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.435+0000 7f772dffb700 1 --2- 172.21.15.112:0/223254153 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f771c066f30 0x7f771c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:22.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.435+0000 7f772dffb700 1 -- 172.21.15.112:0/223254153 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7730085410 con 0x7f7738157220 2023-10-06T04:39:22.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.435+0000 7f773d8b4700 1 --2- 172.21.15.112:0/223254153 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f771c066f30 0x7f771c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:22.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.435+0000 7f773d8b4700 1 --2- 172.21.15.112:0/223254153 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f771c066f30 0x7f771c0693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7734003080 tx=0x7f7734017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:22.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.439+0000 7f772dffb700 1 -- 172.21.15.112:0/223254153 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f773815f130 con 0x7f7738157220 2023-10-06T04:39:22.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:22.667+0000 7f773e8b6700 1 -- 172.21.15.112:0/223254153 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f773815f130 con 0x7f7738157220 2023-10-06T04:39:23.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.648+0000 7f772dffb700 1 -- 172.21.15.112:0/223254153 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f773815f130 con 0x7f7738157220 2023-10-06T04:39:23.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.650+0000 7f773e8b6700 1 -- 172.21.15.112:0/223254153 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f771c066f30 msgr2=0x7f771c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:23.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.650+0000 7f773e8b6700 1 --2- 172.21.15.112:0/223254153 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f771c066f30 0x7f771c0693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7734003080 tx=0x7f7734017000 comp rx=0 tx=0).stop 2023-10-06T04:39:23.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.650+0000 7f773e8b6700 1 -- 172.21.15.112:0/223254153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7738157220 msgr2=0x7f7738146d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:23.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.650+0000 7f773e8b6700 1 --2- 172.21.15.112:0/223254153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7738157220 0x7f7738146d50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7730009df0 tx=0x7f773000b040 comp rx=0 tx=0).stop 2023-10-06T04:39:23.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.650+0000 7f773e8b6700 1 -- 172.21.15.112:0/223254153 shutdown_connections 2023-10-06T04:39:23.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.651+0000 7f773e8b6700 1 --2- 172.21.15.112:0/223254153 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f771c066f30 0x7f771c0693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:23.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.651+0000 7f773e8b6700 1 --2- 172.21.15.112:0/223254153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7738157220 0x7f7738146d50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:23.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.651+0000 7f773e8b6700 1 --2- 172.21.15.112:0/223254153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77380c7da0 0x7f773815f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:23.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.651+0000 7f773e8b6700 1 --2- 172.21.15.112:0/223254153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77380d0a70 0x7f7738146810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:23.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.651+0000 7f773e8b6700 1 -- 172.21.15.112:0/223254153 >> 172.21.15.112:0/223254153 conn(0x7f773806c7d0 msgr2=0x7f77380cb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:23.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.651+0000 7f773e8b6700 1 -- 172.21.15.112:0/223254153 shutdown_connections 2023-10-06T04:39:23.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.651+0000 7f773e8b6700 1 -- 172.21.15.112:0/223254153 wait complete. 2023-10-06T04:39:23.667 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T04:39:23.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.787+0000 7f2d9af70700 1 Processor -- start 2023-10-06T04:39:23.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.787+0000 7f2d9af70700 1 -- start start 2023-10-06T04:39:23.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.788+0000 7f2d9af70700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2d940cbf00 0x7f2d9415b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:23.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.788+0000 7f2d9af70700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d9406d3b0 0x7f2d9415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:23.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.788+0000 7f2d9af70700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9415af50 con 0x7f2d94159a20 2023-10-06T04:39:23.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.788+0000 7f2d9af70700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d940cca70 con 0x7f2d940cbf00 2023-10-06T04:39:23.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.788+0000 7f2d9af70700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9408a080 con 0x7f2d9406d3b0 2023-10-06T04:39:23.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.788+0000 7f2d8bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2d940cbf00 0x7f2d9415b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:23.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.788+0000 7f2d8bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2d940cbf00 0x7f2d9415b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51078/0 (socket says 172.21.15.112:51078) 2023-10-06T04:39:23.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.788+0000 7f2d8bfff700 1 -- 172.21.15.112:0/1404474879 learned_addr learned my addr 172.21.15.112:0/1404474879 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:23.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.788+0000 7f2d9950d700 1 --2- 172.21.15.112:0/1404474879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d9406d3b0 0x7f2d9415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:23.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.789+0000 7f2d8bfff700 1 -- 172.21.15.112:0/1404474879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d9406d3b0 msgr2=0x7f2d9415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:23.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.789+0000 7f2d8bfff700 1 --2- 172.21.15.112:0/1404474879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d9406d3b0 0x7f2d9415bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:23.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.789+0000 7f2d8bfff700 1 -- 172.21.15.112:0/1404474879 >> v1:172.21.15.179:6789/0 conn(0x7f2d94159a20 legacy=0x7f2d940cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:23.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.789+0000 7f2d8bfff700 1 -- 172.21.15.112:0/1404474879 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d940cae50 con 0x7f2d940cbf00 2023-10-06T04:39:23.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.789+0000 7f2d8bfff700 1 --2- 172.21.15.112:0/1404474879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d940cbf00 0x7f2d9415b710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2d840099b0 tx=0x7f2d84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec9b401dd6ddf78 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:23.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.789+0000 7f2d8b7fe700 1 -- 172.21.15.112:0/1404474879 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d84009ea0 con 0x7f2d940cbf00 2023-10-06T04:39:23.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.789+0000 7f2d8b7fe700 1 -- 172.21.15.112:0/1404474879 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8400b860 con 0x7f2d940cbf00 2023-10-06T04:39:23.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.789+0000 7f2d8b7fe700 1 -- 172.21.15.112:0/1404474879 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8400bc00 con 0x7f2d940cbf00 2023-10-06T04:39:23.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.789+0000 7f2d9af70700 1 -- 172.21.15.112:0/1404474879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d940cbf00 msgr2=0x7f2d9415b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:23.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.789+0000 7f2d9af70700 1 --2- 172.21.15.112:0/1404474879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d940cbf00 0x7f2d9415b710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2d840099b0 tx=0x7f2d84009250 comp rx=0 tx=0).stop 2023-10-06T04:39:23.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.789+0000 7f2d9af70700 1 -- 172.21.15.112:0/1404474879 shutdown_connections 2023-10-06T04:39:23.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.789+0000 7f2d9af70700 1 --2- 172.21.15.112:0/1404474879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d9406d3b0 0x7f2d9415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:23.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.789+0000 7f2d9af70700 1 --2- 172.21.15.112:0/1404474879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d940cbf00 0x7f2d9415b710 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:23.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.789+0000 7f2d9af70700 1 -- 172.21.15.112:0/1404474879 >> 172.21.15.112:0/1404474879 conn(0x7f2d9406cfb0 msgr2=0x7f2d940d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:23.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.789+0000 7f2d9af70700 1 -- 172.21.15.112:0/1404474879 shutdown_connections 2023-10-06T04:39:23.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.789+0000 7f2d9af70700 1 -- 172.21.15.112:0/1404474879 wait complete. 2023-10-06T04:39:23.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.790+0000 7f2d9af70700 1 Processor -- start 2023-10-06T04:39:23.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.791+0000 7f2d9af70700 1 -- start start 2023-10-06T04:39:23.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.791+0000 7f2d9af70700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d9406d3b0 0x7f2d940b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:23.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.791+0000 7f2d9af70700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d940cbf00 0x7f2d940b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:23.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.791+0000 7f2d9af70700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d94159a20 0x7f2d940b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:23.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.791+0000 7f2d9af70700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9409a770 con 0x7f2d9406d3b0 2023-10-06T04:39:23.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.791+0000 7f2d9af70700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d940b6130 con 0x7f2d94159a20 2023-10-06T04:39:23.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.791+0000 7f2d9af70700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d940b2ef0 con 0x7f2d940cbf00 2023-10-06T04:39:23.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.791+0000 7f2d98d0c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d9406d3b0 0x7f2d940b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:23.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.792+0000 7f2d98d0c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d9406d3b0 0x7f2d940b53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51080/0 (socket says 172.21.15.112:51080) 2023-10-06T04:39:23.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.792+0000 7f2d98d0c700 1 -- 172.21.15.112:0/4044035546 learned_addr learned my addr 172.21.15.112:0/4044035546 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:23.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.792+0000 7f2d8bfff700 1 --2- 172.21.15.112:0/4044035546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d940cbf00 0x7f2d940b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:23.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.792+0000 7f2d9950d700 1 --2- 172.21.15.112:0/4044035546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d94159a20 0x7f2d940b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:23.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.792+0000 7f2d98d0c700 1 -- 172.21.15.112:0/4044035546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d940cbf00 msgr2=0x7f2d940b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:23.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.792+0000 7f2d98d0c700 1 --2- 172.21.15.112:0/4044035546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d940cbf00 0x7f2d940b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:23.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.792+0000 7f2d98d0c700 1 -- 172.21.15.112:0/4044035546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d94159a20 msgr2=0x7f2d940b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:23.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.792+0000 7f2d98d0c700 1 --2- 172.21.15.112:0/4044035546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d94159a20 0x7f2d940b29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:23.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.792+0000 7f2d98d0c700 1 -- 172.21.15.112:0/4044035546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d840094f0 con 0x7f2d9406d3b0 2023-10-06T04:39:23.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.792+0000 7f2d9950d700 1 --2- 172.21.15.112:0/4044035546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d94159a20 0x7f2d940b29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:23.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.792+0000 7f2d98d0c700 1 --2- 172.21.15.112:0/4044035546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d9406d3b0 0x7f2d940b53b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000c8e0 tx=0x7f2d90001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:23.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.792+0000 7f2d88ff9700 1 -- 172.21.15.112:0/4044035546 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000ce80 con 0x7f2d9406d3b0 2023-10-06T04:39:23.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.792+0000 7f2d88ff9700 1 -- 172.21.15.112:0/4044035546 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9000a7e0 con 0x7f2d9406d3b0 2023-10-06T04:39:23.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.792+0000 7f2d9af70700 1 -- 172.21.15.112:0/4044035546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d940b6340 con 0x7f2d9406d3b0 2023-10-06T04:39:23.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.792+0000 7f2d88ff9700 1 -- 172.21.15.112:0/4044035546 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000aba0 con 0x7f2d9406d3b0 2023-10-06T04:39:23.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.792+0000 7f2d9af70700 1 -- 172.21.15.112:0/4044035546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d940b4e90 con 0x7f2d9406d3b0 2023-10-06T04:39:23.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.793+0000 7f2d9af70700 1 -- 172.21.15.112:0/4044035546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d940b4000 con 0x7f2d9406d3b0 2023-10-06T04:39:23.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.793+0000 7f2d88ff9700 1 -- 172.21.15.112:0/4044035546 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d90003030 con 0x7f2d9406d3b0 2023-10-06T04:39:23.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.794+0000 7f2d88ff9700 1 --2- 172.21.15.112:0/4044035546 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2d80066f30 0x7f2d800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:23.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.794+0000 7f2d8bfff700 1 --2- 172.21.15.112:0/4044035546 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2d80066f30 0x7f2d800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:23.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.794+0000 7f2d88ff9700 1 -- 172.21.15.112:0/4044035546 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2d900846e0 con 0x7f2d9406d3b0 2023-10-06T04:39:23.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.794+0000 7f2d8bfff700 1 --2- 172.21.15.112:0/4044035546 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2d80066f30 0x7f2d800693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2d840099b0 tx=0x7f2d84017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:23.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:23.798+0000 7f2d88ff9700 1 -- 172.21.15.112:0/4044035546 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d90055280 con 0x7f2d9406d3b0 2023-10-06T04:39:24.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.027+0000 7f2d9af70700 1 -- 172.21.15.112:0/4044035546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2d9405f230 con 0x7f2d9406d3b0 2023-10-06T04:39:24.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.655+0000 7f2d88ff9700 1 -- 172.21.15.112:0/4044035546 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2d90054e10 con 0x7f2d9406d3b0 2023-10-06T04:39:24.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.658+0000 7f2d9af70700 1 -- 172.21.15.112:0/4044035546 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2d80066f30 msgr2=0x7f2d800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:24.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.658+0000 7f2d9af70700 1 --2- 172.21.15.112:0/4044035546 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2d80066f30 0x7f2d800693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2d840099b0 tx=0x7f2d84017000 comp rx=0 tx=0).stop 2023-10-06T04:39:24.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.658+0000 7f2d9af70700 1 -- 172.21.15.112:0/4044035546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d9406d3b0 msgr2=0x7f2d940b53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:24.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.658+0000 7f2d9af70700 1 --2- 172.21.15.112:0/4044035546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d9406d3b0 0x7f2d940b53b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000c8e0 tx=0x7f2d90001710 comp rx=0 tx=0).stop 2023-10-06T04:39:24.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.658+0000 7f2d9af70700 1 -- 172.21.15.112:0/4044035546 shutdown_connections 2023-10-06T04:39:24.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.658+0000 7f2d9af70700 1 --2- 172.21.15.112:0/4044035546 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2d80066f30 0x7f2d800693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:24.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.658+0000 7f2d9af70700 1 --2- 172.21.15.112:0/4044035546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d94159a20 0x7f2d940b29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:24.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.658+0000 7f2d9af70700 1 --2- 172.21.15.112:0/4044035546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d9406d3b0 0x7f2d940b53b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:24.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.658+0000 7f2d9af70700 1 --2- 172.21.15.112:0/4044035546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d940cbf00 0x7f2d940b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:24.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.658+0000 7f2d9af70700 1 -- 172.21.15.112:0/4044035546 >> 172.21.15.112:0/4044035546 conn(0x7f2d9406cfb0 msgr2=0x7f2d9415db60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:24.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.658+0000 7f2d9af70700 1 -- 172.21.15.112:0/4044035546 shutdown_connections 2023-10-06T04:39:24.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.658+0000 7f2d9af70700 1 -- 172.21.15.112:0/4044035546 wait complete. 2023-10-06T04:39:24.673 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:39:24.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.787+0000 7fe7b5b08700 1 Processor -- start 2023-10-06T04:39:24.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.787+0000 7fe7b5b08700 1 -- start start 2023-10-06T04:39:24.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5b08700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b00b11a0 0x7fe7b00d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:24.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5b08700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe7b006d3b0 0x7fe7b00b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:24.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5b08700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe7b00b3810 0x7fe7b00b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:24.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5b08700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b00afed0 con 0x7fe7b00b3810 2023-10-06T04:39:24.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5b08700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b00b1ab0 con 0x7fe7b006d3b0 2023-10-06T04:39:24.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5b08700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b00b6170 con 0x7fe7b00b11a0 2023-10-06T04:39:24.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5307700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe7b00b3810 0x7fe7b00b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:24.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5307700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe7b00b3810 0x7fe7b00b3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51092/0 (socket says 172.21.15.112:51092) 2023-10-06T04:39:24.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5307700 1 -- 172.21.15.112:0/2059632017 learned_addr learned my addr 172.21.15.112:0/2059632017 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:24.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b4b06700 1 --2- 172.21.15.112:0/2059632017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b00b11a0 0x7fe7b00d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:24.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7a7fff700 1 --2- 172.21.15.112:0/2059632017 >> v2:172.21.15.179:3300/0 conn(0x7fe7b006d3b0 0x7fe7b00b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:24.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5307700 1 -- 172.21.15.112:0/2059632017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b00b11a0 msgr2=0x7fe7b00d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:24.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5307700 1 --2- 172.21.15.112:0/2059632017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b00b11a0 0x7fe7b00d0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:24.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5307700 1 -- 172.21.15.112:0/2059632017 >> v2:172.21.15.179:3300/0 conn(0x7fe7b006d3b0 msgr2=0x7fe7b00b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:24.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5307700 1 --2- 172.21.15.112:0/2059632017 >> v2:172.21.15.179:3300/0 conn(0x7fe7b006d3b0 0x7fe7b00b1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:24.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5307700 1 -- 172.21.15.112:0/2059632017 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b00b6450 con 0x7fe7b00b3810 2023-10-06T04:39:24.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5307700 1 --2- 172.21.15.112:0/2059632017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7b00b3810 0x7fe7b00b3cb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0089780 tx=0x7fe7a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad59625059285bc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:24.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7a77fe700 1 -- 172.21.15.112:0/2059632017 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a800e070 con 0x7fe7b00b3810 2023-10-06T04:39:24.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7a77fe700 1 -- 172.21.15.112:0/2059632017 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a800ba50 con 0x7fe7b00b3810 2023-10-06T04:39:24.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7a77fe700 1 -- 172.21.15.112:0/2059632017 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a80092e0 con 0x7fe7b00b3810 2023-10-06T04:39:24.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5b08700 1 -- 172.21.15.112:0/2059632017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7b00b3810 msgr2=0x7fe7b00b3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:24.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5b08700 1 --2- 172.21.15.112:0/2059632017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7b00b3810 0x7fe7b00b3cb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0089780 tx=0x7fe7a8009840 comp rx=0 tx=0).stop 2023-10-06T04:39:24.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5b08700 1 -- 172.21.15.112:0/2059632017 shutdown_connections 2023-10-06T04:39:24.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5b08700 1 --2- 172.21.15.112:0/2059632017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b00b11a0 0x7fe7b00d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:24.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5b08700 1 --2- 172.21.15.112:0/2059632017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7b00b3810 0x7fe7b00b3cb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:24.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5b08700 1 --2- 172.21.15.112:0/2059632017 >> v2:172.21.15.179:3300/0 conn(0x7fe7b006d3b0 0x7fe7b00b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:24.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5b08700 1 -- 172.21.15.112:0/2059632017 >> 172.21.15.112:0/2059632017 conn(0x7fe7b006cfb0 msgr2=0x7fe7b00d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:24.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5b08700 1 -- 172.21.15.112:0/2059632017 shutdown_connections 2023-10-06T04:39:24.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.788+0000 7fe7b5b08700 1 -- 172.21.15.112:0/2059632017 wait complete. 2023-10-06T04:39:24.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.789+0000 7fe7b5b08700 1 Processor -- start 2023-10-06T04:39:24.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.790+0000 7fe7b5b08700 1 -- start start 2023-10-06T04:39:24.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.790+0000 7fe7b5b08700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b006d3b0 0x7fe7b015e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:24.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.790+0000 7fe7b5b08700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b00b11a0 0x7fe7b015eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:24.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.790+0000 7fe7b5b08700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7b00b3810 0x7fe7b015f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:24.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.790+0000 7fe7b5b08700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b015e8d0 con 0x7fe7b00b3810 2023-10-06T04:39:24.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.790+0000 7fe7b5b08700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b00cb250 con 0x7fe7b00b11a0 2023-10-06T04:39:24.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.790+0000 7fe7b5b08700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b00c9d50 con 0x7fe7b006d3b0 2023-10-06T04:39:24.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.790+0000 7fe7b5307700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7b00b3810 0x7fe7b015f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:24.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.790+0000 7fe7b5307700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7b00b3810 0x7fe7b015f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51108/0 (socket says 172.21.15.112:51108) 2023-10-06T04:39:24.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.790+0000 7fe7b5307700 1 -- 172.21.15.112:0/2641440632 learned_addr learned my addr 172.21.15.112:0/2641440632 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:24.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.790+0000 7fe7b4b06700 1 --2- 172.21.15.112:0/2641440632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b006d3b0 0x7fe7b015e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:24.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.790+0000 7fe7a7fff700 1 --2- 172.21.15.112:0/2641440632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b00b11a0 0x7fe7b015eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:24.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.791+0000 7fe7b5307700 1 -- 172.21.15.112:0/2641440632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b006d3b0 msgr2=0x7fe7b015e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:24.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.791+0000 7fe7b5307700 1 --2- 172.21.15.112:0/2641440632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b006d3b0 0x7fe7b015e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:24.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.791+0000 7fe7b5307700 1 -- 172.21.15.112:0/2641440632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b00b11a0 msgr2=0x7fe7b015eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:24.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.791+0000 7fe7b5307700 1 --2- 172.21.15.112:0/2641440632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b00b11a0 0x7fe7b015eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:24.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.791+0000 7fe7b5307700 1 -- 172.21.15.112:0/2641440632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a8009ae0 con 0x7fe7b00b3810 2023-10-06T04:39:24.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.791+0000 7fe7a7fff700 1 --2- 172.21.15.112:0/2641440632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b00b11a0 0x7fe7b015eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:24.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.791+0000 7fe7b5307700 1 --2- 172.21.15.112:0/2641440632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7b00b3810 0x7fe7b015f0b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8009fd0 tx=0x7fe7a8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:24.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.791+0000 7fe7a4ff9700 1 -- 172.21.15.112:0/2641440632 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a80032f0 con 0x7fe7b00b3810 2023-10-06T04:39:24.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.791+0000 7fe7a4ff9700 1 -- 172.21.15.112:0/2641440632 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a8007db0 con 0x7fe7b00b3810 2023-10-06T04:39:24.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.791+0000 7fe7b5b08700 1 -- 172.21.15.112:0/2641440632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b00cbdb0 con 0x7fe7b00b3810 2023-10-06T04:39:24.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.791+0000 7fe7a4ff9700 1 -- 172.21.15.112:0/2641440632 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a801d650 con 0x7fe7b00b3810 2023-10-06T04:39:24.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.791+0000 7fe7b5b08700 1 -- 172.21.15.112:0/2641440632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b00cb760 con 0x7fe7b00b3810 2023-10-06T04:39:24.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.792+0000 7fe7b5b08700 1 -- 172.21.15.112:0/2641440632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b00cbf40 con 0x7fe7b00b3810 2023-10-06T04:39:24.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.792+0000 7fe7a4ff9700 1 -- 172.21.15.112:0/2641440632 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7a8003040 con 0x7fe7b00b3810 2023-10-06T04:39:24.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.793+0000 7fe7a4ff9700 1 --2- 172.21.15.112:0/2641440632 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe79c066f30 0x7fe79c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:24.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.793+0000 7fe7a4ff9700 1 -- 172.21.15.112:0/2641440632 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe7a80862e0 con 0x7fe7b00b3810 2023-10-06T04:39:24.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.793+0000 7fe7b4b06700 1 --2- 172.21.15.112:0/2641440632 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe79c066f30 0x7fe79c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:24.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.793+0000 7fe7b4b06700 1 --2- 172.21.15.112:0/2641440632 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe79c066f30 0x7fe79c0693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac006fd0 tx=0x7fe7ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:24.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:24.797+0000 7fe7a4ff9700 1 -- 172.21.15.112:0/2641440632 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7a80533f0 con 0x7fe7b00b3810 2023-10-06T04:39:25.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.021+0000 7fe7b5b08700 1 -- 172.21.15.112:0/2641440632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7b005f230 con 0x7fe7b00b3810 2023-10-06T04:39:25.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.022+0000 7fe7a4ff9700 1 -- 172.21.15.112:0/2641440632 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fe7a8056a10 con 0x7fe7b00b3810 2023-10-06T04:39:25.025 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:25.025 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1694304040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1694304040},{"type":"v1","addr":"172.21.15.112:6837","nonce":1694304040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3750383657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3750383657},{"type":"v1","addr":"172.21.15.112:6835","nonce":3750383657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2217480877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2217480877},{"type":"v1","addr":"172.21.15.179:6834","nonce":2217480877}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:39:21.015278+0000","modified":"2023-10-06T04:39:24.651029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/140836226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":140836226},{"type":"v1","addr":"172.21.15.179:6835","nonce":140836226}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:39:25.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.024+0000 7fe7b5b08700 1 -- 172.21.15.112:0/2641440632 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe79c066f30 msgr2=0x7fe79c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:25.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.024+0000 7fe7b5b08700 1 --2- 172.21.15.112:0/2641440632 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe79c066f30 0x7fe79c0693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac006fd0 tx=0x7fe7ac008040 comp rx=0 tx=0).stop 2023-10-06T04:39:25.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.024+0000 7fe7b5b08700 1 -- 172.21.15.112:0/2641440632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7b00b3810 msgr2=0x7fe7b015f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:25.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.024+0000 7fe7b5b08700 1 --2- 172.21.15.112:0/2641440632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7b00b3810 0x7fe7b015f0b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8009fd0 tx=0x7fe7a8018000 comp rx=0 tx=0).stop 2023-10-06T04:39:25.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.024+0000 7fe7b5b08700 1 -- 172.21.15.112:0/2641440632 shutdown_connections 2023-10-06T04:39:25.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.024+0000 7fe7b5b08700 1 --2- 172.21.15.112:0/2641440632 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe79c066f30 0x7fe79c0693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.024+0000 7fe7b5b08700 1 --2- 172.21.15.112:0/2641440632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7b00b3810 0x7fe7b015f0b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.024+0000 7fe7b5b08700 1 --2- 172.21.15.112:0/2641440632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b006d3b0 0x7fe7b015e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.024+0000 7fe7b5b08700 1 --2- 172.21.15.112:0/2641440632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b00b11a0 0x7fe7b015eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.024+0000 7fe7b5b08700 1 -- 172.21.15.112:0/2641440632 >> 172.21.15.112:0/2641440632 conn(0x7fe7b006cfb0 msgr2=0x7fe7b006f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:25.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.024+0000 7fe7b5b08700 1 -- 172.21.15.112:0/2641440632 shutdown_connections 2023-10-06T04:39:25.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.024+0000 7fe7b5b08700 1 -- 172.21.15.112:0/2641440632 wait complete. 2023-10-06T04:39:25.028 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 7 2023-10-06T04:39:25.038 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:25.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.150+0000 7fa87f3b0700 1 Processor -- start 2023-10-06T04:39:25.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.150+0000 7fa87f3b0700 1 -- start start 2023-10-06T04:39:25.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa87f3b0700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa87815aa00 0x7fa8781585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:25.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa87f3b0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa87815a020 0x7fa878068320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:25.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa87f3b0700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa878068860 con 0x7fa878067eb0 2023-10-06T04:39:25.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa87f3b0700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa878158b30 con 0x7fa87815a020 2023-10-06T04:39:25.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa87f3b0700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87815b500 con 0x7fa87815aa00 2023-10-06T04:39:25.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa87d94d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa87815a020 0x7fa878068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:25.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa87d94d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa87815a020 0x7fa878068320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51118/0 (socket says 172.21.15.112:51118) 2023-10-06T04:39:25.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa87d94d700 1 -- 172.21.15.112:0/2507715612 learned_addr learned my addr 172.21.15.112:0/2507715612 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:25.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa87d94d700 1 -- 172.21.15.112:0/2507715612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa87815aa00 msgr2=0x7fa8781585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:25.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa87d94d700 1 --2- 172.21.15.112:0/2507715612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa87815aa00 0x7fa8781585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa87d94d700 1 -- 172.21.15.112:0/2507715612 >> v1:172.21.15.179:6789/0 conn(0x7fa878067eb0 legacy=0x7fa878069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:25.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa87d94d700 1 -- 172.21.15.112:0/2507715612 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87815b7e0 con 0x7fa87815a020 2023-10-06T04:39:25.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa87d94d700 1 --2- 172.21.15.112:0/2507715612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa87815a020 0x7fa878068320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa870009f20 tx=0x7fa870009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9a383b4f5e7888 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:25.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa86ffff700 1 -- 172.21.15.112:0/2507715612 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87000e070 con 0x7fa87815a020 2023-10-06T04:39:25.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa86ffff700 1 -- 172.21.15.112:0/2507715612 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87000ba80 con 0x7fa87815a020 2023-10-06T04:39:25.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa86ffff700 1 -- 172.21.15.112:0/2507715612 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8700092e0 con 0x7fa87815a020 2023-10-06T04:39:25.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa87f3b0700 1 -- 172.21.15.112:0/2507715612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa87815a020 msgr2=0x7fa878068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:25.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa87f3b0700 1 --2- 172.21.15.112:0/2507715612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa87815a020 0x7fa878068320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa870009f20 tx=0x7fa870009840 comp rx=0 tx=0).stop 2023-10-06T04:39:25.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa87f3b0700 1 -- 172.21.15.112:0/2507715612 shutdown_connections 2023-10-06T04:39:25.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa87f3b0700 1 --2- 172.21.15.112:0/2507715612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa87815a020 0x7fa878068320 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa87f3b0700 1 --2- 172.21.15.112:0/2507715612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa87815aa00 0x7fa8781585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa87f3b0700 1 -- 172.21.15.112:0/2507715612 >> 172.21.15.112:0/2507715612 conn(0x7fa8780ce5e0 msgr2=0x7fa8780ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:25.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.152+0000 7fa87f3b0700 1 -- 172.21.15.112:0/2507715612 shutdown_connections 2023-10-06T04:39:25.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.153+0000 7fa87f3b0700 1 -- 172.21.15.112:0/2507715612 wait complete. 2023-10-06T04:39:25.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.154+0000 7fa87f3b0700 1 Processor -- start 2023-10-06T04:39:25.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.154+0000 7fa87f3b0700 1 -- start start 2023-10-06T04:39:25.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.154+0000 7fa87f3b0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa878067eb0 0x7fa87816b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:25.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.154+0000 7fa87f3b0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa87815a020 0x7fa8780b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:25.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.154+0000 7fa87f3b0700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa87815aa00 0x7fa8780ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:25.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.154+0000 7fa87f3b0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8780b1dd0 con 0x7fa878067eb0 2023-10-06T04:39:25.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.154+0000 7fa87f3b0700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8780b2090 con 0x7fa87815a020 2023-10-06T04:39:25.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.154+0000 7fa87f3b0700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8780b2370 con 0x7fa87815aa00 2023-10-06T04:39:25.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.154+0000 7fa87d14c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa878067eb0 0x7fa87816b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:25.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.155+0000 7fa87d14c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa878067eb0 0x7fa87816b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51128/0 (socket says 172.21.15.112:51128) 2023-10-06T04:39:25.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.155+0000 7fa87d14c700 1 -- 172.21.15.112:0/3628254540 learned_addr learned my addr 172.21.15.112:0/3628254540 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:25.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.155+0000 7fa87d14c700 1 -- 172.21.15.112:0/3628254540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa87815aa00 msgr2=0x7fa8780ad0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:25.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.155+0000 7fa87d14c700 1 --2- 172.21.15.112:0/3628254540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa87815aa00 0x7fa8780ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.155+0000 7fa87d14c700 1 -- 172.21.15.112:0/3628254540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa87815a020 msgr2=0x7fa8780b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:25.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.155+0000 7fa87c94b700 1 --2- 172.21.15.112:0/3628254540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa87815a020 0x7fa8780b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:25.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.155+0000 7fa87d14c700 1 --2- 172.21.15.112:0/3628254540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa87815a020 0x7fa8780b1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.155+0000 7fa87d14c700 1 -- 172.21.15.112:0/3628254540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa870009ae0 con 0x7fa878067eb0 2023-10-06T04:39:25.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.155+0000 7fa87d14c700 1 --2- 172.21.15.112:0/3628254540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa878067eb0 0x7fa87816b810 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa87400b810 tx=0x7fa8740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:25.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.155+0000 7fa86d7fa700 1 -- 172.21.15.112:0/3628254540 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87400f570 con 0x7fa878067eb0 2023-10-06T04:39:25.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.155+0000 7fa86d7fa700 1 -- 172.21.15.112:0/3628254540 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87400f6d0 con 0x7fa878067eb0 2023-10-06T04:39:25.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.155+0000 7fa86d7fa700 1 -- 172.21.15.112:0/3628254540 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87400fa90 con 0x7fa878067eb0 2023-10-06T04:39:25.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.155+0000 7fa87f3b0700 1 -- 172.21.15.112:0/3628254540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8780b2650 con 0x7fa878067eb0 2023-10-06T04:39:25.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.155+0000 7fa87f3b0700 1 -- 172.21.15.112:0/3628254540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8780b2c10 con 0x7fa878067eb0 2023-10-06T04:39:25.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.156+0000 7fa87f3b0700 1 -- 172.21.15.112:0/3628254540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87805f230 con 0x7fa878067eb0 2023-10-06T04:39:25.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.156+0000 7fa86d7fa700 1 -- 172.21.15.112:0/3628254540 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa87401a460 con 0x7fa878067eb0 2023-10-06T04:39:25.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.157+0000 7fa86d7fa700 1 --2- 172.21.15.112:0/3628254540 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa85c066f30 0x7fa85c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:25.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.157+0000 7fa86d7fa700 1 -- 172.21.15.112:0/3628254540 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa874084370 con 0x7fa878067eb0 2023-10-06T04:39:25.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.157+0000 7fa87c94b700 1 --2- 172.21.15.112:0/3628254540 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa85c066f30 0x7fa85c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:25.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.157+0000 7fa87c94b700 1 --2- 172.21.15.112:0/3628254540 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa85c066f30 0x7fa85c0693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa8781553a0 tx=0x7fa868009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:25.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.161+0000 7fa86d7fa700 1 -- 172.21.15.112:0/3628254540 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa874051500 con 0x7fa878067eb0 2023-10-06T04:39:25.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.343+0000 7fa87f3b0700 1 -- 172.21.15.112:0/3628254540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa87815bac0 con 0x7fa878067eb0 2023-10-06T04:39:25.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.344+0000 7fa86d7fa700 1 -- 172.21.15.112:0/3628254540 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7fa874054b20 con 0x7fa878067eb0 2023-10-06T04:39:25.346 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:25.347 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:39:22.637355+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:18.657040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:19.972295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:25.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.346+0000 7fa87f3b0700 1 -- 172.21.15.112:0/3628254540 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa85c066f30 msgr2=0x7fa85c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:25.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.346+0000 7fa87f3b0700 1 --2- 172.21.15.112:0/3628254540 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa85c066f30 0x7fa85c0693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa8781553a0 tx=0x7fa868009040 comp rx=0 tx=0).stop 2023-10-06T04:39:25.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.346+0000 7fa87f3b0700 1 -- 172.21.15.112:0/3628254540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa878067eb0 msgr2=0x7fa87816b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:25.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.346+0000 7fa87f3b0700 1 --2- 172.21.15.112:0/3628254540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa878067eb0 0x7fa87816b810 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa87400b810 tx=0x7fa8740091d0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.346+0000 7fa87f3b0700 1 -- 172.21.15.112:0/3628254540 shutdown_connections 2023-10-06T04:39:25.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.346+0000 7fa87f3b0700 1 --2- 172.21.15.112:0/3628254540 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa85c066f30 0x7fa85c0693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.346+0000 7fa87f3b0700 1 --2- 172.21.15.112:0/3628254540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa87815aa00 0x7fa8780ad0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.346+0000 7fa87f3b0700 1 --2- 172.21.15.112:0/3628254540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa878067eb0 0x7fa87816b810 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.346+0000 7fa87f3b0700 1 --2- 172.21.15.112:0/3628254540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa87815a020 0x7fa8780b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.346+0000 7fa87f3b0700 1 -- 172.21.15.112:0/3628254540 >> 172.21.15.112:0/3628254540 conn(0x7fa8780ce5e0 msgr2=0x7fa8780cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:25.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.346+0000 7fa87f3b0700 1 -- 172.21.15.112:0/3628254540 shutdown_connections 2023-10-06T04:39:25.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.346+0000 7fa87f3b0700 1 -- 172.21.15.112:0/3628254540 wait complete. 2023-10-06T04:39:25.360 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T04:39:25.360 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:39:25.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.471+0000 7f985f2b9700 1 Processor -- start 2023-10-06T04:39:25.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.471+0000 7f985f2b9700 1 -- start start 2023-10-06T04:39:25.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.472+0000 7f985f2b9700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f98580cb620 0x7f985815aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:25.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.472+0000 7f985f2b9700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985815a570 con 0x7f98580cb9f0 2023-10-06T04:39:25.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.472+0000 7f985f2b9700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98580ac030 con 0x7f985806b8b0 2023-10-06T04:39:25.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.472+0000 7f985f2b9700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985815a020 con 0x7f98580cb620 2023-10-06T04:39:25.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.472+0000 7f985d055700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f98580cb620 0x7f985815aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:25.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.472+0000 7f985d856700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f98580cb9f0 0x7f98580a9890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54704/0 (socket says 172.21.15.112:54704) 2023-10-06T04:39:25.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.472+0000 7f985d856700 1 -- 172.21.15.112:0/901942961 learned_addr learned my addr 172.21.15.112:0/901942961 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:25.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.473+0000 7f985d055700 1 -- 172.21.15.112:0/901942961 >> v1:172.21.15.179:6789/0 conn(0x7f985806b8b0 legacy=0x7f98580ab700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:25.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.473+0000 7f985d055700 1 -- 172.21.15.112:0/901942961 >> v1:172.21.15.112:6789/0 conn(0x7f98580cb9f0 legacy=0x7f98580a9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:25.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.473+0000 7f985d055700 1 -- 172.21.15.112:0/901942961 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98580ac310 con 0x7f98580cb620 2023-10-06T04:39:25.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.473+0000 7f984ffff700 1 -- 172.21.15.112:0/901942961 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351019093 0 0) 0x7f985815a570 con 0x7f98580cb9f0 2023-10-06T04:39:25.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.473+0000 7f985d055700 1 --2- 172.21.15.112:0/901942961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98580cb620 0x7f985815aa00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9854009e60 tx=0x7f9854009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2e7c4d1b0e6312 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:25.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.473+0000 7f984ffff700 1 -- 172.21.15.112:0/901942961 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985400e070 con 0x7f98580cb620 2023-10-06T04:39:25.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.473+0000 7f984ffff700 1 -- 172.21.15.112:0/901942961 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985400bbf0 con 0x7f98580cb620 2023-10-06T04:39:25.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.473+0000 7f984ffff700 1 -- 172.21.15.112:0/901942961 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854012430 con 0x7f98580cb620 2023-10-06T04:39:25.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.473+0000 7f985f2b9700 1 -- 172.21.15.112:0/901942961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98580cb620 msgr2=0x7f985815aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:25.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.473+0000 7f985f2b9700 1 --2- 172.21.15.112:0/901942961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98580cb620 0x7f985815aa00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9854009e60 tx=0x7f9854009780 comp rx=0 tx=0).stop 2023-10-06T04:39:25.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.473+0000 7f985f2b9700 1 -- 172.21.15.112:0/901942961 shutdown_connections 2023-10-06T04:39:25.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.473+0000 7f985f2b9700 1 --2- 172.21.15.112:0/901942961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98580cb620 0x7f985815aa00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.473+0000 7f985f2b9700 1 -- 172.21.15.112:0/901942961 >> 172.21.15.112:0/901942961 conn(0x7f98580ccc40 msgr2=0x7f98580cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:25.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.474+0000 7f985f2b9700 1 -- 172.21.15.112:0/901942961 shutdown_connections 2023-10-06T04:39:25.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.474+0000 7f985f2b9700 1 -- 172.21.15.112:0/901942961 wait complete. 2023-10-06T04:39:25.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.475+0000 7f985f2b9700 1 Processor -- start 2023-10-06T04:39:25.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.475+0000 7f985f2b9700 1 -- start start 2023-10-06T04:39:25.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.475+0000 7f985f2b9700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f985806b8b0 0x7f985816cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:25.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.475+0000 7f985f2b9700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98580cb620 0x7f98580ad090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:25.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.476+0000 7f985f2b9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98580cb9f0 0x7f98581563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:25.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.476+0000 7f985f2b9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98580ada00 con 0x7f98580cb9f0 2023-10-06T04:39:25.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.476+0000 7f985f2b9700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98580adce0 con 0x7f98580cb620 2023-10-06T04:39:25.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.476+0000 7f985f2b9700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98580adfc0 con 0x7f985806b8b0 2023-10-06T04:39:25.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.476+0000 7f985d856700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98580cb9f0 0x7f98581563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:25.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.476+0000 7f985d856700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98580cb9f0 0x7f98581563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51154/0 (socket says 172.21.15.112:51154) 2023-10-06T04:39:25.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.476+0000 7f985d856700 1 -- 172.21.15.112:0/197341018 learned_addr learned my addr 172.21.15.112:0/197341018 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:25.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.476+0000 7f985d055700 1 --2- 172.21.15.112:0/197341018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f985806b8b0 0x7f985816cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:25.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.476+0000 7f985c854700 1 --2- 172.21.15.112:0/197341018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98580cb620 0x7f98580ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:25.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.476+0000 7f985d856700 1 -- 172.21.15.112:0/197341018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f985806b8b0 msgr2=0x7f985816cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:25.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.476+0000 7f985d856700 1 --2- 172.21.15.112:0/197341018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f985806b8b0 0x7f985816cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.476+0000 7f985d856700 1 -- 172.21.15.112:0/197341018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98580cb620 msgr2=0x7f98580ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:25.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.476+0000 7f985d856700 1 --2- 172.21.15.112:0/197341018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98580cb620 0x7f98580ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.476+0000 7f985d856700 1 -- 172.21.15.112:0/197341018 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9854009a20 con 0x7f98580cb9f0 2023-10-06T04:39:25.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.476+0000 7f985d856700 1 --2- 172.21.15.112:0/197341018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98580cb9f0 0x7f98581563d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f985000c500 tx=0x7f9850007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:25.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.476+0000 7f984d7fa700 1 -- 172.21.15.112:0/197341018 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850005b30 con 0x7f98580cb9f0 2023-10-06T04:39:25.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.476+0000 7f984d7fa700 1 -- 172.21.15.112:0/197341018 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9850005c90 con 0x7f98580cb9f0 2023-10-06T04:39:25.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.476+0000 7f985f2b9700 1 -- 172.21.15.112:0/197341018 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98580ae2a0 con 0x7f98580cb9f0 2023-10-06T04:39:25.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.476+0000 7f984d7fa700 1 -- 172.21.15.112:0/197341018 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850007320 con 0x7f98580cb9f0 2023-10-06T04:39:25.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.476+0000 7f985f2b9700 1 -- 172.21.15.112:0/197341018 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985816d4c0 con 0x7f98580cb9f0 2023-10-06T04:39:25.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.477+0000 7f985f2b9700 1 -- 172.21.15.112:0/197341018 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985805f230 con 0x7f98580cb9f0 2023-10-06T04:39:25.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.478+0000 7f984d7fa700 1 -- 172.21.15.112:0/197341018 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f985001b3b0 con 0x7f98580cb9f0 2023-10-06T04:39:25.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.478+0000 7f984d7fa700 1 --2- 172.21.15.112:0/197341018 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f983c066f30 0x7f983c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:25.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.478+0000 7f985d055700 1 --2- 172.21.15.112:0/197341018 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f983c066f30 0x7f983c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:25.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.478+0000 7f984d7fa700 1 -- 172.21.15.112:0/197341018 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9850083a10 con 0x7f98580cb9f0 2023-10-06T04:39:25.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.478+0000 7f985d055700 1 --2- 172.21.15.112:0/197341018 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f983c066f30 0x7f983c0693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f98540099f0 tx=0x7f9854018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:25.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.482+0000 7f984d7fa700 1 -- 172.21.15.112:0/197341018 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9850050b20 con 0x7f98580cb9f0 2023-10-06T04:39:25.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.659+0000 7f985f2b9700 1 -- 172.21.15.112:0/197341018 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f98580633c0 con 0x7f983c066f30 2023-10-06T04:39:25.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.668+0000 7f984d7fa700 1 -- 172.21.15.112:0/197341018 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286879 (secure 0 0 0) 0x7f98580633c0 con 0x7f983c066f30 2023-10-06T04:39:25.673 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:25.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.671+0000 7f985f2b9700 1 -- 172.21.15.112:0/197341018 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f983c066f30 msgr2=0x7f983c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:25.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.671+0000 7f985f2b9700 1 --2- 172.21.15.112:0/197341018 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f983c066f30 0x7f983c0693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f98540099f0 tx=0x7f9854018000 comp rx=0 tx=0).stop 2023-10-06T04:39:25.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.671+0000 7f985f2b9700 1 -- 172.21.15.112:0/197341018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98580cb9f0 msgr2=0x7f98581563d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:25.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.671+0000 7f985f2b9700 1 --2- 172.21.15.112:0/197341018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98580cb9f0 0x7f98581563d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f985000c500 tx=0x7f9850007f60 comp rx=0 tx=0).stop 2023-10-06T04:39:25.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.671+0000 7f985f2b9700 1 -- 172.21.15.112:0/197341018 shutdown_connections 2023-10-06T04:39:25.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.671+0000 7f985f2b9700 1 --2- 172.21.15.112:0/197341018 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f983c066f30 0x7f983c0693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.671+0000 7f985f2b9700 1 --2- 172.21.15.112:0/197341018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98580cb9f0 0x7f98581563d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.671+0000 7f985f2b9700 1 --2- 172.21.15.112:0/197341018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f985806b8b0 0x7f985816cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.671+0000 7f985f2b9700 1 --2- 172.21.15.112:0/197341018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98580cb620 0x7f98580ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.671+0000 7f985f2b9700 1 -- 172.21.15.112:0/197341018 >> 172.21.15.112:0/197341018 conn(0x7f98580ccc40 msgr2=0x7f98581515c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:25.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.671+0000 7f985f2b9700 1 -- 172.21.15.112:0/197341018 shutdown_connections 2023-10-06T04:39:25.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.671+0000 7f985f2b9700 1 -- 172.21.15.112:0/197341018 wait complete. 2023-10-06T04:39:25.677 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-10-06T04:39:25.685 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-06T04:39:24.279109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381076,"kb_used_data":2772,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593644,"statfs":{"total":773094113280,"available":770655891456,"internally_reserved":0,"allocated":2838528,"data_stored":1750903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.659187"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.643644+0000","last_change":"2023-10-06T04:39:21.643644+0000","last_active":"2023-10-06T04:39:21.643644+0000","last_peered":"2023-10-06T04:39:21.643644+0000","last_clean":"2023-10-06T04:39:21.643644+0000","last_became_active":"2023-10-06T04:39:21.643389+0000","last_became_peered":"2023-10-06T04:39:21.643389+0000","last_unstale":"2023-10-06T04:39:21.643644+0000","last_undegraded":"2023-10-06T04:39:21.643644+0000","last_fullsized":"2023-10-06T04:39:21.643644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:14.965914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650050+0000","last_change":"2023-10-06T04:39:21.643603+0000","last_active":"2023-10-06T04:39:21.650050+0000","last_peered":"2023-10-06T04:39:21.650050+0000","last_clean":"2023-10-06T04:39:21.650050+0000","last_became_active":"2023-10-06T04:39:21.643357+0000","last_became_peered":"2023-10-06T04:39:21.643357+0000","last_unstale":"2023-10-06T04:39:21.650050+0000","last_undegraded":"2023-10-06T04:39:21.650050+0000","last_fullsized":"2023-10-06T04:39:21.650050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:15.667787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.659151+0000","last_change":"2023-10-06T04:39:21.656120+0000","last_active":"2023-10-06T04:39:21.659151+0000","last_peered":"2023-10-06T04:39:21.659151+0000","last_clean":"2023-10-06T04:39:21.659151+0000","last_became_active":"2023-10-06T04:39:21.655868+0000","last_became_peered":"2023-10-06T04:39:21.655868+0000","last_unstale":"2023-10-06T04:39:21.659151+0000","last_undegraded":"2023-10-06T04:39:21.659151+0000","last_fullsized":"2023-10-06T04:39:21.659151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:27.287173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651328+0000","last_change":"2023-10-06T04:39:21.647825+0000","last_active":"2023-10-06T04:39:21.651328+0000","last_peered":"2023-10-06T04:39:21.651328+0000","last_clean":"2023-10-06T04:39:21.651328+0000","last_became_active":"2023-10-06T04:39:21.647566+0000","last_became_peered":"2023-10-06T04:39:21.647566+0000","last_unstale":"2023-10-06T04:39:21.651328+0000","last_undegraded":"2023-10-06T04:39:21.651328+0000","last_fullsized":"2023-10-06T04:39:21.651328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:44.939595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656951+0000","last_change":"2023-10-06T04:39:21.656951+0000","last_active":"2023-10-06T04:39:21.656951+0000","last_peered":"2023-10-06T04:39:21.656951+0000","last_clean":"2023-10-06T04:39:21.656951+0000","last_became_active":"2023-10-06T04:39:21.656705+0000","last_became_peered":"2023-10-06T04:39:21.656705+0000","last_unstale":"2023-10-06T04:39:21.656951+0000","last_undegraded":"2023-10-06T04:39:21.656951+0000","last_fullsized":"2023-10-06T04:39:21.656951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:30.052905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656740+0000","last_change":"2023-10-06T04:39:21.651985+0000","last_active":"2023-10-06T04:39:21.656740+0000","last_peered":"2023-10-06T04:39:21.656740+0000","last_clean":"2023-10-06T04:39:21.656740+0000","last_became_active":"2023-10-06T04:39:21.649488+0000","last_became_peered":"2023-10-06T04:39:21.649488+0000","last_unstale":"2023-10-06T04:39:21.656740+0000","last_undegraded":"2023-10-06T04:39:21.656740+0000","last_fullsized":"2023-10-06T04:39:21.656740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:48:03.866418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657637+0000","last_change":"2023-10-06T04:39:21.653127+0000","last_active":"2023-10-06T04:39:21.657637+0000","last_peered":"2023-10-06T04:39:21.657637+0000","last_clean":"2023-10-06T04:39:21.657637+0000","last_became_active":"2023-10-06T04:39:21.652573+0000","last_became_peered":"2023-10-06T04:39:21.652573+0000","last_unstale":"2023-10-06T04:39:21.657637+0000","last_undegraded":"2023-10-06T04:39:21.657637+0000","last_fullsized":"2023-10-06T04:39:21.657637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:02.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654141+0000","last_change":"2023-10-06T04:39:21.651949+0000","last_active":"2023-10-06T04:39:21.654141+0000","last_peered":"2023-10-06T04:39:21.654141+0000","last_clean":"2023-10-06T04:39:21.654141+0000","last_became_active":"2023-10-06T04:39:21.651637+0000","last_became_peered":"2023-10-06T04:39:21.651637+0000","last_unstale":"2023-10-06T04:39:21.654141+0000","last_undegraded":"2023-10-06T04:39:21.654141+0000","last_fullsized":"2023-10-06T04:39:21.654141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:02.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.658016+0000","last_change":"2023-10-06T04:39:21.658016+0000","last_active":"2023-10-06T04:39:21.658016+0000","last_peered":"2023-10-06T04:39:21.658016+0000","last_clean":"2023-10-06T04:39:21.658016+0000","last_became_active":"2023-10-06T04:39:21.657149+0000","last_became_peered":"2023-10-06T04:39:21.657149+0000","last_unstale":"2023-10-06T04:39:21.658016+0000","last_undegraded":"2023-10-06T04:39:21.658016+0000","last_fullsized":"2023-10-06T04:39:21.658016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:53.420342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.658796+0000","last_change":"2023-10-06T04:39:21.656885+0000","last_active":"2023-10-06T04:39:21.658796+0000","last_peered":"2023-10-06T04:39:21.658796+0000","last_clean":"2023-10-06T04:39:21.658796+0000","last_became_active":"2023-10-06T04:39:21.656652+0000","last_became_peered":"2023-10-06T04:39:21.656652+0000","last_unstale":"2023-10-06T04:39:21.658796+0000","last_undegraded":"2023-10-06T04:39:21.658796+0000","last_fullsized":"2023-10-06T04:39:21.658796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:37.183346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656795+0000","last_change":"2023-10-06T04:39:21.652303+0000","last_active":"2023-10-06T04:39:21.656795+0000","last_peered":"2023-10-06T04:39:21.656795+0000","last_clean":"2023-10-06T04:39:21.656795+0000","last_became_active":"2023-10-06T04:39:21.652040+0000","last_became_peered":"2023-10-06T04:39:21.652040+0000","last_unstale":"2023-10-06T04:39:21.656795+0000","last_undegraded":"2023-10-06T04:39:21.656795+0000","last_fullsized":"2023-10-06T04:39:21.656795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:50.708331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.655931+0000","last_change":"2023-10-06T04:39:21.655931+0000","last_active":"2023-10-06T04:39:21.655931+0000","last_peered":"2023-10-06T04:39:21.655931+0000","last_clean":"2023-10-06T04:39:21.655931+0000","last_became_active":"2023-10-06T04:39:21.655663+0000","last_became_peered":"2023-10-06T04:39:21.655663+0000","last_unstale":"2023-10-06T04:39:21.655931+0000","last_undegraded":"2023-10-06T04:39:21.655931+0000","last_fullsized":"2023-10-06T04:39:21.655931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:30:34.663775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.643679+0000","last_change":"2023-10-06T04:39:21.643679+0000","last_active":"2023-10-06T04:39:21.643679+0000","last_peered":"2023-10-06T04:39:21.643679+0000","last_clean":"2023-10-06T04:39:21.643679+0000","last_became_active":"2023-10-06T04:39:21.643341+0000","last_became_peered":"2023-10-06T04:39:21.643341+0000","last_unstale":"2023-10-06T04:39:21.643679+0000","last_undegraded":"2023-10-06T04:39:21.643679+0000","last_fullsized":"2023-10-06T04:39:21.643679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:27.026173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653958+0000","last_change":"2023-10-06T04:39:21.651998+0000","last_active":"2023-10-06T04:39:21.653958+0000","last_peered":"2023-10-06T04:39:21.653958+0000","last_clean":"2023-10-06T04:39:21.653958+0000","last_became_active":"2023-10-06T04:39:21.651702+0000","last_became_peered":"2023-10-06T04:39:21.651702+0000","last_unstale":"2023-10-06T04:39:21.653958+0000","last_undegraded":"2023-10-06T04:39:21.653958+0000","last_fullsized":"2023-10-06T04:39:21.653958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:23.201656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657656+0000","last_change":"2023-10-06T04:39:21.653318+0000","last_active":"2023-10-06T04:39:21.657656+0000","last_peered":"2023-10-06T04:39:21.657656+0000","last_clean":"2023-10-06T04:39:21.657656+0000","last_became_active":"2023-10-06T04:39:21.652877+0000","last_became_peered":"2023-10-06T04:39:21.652877+0000","last_unstale":"2023-10-06T04:39:21.657656+0000","last_undegraded":"2023-10-06T04:39:21.657656+0000","last_fullsized":"2023-10-06T04:39:21.657656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:23.201656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656760+0000","last_change":"2023-10-06T04:39:21.649928+0000","last_active":"2023-10-06T04:39:21.656760+0000","last_peered":"2023-10-06T04:39:21.656760+0000","last_clean":"2023-10-06T04:39:21.656760+0000","last_became_active":"2023-10-06T04:39:21.649638+0000","last_became_peered":"2023-10-06T04:39:21.649638+0000","last_unstale":"2023-10-06T04:39:21.656760+0000","last_undegraded":"2023-10-06T04:39:21.656760+0000","last_fullsized":"2023-10-06T04:39:21.656760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:54.256525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657715+0000","last_change":"2023-10-06T04:39:21.657715+0000","last_active":"2023-10-06T04:39:21.657715+0000","last_peered":"2023-10-06T04:39:21.657715+0000","last_clean":"2023-10-06T04:39:21.657715+0000","last_became_active":"2023-10-06T04:39:21.656464+0000","last_became_peered":"2023-10-06T04:39:21.656464+0000","last_unstale":"2023-10-06T04:39:21.657715+0000","last_undegraded":"2023-10-06T04:39:21.657715+0000","last_fullsized":"2023-10-06T04:39:21.657715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:37.183346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.658960+0000","last_change":"2023-10-06T04:39:21.655935+0000","last_active":"2023-10-06T04:39:21.658960+0000","last_peered":"2023-10-06T04:39:21.658960+0000","last_clean":"2023-10-06T04:39:21.658960+0000","last_became_active":"2023-10-06T04:39:21.655700+0000","last_became_peered":"2023-10-06T04:39:21.655700+0000","last_unstale":"2023-10-06T04:39:21.658960+0000","last_undegraded":"2023-10-06T04:39:21.658960+0000","last_fullsized":"2023-10-06T04:39:21.658960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:30.052905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.642376+0000","last_change":"2023-10-06T04:39:21.642376+0000","last_active":"2023-10-06T04:39:21.642376+0000","last_peered":"2023-10-06T04:39:21.642376+0000","last_clean":"2023-10-06T04:39:21.642376+0000","last_became_active":"2023-10-06T04:39:21.642132+0000","last_became_peered":"2023-10-06T04:39:21.642132+0000","last_unstale":"2023-10-06T04:39:21.642376+0000","last_undegraded":"2023-10-06T04:39:21.642376+0000","last_fullsized":"2023-10-06T04:39:21.642376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:57:07.955415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657008+0000","last_change":"2023-10-06T04:39:21.651106+0000","last_active":"2023-10-06T04:39:21.657008+0000","last_peered":"2023-10-06T04:39:21.657008+0000","last_clean":"2023-10-06T04:39:21.657008+0000","last_became_active":"2023-10-06T04:39:21.650595+0000","last_became_peered":"2023-10-06T04:39:21.650595+0000","last_unstale":"2023-10-06T04:39:21.657008+0000","last_undegraded":"2023-10-06T04:39:21.657008+0000","last_fullsized":"2023-10-06T04:39:21.657008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:39.953564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657675+0000","last_change":"2023-10-06T04:39:21.654113+0000","last_active":"2023-10-06T04:39:21.657675+0000","last_peered":"2023-10-06T04:39:21.657675+0000","last_clean":"2023-10-06T04:39:21.657675+0000","last_became_active":"2023-10-06T04:39:21.653847+0000","last_became_peered":"2023-10-06T04:39:21.653847+0000","last_unstale":"2023-10-06T04:39:21.657675+0000","last_undegraded":"2023-10-06T04:39:21.657675+0000","last_fullsized":"2023-10-06T04:39:21.657675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:37.183346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656316+0000","last_change":"2023-10-06T04:39:21.656316+0000","last_active":"2023-10-06T04:39:21.656316+0000","last_peered":"2023-10-06T04:39:21.656316+0000","last_clean":"2023-10-06T04:39:21.656316+0000","last_became_active":"2023-10-06T04:39:21.655902+0000","last_became_peered":"2023-10-06T04:39:21.655902+0000","last_unstale":"2023-10-06T04:39:21.656316+0000","last_undegraded":"2023-10-06T04:39:21.656316+0000","last_fullsized":"2023-10-06T04:39:21.656316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:23.201656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654941+0000","last_change":"2023-10-06T04:39:21.651840+0000","last_active":"2023-10-06T04:39:21.654941+0000","last_peered":"2023-10-06T04:39:21.654941+0000","last_clean":"2023-10-06T04:39:21.654941+0000","last_became_active":"2023-10-06T04:39:21.651580+0000","last_became_peered":"2023-10-06T04:39:21.651580+0000","last_unstale":"2023-10-06T04:39:21.654941+0000","last_undegraded":"2023-10-06T04:39:21.654941+0000","last_fullsized":"2023-10-06T04:39:21.654941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:56.545180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657569+0000","last_change":"2023-10-06T04:39:21.650621+0000","last_active":"2023-10-06T04:39:21.657569+0000","last_peered":"2023-10-06T04:39:21.657569+0000","last_clean":"2023-10-06T04:39:21.657569+0000","last_became_active":"2023-10-06T04:39:21.650370+0000","last_became_peered":"2023-10-06T04:39:21.650370+0000","last_unstale":"2023-10-06T04:39:21.657569+0000","last_undegraded":"2023-10-06T04:39:21.657569+0000","last_fullsized":"2023-10-06T04:39:21.657569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.886362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649124+0000","last_change":"2023-10-06T04:39:21.649124+0000","last_active":"2023-10-06T04:39:21.649124+0000","last_peered":"2023-10-06T04:39:21.649124+0000","last_clean":"2023-10-06T04:39:21.649124+0000","last_became_active":"2023-10-06T04:39:21.648871+0000","last_became_peered":"2023-10-06T04:39:21.648871+0000","last_unstale":"2023-10-06T04:39:21.649124+0000","last_undegraded":"2023-10-06T04:39:21.649124+0000","last_fullsized":"2023-10-06T04:39:21.649124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:15.667787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.639325+0000","last_change":"2023-10-06T04:39:21.639325+0000","last_active":"2023-10-06T04:39:21.639325+0000","last_peered":"2023-10-06T04:39:21.639325+0000","last_clean":"2023-10-06T04:39:21.639325+0000","last_became_active":"2023-10-06T04:39:21.639068+0000","last_became_peered":"2023-10-06T04:39:21.639068+0000","last_unstale":"2023-10-06T04:39:21.639325+0000","last_undegraded":"2023-10-06T04:39:21.639325+0000","last_fullsized":"2023-10-06T04:39:21.639325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:52.077624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651949+0000","last_change":"2023-10-06T04:39:21.646735+0000","last_active":"2023-10-06T04:39:21.651949+0000","last_peered":"2023-10-06T04:39:21.651949+0000","last_clean":"2023-10-06T04:39:21.651949+0000","last_became_active":"2023-10-06T04:39:21.646325+0000","last_became_peered":"2023-10-06T04:39:21.646325+0000","last_unstale":"2023-10-06T04:39:21.651949+0000","last_undegraded":"2023-10-06T04:39:21.651949+0000","last_fullsized":"2023-10-06T04:39:21.651949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.886362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.652192+0000","last_change":"2023-10-06T04:39:20.642499+0000","last_active":"2023-10-06T04:39:21.652192+0000","last_peered":"2023-10-06T04:39:21.652192+0000","last_clean":"2023-10-06T04:39:21.652192+0000","last_became_active":"2023-10-06T04:39:20.642246+0000","last_became_peered":"2023-10-06T04:39:20.642246+0000","last_unstale":"2023-10-06T04:39:21.652192+0000","last_undegraded":"2023-10-06T04:39:21.652192+0000","last_fullsized":"2023-10-06T04:39:21.652192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.956516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649570+0000","last_change":"2023-10-06T04:39:21.644626+0000","last_active":"2023-10-06T04:39:21.649570+0000","last_peered":"2023-10-06T04:39:21.649570+0000","last_clean":"2023-10-06T04:39:21.649570+0000","last_became_active":"2023-10-06T04:39:21.644333+0000","last_became_peered":"2023-10-06T04:39:21.644333+0000","last_unstale":"2023-10-06T04:39:21.649570+0000","last_undegraded":"2023-10-06T04:39:21.649570+0000","last_fullsized":"2023-10-06T04:39:21.649570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:54.256525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-06T04:39:20.640506+0000","last_change":"2023-10-06T04:39:20.639697+0000","last_active":"2023-10-06T04:39:20.640506+0000","last_peered":"2023-10-06T04:39:20.640506+0000","last_clean":"2023-10-06T04:39:20.640506+0000","last_became_active":"2023-10-06T04:39:20.639431+0000","last_became_peered":"2023-10-06T04:39:20.639431+0000","last_unstale":"2023-10-06T04:39:20.640506+0000","last_undegraded":"2023-10-06T04:39:20.640506+0000","last_fullsized":"2023-10-06T04:39:20.640506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:20.086705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.659222+0000","last_change":"2023-10-06T04:39:21.659222+0000","last_active":"2023-10-06T04:39:21.659222+0000","last_peered":"2023-10-06T04:39:21.659222+0000","last_clean":"2023-10-06T04:39:21.659222+0000","last_became_active":"2023-10-06T04:39:21.659030+0000","last_became_peered":"2023-10-06T04:39:21.659030+0000","last_unstale":"2023-10-06T04:39:21.659222+0000","last_undegraded":"2023-10-06T04:39:21.659222+0000","last_fullsized":"2023-10-06T04:39:21.659222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.886362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.636144+0000","last_change":"2023-10-06T04:39:20.642433+0000","last_active":"2023-10-06T04:39:21.636144+0000","last_peered":"2023-10-06T04:39:21.636144+0000","last_clean":"2023-10-06T04:39:21.636144+0000","last_became_active":"2023-10-06T04:39:20.640984+0000","last_became_peered":"2023-10-06T04:39:20.640984+0000","last_unstale":"2023-10-06T04:39:21.636144+0000","last_undegraded":"2023-10-06T04:39:21.636144+0000","last_fullsized":"2023-10-06T04:39:21.636144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:41.984467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651186+0000","last_change":"2023-10-06T04:39:21.643087+0000","last_active":"2023-10-06T04:39:21.651186+0000","last_peered":"2023-10-06T04:39:21.651186+0000","last_clean":"2023-10-06T04:39:21.651186+0000","last_became_active":"2023-10-06T04:39:21.642825+0000","last_became_peered":"2023-10-06T04:39:21.642825+0000","last_unstale":"2023-10-06T04:39:21.651186+0000","last_undegraded":"2023-10-06T04:39:21.651186+0000","last_fullsized":"2023-10-06T04:39:21.651186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:38.337736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-06T04:39:20.645703+0000","last_change":"2023-10-06T04:39:20.644712+0000","last_active":"2023-10-06T04:39:20.645703+0000","last_peered":"2023-10-06T04:39:20.645703+0000","last_clean":"2023-10-06T04:39:20.645703+0000","last_became_active":"2023-10-06T04:39:20.644415+0000","last_became_peered":"2023-10-06T04:39:20.644415+0000","last_unstale":"2023-10-06T04:39:20.645703+0000","last_undegraded":"2023-10-06T04:39:20.645703+0000","last_fullsized":"2023-10-06T04:39:20.645703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.956516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641262+0000","last_change":"2023-10-06T04:39:21.638794+0000","last_active":"2023-10-06T04:39:21.641262+0000","last_peered":"2023-10-06T04:39:21.641262+0000","last_clean":"2023-10-06T04:39:21.641262+0000","last_became_active":"2023-10-06T04:39:21.638555+0000","last_became_peered":"2023-10-06T04:39:21.638555+0000","last_unstale":"2023-10-06T04:39:21.641262+0000","last_undegraded":"2023-10-06T04:39:21.641262+0000","last_fullsized":"2023-10-06T04:39:21.641262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:48.632302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.639947+0000","last_change":"2023-10-06T04:39:20.643255+0000","last_active":"2023-10-06T04:39:21.639947+0000","last_peered":"2023-10-06T04:39:21.639947+0000","last_clean":"2023-10-06T04:39:21.639947+0000","last_became_active":"2023-10-06T04:39:20.642932+0000","last_became_peered":"2023-10-06T04:39:20.642932+0000","last_unstale":"2023-10-06T04:39:21.639947+0000","last_undegraded":"2023-10-06T04:39:21.639947+0000","last_fullsized":"2023-10-06T04:39:21.639947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:20.086705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649490+0000","last_change":"2023-10-06T04:39:21.643526+0000","last_active":"2023-10-06T04:39:21.649490+0000","last_peered":"2023-10-06T04:39:21.649490+0000","last_clean":"2023-10-06T04:39:21.649490+0000","last_became_active":"2023-10-06T04:39:21.643270+0000","last_became_peered":"2023-10-06T04:39:21.643270+0000","last_unstale":"2023-10-06T04:39:21.649490+0000","last_undegraded":"2023-10-06T04:39:21.649490+0000","last_fullsized":"2023-10-06T04:39:21.649490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:47.582081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654054+0000","last_change":"2023-10-06T04:39:20.647036+0000","last_active":"2023-10-06T04:39:21.654054+0000","last_peered":"2023-10-06T04:39:21.654054+0000","last_clean":"2023-10-06T04:39:21.654054+0000","last_became_active":"2023-10-06T04:39:20.646772+0000","last_became_peered":"2023-10-06T04:39:20.646772+0000","last_unstale":"2023-10-06T04:39:21.654054+0000","last_undegraded":"2023-10-06T04:39:21.654054+0000","last_fullsized":"2023-10-06T04:39:21.654054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:13.508117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.648922+0000","last_change":"2023-10-06T04:39:21.648922+0000","last_active":"2023-10-06T04:39:21.648922+0000","last_peered":"2023-10-06T04:39:21.648922+0000","last_clean":"2023-10-06T04:39:21.648922+0000","last_became_active":"2023-10-06T04:39:21.648665+0000","last_became_peered":"2023-10-06T04:39:21.648665+0000","last_unstale":"2023-10-06T04:39:21.648922+0000","last_undegraded":"2023-10-06T04:39:21.648922+0000","last_fullsized":"2023-10-06T04:39:21.648922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:35:46.706541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.659518+0000","last_change":"2023-10-06T04:39:20.644243+0000","last_active":"2023-10-06T04:39:21.659518+0000","last_peered":"2023-10-06T04:39:21.659518+0000","last_clean":"2023-10-06T04:39:21.659518+0000","last_became_active":"2023-10-06T04:39:20.643934+0000","last_became_peered":"2023-10-06T04:39:20.643934+0000","last_unstale":"2023-10-06T04:39:21.659518+0000","last_undegraded":"2023-10-06T04:39:21.659518+0000","last_fullsized":"2023-10-06T04:39:21.659518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:30:33.654378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653554+0000","last_change":"2023-10-06T04:39:21.641258+0000","last_active":"2023-10-06T04:39:21.653554+0000","last_peered":"2023-10-06T04:39:21.653554+0000","last_clean":"2023-10-06T04:39:21.653554+0000","last_became_active":"2023-10-06T04:39:21.640963+0000","last_became_peered":"2023-10-06T04:39:21.640963+0000","last_unstale":"2023-10-06T04:39:21.653554+0000","last_undegraded":"2023-10-06T04:39:21.653554+0000","last_fullsized":"2023-10-06T04:39:21.653554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:30.317889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656880+0000","last_change":"2023-10-06T04:39:20.649614+0000","last_active":"2023-10-06T04:39:21.656880+0000","last_peered":"2023-10-06T04:39:21.656880+0000","last_clean":"2023-10-06T04:39:21.656880+0000","last_became_active":"2023-10-06T04:39:20.649327+0000","last_became_peered":"2023-10-06T04:39:20.649327+0000","last_unstale":"2023-10-06T04:39:21.656880+0000","last_undegraded":"2023-10-06T04:39:21.656880+0000","last_fullsized":"2023-10-06T04:39:21.656880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:34.104262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649589+0000","last_change":"2023-10-06T04:39:21.644535+0000","last_active":"2023-10-06T04:39:21.649589+0000","last_peered":"2023-10-06T04:39:21.649589+0000","last_clean":"2023-10-06T04:39:21.649589+0000","last_became_active":"2023-10-06T04:39:21.644260+0000","last_became_peered":"2023-10-06T04:39:21.644260+0000","last_unstale":"2023-10-06T04:39:21.649589+0000","last_undegraded":"2023-10-06T04:39:21.649589+0000","last_fullsized":"2023-10-06T04:39:21.649589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:30.052905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-06T04:39:20.644505+0000","last_change":"2023-10-06T04:39:20.641086+0000","last_active":"2023-10-06T04:39:20.644505+0000","last_peered":"2023-10-06T04:39:20.644505+0000","last_clean":"2023-10-06T04:39:20.644505+0000","last_became_active":"2023-10-06T04:39:20.640581+0000","last_became_peered":"2023-10-06T04:39:20.640581+0000","last_unstale":"2023-10-06T04:39:20.644505+0000","last_undegraded":"2023-10-06T04:39:20.644505+0000","last_fullsized":"2023-10-06T04:39:20.644505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:34.035323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651928+0000","last_change":"2023-10-06T04:39:21.646546+0000","last_active":"2023-10-06T04:39:21.651928+0000","last_peered":"2023-10-06T04:39:21.651928+0000","last_clean":"2023-10-06T04:39:21.651928+0000","last_became_active":"2023-10-06T04:39:21.645987+0000","last_became_peered":"2023-10-06T04:39:21.645987+0000","last_unstale":"2023-10-06T04:39:21.651928+0000","last_undegraded":"2023-10-06T04:39:21.651928+0000","last_fullsized":"2023-10-06T04:39:21.651928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:52.077624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641875+0000","last_change":"2023-10-06T04:39:20.648674+0000","last_active":"2023-10-06T04:39:21.641875+0000","last_peered":"2023-10-06T04:39:21.641875+0000","last_clean":"2023-10-06T04:39:21.641875+0000","last_became_active":"2023-10-06T04:39:20.648394+0000","last_became_peered":"2023-10-06T04:39:20.648394+0000","last_unstale":"2023-10-06T04:39:21.641875+0000","last_undegraded":"2023-10-06T04:39:21.641875+0000","last_fullsized":"2023-10-06T04:39:21.641875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:15.387433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656280+0000","last_change":"2023-10-06T04:39:21.656280+0000","last_active":"2023-10-06T04:39:21.656280+0000","last_peered":"2023-10-06T04:39:21.656280+0000","last_clean":"2023-10-06T04:39:21.656280+0000","last_became_active":"2023-10-06T04:39:21.655973+0000","last_became_peered":"2023-10-06T04:39:21.655973+0000","last_unstale":"2023-10-06T04:39:21.656280+0000","last_undegraded":"2023-10-06T04:39:21.656280+0000","last_fullsized":"2023-10-06T04:39:21.656280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:56.545180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650234+0000","last_change":"2023-10-06T04:39:20.641641+0000","last_active":"2023-10-06T04:39:21.650234+0000","last_peered":"2023-10-06T04:39:21.650234+0000","last_clean":"2023-10-06T04:39:21.650234+0000","last_became_active":"2023-10-06T04:39:20.641335+0000","last_became_peered":"2023-10-06T04:39:20.641335+0000","last_unstale":"2023-10-06T04:39:21.650234+0000","last_undegraded":"2023-10-06T04:39:21.650234+0000","last_fullsized":"2023-10-06T04:39:21.650234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.956516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649486+0000","last_change":"2023-10-06T04:39:21.642393+0000","last_active":"2023-10-06T04:39:21.649486+0000","last_peered":"2023-10-06T04:39:21.649486+0000","last_clean":"2023-10-06T04:39:21.649486+0000","last_became_active":"2023-10-06T04:39:21.641909+0000","last_became_peered":"2023-10-06T04:39:21.641909+0000","last_unstale":"2023-10-06T04:39:21.649486+0000","last_undegraded":"2023-10-06T04:39:21.649486+0000","last_fullsized":"2023-10-06T04:39:21.649486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:02.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656881+0000","last_change":"2023-10-06T04:39:20.648860+0000","last_active":"2023-10-06T04:39:21.656881+0000","last_peered":"2023-10-06T04:39:21.656881+0000","last_clean":"2023-10-06T04:39:21.656881+0000","last_became_active":"2023-10-06T04:39:20.648534+0000","last_became_peered":"2023-10-06T04:39:20.648534+0000","last_unstale":"2023-10-06T04:39:21.656881+0000","last_undegraded":"2023-10-06T04:39:21.656881+0000","last_fullsized":"2023-10-06T04:39:21.656881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:02.150888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651553+0000","last_change":"2023-10-06T04:39:21.644510+0000","last_active":"2023-10-06T04:39:21.651553+0000","last_peered":"2023-10-06T04:39:21.651553+0000","last_clean":"2023-10-06T04:39:21.651553+0000","last_became_active":"2023-10-06T04:39:21.644240+0000","last_became_peered":"2023-10-06T04:39:21.644240+0000","last_unstale":"2023-10-06T04:39:21.651553+0000","last_undegraded":"2023-10-06T04:39:21.651553+0000","last_fullsized":"2023-10-06T04:39:21.651553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:51.885986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654601+0000","last_change":"2023-10-06T04:39:20.649002+0000","last_active":"2023-10-06T04:39:21.654601+0000","last_peered":"2023-10-06T04:39:21.654601+0000","last_clean":"2023-10-06T04:39:21.654601+0000","last_became_active":"2023-10-06T04:39:20.648668+0000","last_became_peered":"2023-10-06T04:39:20.648668+0000","last_unstale":"2023-10-06T04:39:21.654601+0000","last_undegraded":"2023-10-06T04:39:21.654601+0000","last_fullsized":"2023-10-06T04:39:21.654601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:37.328339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650007+0000","last_change":"2023-10-06T04:39:21.636412+0000","last_active":"2023-10-06T04:39:21.650007+0000","last_peered":"2023-10-06T04:39:21.650007+0000","last_clean":"2023-10-06T04:39:21.650007+0000","last_became_active":"2023-10-06T04:39:21.636129+0000","last_became_peered":"2023-10-06T04:39:21.636129+0000","last_unstale":"2023-10-06T04:39:21.650007+0000","last_undegraded":"2023-10-06T04:39:21.650007+0000","last_fullsized":"2023-10-06T04:39:21.650007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:23.201656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.652225+0000","last_change":"2023-10-06T04:39:20.644212+0000","last_active":"2023-10-06T04:39:21.652225+0000","last_peered":"2023-10-06T04:39:21.652225+0000","last_clean":"2023-10-06T04:39:21.652225+0000","last_became_active":"2023-10-06T04:39:20.643961+0000","last_became_peered":"2023-10-06T04:39:20.643961+0000","last_unstale":"2023-10-06T04:39:21.652225+0000","last_undegraded":"2023-10-06T04:39:21.652225+0000","last_fullsized":"2023-10-06T04:39:21.652225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:43.930198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650010+0000","last_change":"2023-10-06T04:39:21.641026+0000","last_active":"2023-10-06T04:39:21.650010+0000","last_peered":"2023-10-06T04:39:21.650010+0000","last_clean":"2023-10-06T04:39:21.650010+0000","last_became_active":"2023-10-06T04:39:21.640757+0000","last_became_peered":"2023-10-06T04:39:21.640757+0000","last_unstale":"2023-10-06T04:39:21.650010+0000","last_undegraded":"2023-10-06T04:39:21.650010+0000","last_fullsized":"2023-10-06T04:39:21.650010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:35.113660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.639626+0000","last_change":"2023-10-06T04:39:20.637507+0000","last_active":"2023-10-06T04:39:21.639626+0000","last_peered":"2023-10-06T04:39:21.639626+0000","last_clean":"2023-10-06T04:39:21.639626+0000","last_became_active":"2023-10-06T04:39:20.637209+0000","last_became_peered":"2023-10-06T04:39:20.637209+0000","last_unstale":"2023-10-06T04:39:21.639626+0000","last_undegraded":"2023-10-06T04:39:21.639626+0000","last_fullsized":"2023-10-06T04:39:21.639626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:30:33.654378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.652401+0000","last_change":"2023-10-06T04:39:21.652401+0000","last_active":"2023-10-06T04:39:21.652401+0000","last_peered":"2023-10-06T04:39:21.652401+0000","last_clean":"2023-10-06T04:39:21.652401+0000","last_became_active":"2023-10-06T04:39:21.652150+0000","last_became_peered":"2023-10-06T04:39:21.652150+0000","last_unstale":"2023-10-06T04:39:21.652401+0000","last_undegraded":"2023-10-06T04:39:21.652401+0000","last_fullsized":"2023-10-06T04:39:21.652401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:02.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651501+0000","last_change":"2023-10-06T04:39:20.643661+0000","last_active":"2023-10-06T04:39:21.651501+0000","last_peered":"2023-10-06T04:39:21.651501+0000","last_clean":"2023-10-06T04:39:21.651501+0000","last_became_active":"2023-10-06T04:39:20.643353+0000","last_became_peered":"2023-10-06T04:39:20.643353+0000","last_unstale":"2023-10-06T04:39:21.651501+0000","last_undegraded":"2023-10-06T04:39:21.651501+0000","last_fullsized":"2023-10-06T04:39:21.651501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:37.328339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656988+0000","last_change":"2023-10-06T04:39:21.650918+0000","last_active":"2023-10-06T04:39:21.656988+0000","last_peered":"2023-10-06T04:39:21.656988+0000","last_clean":"2023-10-06T04:39:21.656988+0000","last_became_active":"2023-10-06T04:39:21.650308+0000","last_became_peered":"2023-10-06T04:39:21.650308+0000","last_unstale":"2023-10-06T04:39:21.656988+0000","last_undegraded":"2023-10-06T04:39:21.656988+0000","last_fullsized":"2023-10-06T04:39:21.656988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:54.734766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.631765+0000","last_change":"2023-10-06T04:39:20.643726+0000","last_active":"2023-10-06T04:39:21.631765+0000","last_peered":"2023-10-06T04:39:21.631765+0000","last_clean":"2023-10-06T04:39:21.631765+0000","last_became_active":"2023-10-06T04:39:20.643431+0000","last_became_peered":"2023-10-06T04:39:20.643431+0000","last_unstale":"2023-10-06T04:39:21.631765+0000","last_undegraded":"2023-10-06T04:39:21.631765+0000","last_fullsized":"2023-10-06T04:39:21.631765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:26.016776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.659132+0000","last_change":"2023-10-06T04:39:21.656050+0000","last_active":"2023-10-06T04:39:21.659132+0000","last_peered":"2023-10-06T04:39:21.659132+0000","last_clean":"2023-10-06T04:39:21.659132+0000","last_became_active":"2023-10-06T04:39:21.655770+0000","last_became_peered":"2023-10-06T04:39:21.655770+0000","last_unstale":"2023-10-06T04:39:21.659132+0000","last_undegraded":"2023-10-06T04:39:21.659132+0000","last_fullsized":"2023-10-06T04:39:21.659132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:48.632302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.632742+0000","last_change":"2023-10-06T04:39:20.646573+0000","last_active":"2023-10-06T04:39:21.632742+0000","last_peered":"2023-10-06T04:39:21.632742+0000","last_clean":"2023-10-06T04:39:21.632742+0000","last_became_active":"2023-10-06T04:39:20.646304+0000","last_became_peered":"2023-10-06T04:39:20.646304+0000","last_unstale":"2023-10-06T04:39:21.632742+0000","last_undegraded":"2023-10-06T04:39:21.632742+0000","last_fullsized":"2023-10-06T04:39:21.632742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:34.035323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653927+0000","last_change":"2023-10-06T04:39:21.647116+0000","last_active":"2023-10-06T04:39:21.653927+0000","last_peered":"2023-10-06T04:39:21.653927+0000","last_clean":"2023-10-06T04:39:21.653927+0000","last_became_active":"2023-10-06T04:39:21.646843+0000","last_became_peered":"2023-10-06T04:39:21.646843+0000","last_unstale":"2023-10-06T04:39:21.653927+0000","last_undegraded":"2023-10-06T04:39:21.653927+0000","last_fullsized":"2023-10-06T04:39:21.653927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:44.744728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.636029+0000","last_change":"2023-10-06T04:39:20.643002+0000","last_active":"2023-10-06T04:39:21.636029+0000","last_peered":"2023-10-06T04:39:21.636029+0000","last_clean":"2023-10-06T04:39:21.636029+0000","last_became_active":"2023-10-06T04:39:20.642751+0000","last_became_peered":"2023-10-06T04:39:20.642751+0000","last_unstale":"2023-10-06T04:39:21.636029+0000","last_undegraded":"2023-10-06T04:39:21.636029+0000","last_fullsized":"2023-10-06T04:39:21.636029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:34.035323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.644991+0000","last_change":"2023-10-06T04:39:21.644991+0000","last_active":"2023-10-06T04:39:21.644991+0000","last_peered":"2023-10-06T04:39:21.644991+0000","last_clean":"2023-10-06T04:39:21.644991+0000","last_became_active":"2023-10-06T04:39:21.644463+0000","last_became_peered":"2023-10-06T04:39:21.644463+0000","last_unstale":"2023-10-06T04:39:21.644991+0000","last_undegraded":"2023-10-06T04:39:21.644991+0000","last_fullsized":"2023-10-06T04:39:21.644991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.886362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.646559+0000","last_change":"2023-10-06T04:39:20.644886+0000","last_active":"2023-10-06T04:39:21.646559+0000","last_peered":"2023-10-06T04:39:21.646559+0000","last_clean":"2023-10-06T04:39:21.646559+0000","last_became_active":"2023-10-06T04:39:20.644539+0000","last_became_peered":"2023-10-06T04:39:20.644539+0000","last_unstale":"2023-10-06T04:39:21.646559+0000","last_undegraded":"2023-10-06T04:39:21.646559+0000","last_fullsized":"2023-10-06T04:39:21.646559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.956516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.636207+0000","last_change":"2023-10-06T04:39:16.067723+0000","last_active":"2023-10-06T04:39:21.636207+0000","last_peered":"2023-10-06T04:39:21.636207+0000","last_clean":"2023-10-06T04:39:21.636207+0000","last_became_active":"2023-10-06T04:39:16.067325+0000","last_became_peered":"2023-10-06T04:39:16.067325+0000","last_unstale":"2023-10-06T04:39:21.636207+0000","last_undegraded":"2023-10-06T04:39:21.636207+0000","last_fullsized":"2023-10-06T04:39:21.636207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649652+0000","last_change":"2023-10-06T04:39:21.645095+0000","last_active":"2023-10-06T04:39:21.649652+0000","last_peered":"2023-10-06T04:39:21.649652+0000","last_clean":"2023-10-06T04:39:21.649652+0000","last_became_active":"2023-10-06T04:39:21.643941+0000","last_became_peered":"2023-10-06T04:39:21.643941+0000","last_unstale":"2023-10-06T04:39:21.649652+0000","last_undegraded":"2023-10-06T04:39:21.649652+0000","last_fullsized":"2023-10-06T04:39:21.649652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:37.183346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.636787+0000","last_change":"2023-10-06T04:39:15.592391+0000","last_active":"2023-10-06T04:39:21.636787+0000","last_peered":"2023-10-06T04:39:21.636787+0000","last_clean":"2023-10-06T04:39:21.636787+0000","last_became_active":"2023-10-06T04:39:15.592094+0000","last_became_peered":"2023-10-06T04:39:15.592094+0000","last_unstale":"2023-10-06T04:39:21.636787+0000","last_undegraded":"2023-10-06T04:39:21.636787+0000","last_fullsized":"2023-10-06T04:39:21.636787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.280766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-06T04:39:20.645256+0000","last_change":"2023-10-06T04:39:20.641845+0000","last_active":"2023-10-06T04:39:20.645256+0000","last_peered":"2023-10-06T04:39:20.645256+0000","last_clean":"2023-10-06T04:39:20.645256+0000","last_became_active":"2023-10-06T04:39:20.641582+0000","last_became_peered":"2023-10-06T04:39:20.641582+0000","last_unstale":"2023-10-06T04:39:20.645256+0000","last_undegraded":"2023-10-06T04:39:20.645256+0000","last_fullsized":"2023-10-06T04:39:20.645256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:25.801442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650028+0000","last_change":"2023-10-06T04:39:21.640130+0000","last_active":"2023-10-06T04:39:21.650028+0000","last_peered":"2023-10-06T04:39:21.650028+0000","last_clean":"2023-10-06T04:39:21.650028+0000","last_became_active":"2023-10-06T04:39:21.639874+0000","last_became_peered":"2023-10-06T04:39:21.639874+0000","last_unstale":"2023-10-06T04:39:21.650028+0000","last_undegraded":"2023-10-06T04:39:21.650028+0000","last_fullsized":"2023-10-06T04:39:21.650028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:33.545272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-06T04:39:20.632526+0000","last_change":"2023-10-06T04:39:15.585112+0000","last_active":"2023-10-06T04:39:20.632526+0000","last_peered":"2023-10-06T04:39:20.632526+0000","last_clean":"2023-10-06T04:39:20.632526+0000","last_became_active":"2023-10-06T04:39:15.584853+0000","last_became_peered":"2023-10-06T04:39:15.584853+0000","last_unstale":"2023-10-06T04:39:20.632526+0000","last_undegraded":"2023-10-06T04:39:20.632526+0000","last_fullsized":"2023-10-06T04:39:20.632526+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641467+0000","last_change":"2023-10-06T04:39:15.588017+0000","last_active":"2023-10-06T04:39:21.641467+0000","last_peered":"2023-10-06T04:39:21.641467+0000","last_clean":"2023-10-06T04:39:21.641467+0000","last_became_active":"2023-10-06T04:39:15.586771+0000","last_became_peered":"2023-10-06T04:39:15.586771+0000","last_unstale":"2023-10-06T04:39:21.641467+0000","last_undegraded":"2023-10-06T04:39:21.641467+0000","last_fullsized":"2023-10-06T04:39:21.641467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:35.225282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-06T04:39:20.647172+0000","last_change":"2023-10-06T04:39:20.646203+0000","last_active":"2023-10-06T04:39:20.647172+0000","last_peered":"2023-10-06T04:39:20.647172+0000","last_clean":"2023-10-06T04:39:20.647172+0000","last_became_active":"2023-10-06T04:39:20.645902+0000","last_became_peered":"2023-10-06T04:39:20.645902+0000","last_unstale":"2023-10-06T04:39:20.647172+0000","last_undegraded":"2023-10-06T04:39:20.647172+0000","last_fullsized":"2023-10-06T04:39:20.647172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:26.016776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656264+0000","last_change":"2023-10-06T04:39:21.656264+0000","last_active":"2023-10-06T04:39:21.656264+0000","last_peered":"2023-10-06T04:39:21.656264+0000","last_clean":"2023-10-06T04:39:21.656264+0000","last_became_active":"2023-10-06T04:39:21.655944+0000","last_became_peered":"2023-10-06T04:39:21.655944+0000","last_unstale":"2023-10-06T04:39:21.656264+0000","last_undegraded":"2023-10-06T04:39:21.656264+0000","last_fullsized":"2023-10-06T04:39:21.656264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:47.582081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641321+0000","last_change":"2023-10-06T04:39:16.252521+0000","last_active":"2023-10-06T04:39:21.641321+0000","last_peered":"2023-10-06T04:39:21.641321+0000","last_clean":"2023-10-06T04:39:21.641321+0000","last_became_active":"2023-10-06T04:39:16.252245+0000","last_became_peered":"2023-10-06T04:39:16.252245+0000","last_unstale":"2023-10-06T04:39:21.641321+0000","last_undegraded":"2023-10-06T04:39:21.641321+0000","last_fullsized":"2023-10-06T04:39:21.641321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:17.694713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-06T04:39:20.643610+0000","last_change":"2023-10-06T04:39:20.641992+0000","last_active":"2023-10-06T04:39:20.643610+0000","last_peered":"2023-10-06T04:39:20.643610+0000","last_clean":"2023-10-06T04:39:20.643610+0000","last_became_active":"2023-10-06T04:39:20.641741+0000","last_became_peered":"2023-10-06T04:39:20.641741+0000","last_unstale":"2023-10-06T04:39:20.643610+0000","last_undegraded":"2023-10-06T04:39:20.643610+0000","last_fullsized":"2023-10-06T04:39:20.643610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:26.016776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.645153+0000","last_change":"2023-10-06T04:39:21.645153+0000","last_active":"2023-10-06T04:39:21.645153+0000","last_peered":"2023-10-06T04:39:21.645153+0000","last_clean":"2023-10-06T04:39:21.645153+0000","last_became_active":"2023-10-06T04:39:21.644766+0000","last_became_peered":"2023-10-06T04:39:21.644766+0000","last_unstale":"2023-10-06T04:39:21.645153+0000","last_undegraded":"2023-10-06T04:39:21.645153+0000","last_fullsized":"2023-10-06T04:39:21.645153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:40.720886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.640765+0000","last_change":"2023-10-06T04:39:16.252493+0000","last_active":"2023-10-06T04:39:21.640765+0000","last_peered":"2023-10-06T04:39:21.640765+0000","last_clean":"2023-10-06T04:39:21.640765+0000","last_became_active":"2023-10-06T04:39:16.252190+0000","last_became_peered":"2023-10-06T04:39:16.252190+0000","last_unstale":"2023-10-06T04:39:21.640765+0000","last_undegraded":"2023-10-06T04:39:21.640765+0000","last_fullsized":"2023-10-06T04:39:21.640765+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:59.554724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.636098+0000","last_change":"2023-10-06T04:39:20.639854+0000","last_active":"2023-10-06T04:39:21.636098+0000","last_peered":"2023-10-06T04:39:21.636098+0000","last_clean":"2023-10-06T04:39:21.636098+0000","last_became_active":"2023-10-06T04:39:20.639584+0000","last_became_peered":"2023-10-06T04:39:20.639584+0000","last_unstale":"2023-10-06T04:39:21.636098+0000","last_undegraded":"2023-10-06T04:39:21.636098+0000","last_fullsized":"2023-10-06T04:39:21.636098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:02.150888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656202+0000","last_change":"2023-10-06T04:39:21.653017+0000","last_active":"2023-10-06T04:39:21.656202+0000","last_peered":"2023-10-06T04:39:21.656202+0000","last_clean":"2023-10-06T04:39:21.656202+0000","last_became_active":"2023-10-06T04:39:21.652754+0000","last_became_peered":"2023-10-06T04:39:21.652754+0000","last_unstale":"2023-10-06T04:39:21.656202+0000","last_undegraded":"2023-10-06T04:39:21.656202+0000","last_fullsized":"2023-10-06T04:39:21.656202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:40.720886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.639474+0000","last_change":"2023-10-06T04:39:16.252554+0000","last_active":"2023-10-06T04:39:21.639474+0000","last_peered":"2023-10-06T04:39:21.639474+0000","last_clean":"2023-10-06T04:39:21.639474+0000","last_became_active":"2023-10-06T04:39:16.252225+0000","last_became_peered":"2023-10-06T04:39:16.252225+0000","last_unstale":"2023-10-06T04:39:21.639474+0000","last_undegraded":"2023-10-06T04:39:21.639474+0000","last_fullsized":"2023-10-06T04:39:21.639474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.280766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.633085+0000","last_change":"2023-10-06T04:39:20.644016+0000","last_active":"2023-10-06T04:39:21.633085+0000","last_peered":"2023-10-06T04:39:21.633085+0000","last_clean":"2023-10-06T04:39:21.633085+0000","last_became_active":"2023-10-06T04:39:20.643732+0000","last_became_peered":"2023-10-06T04:39:20.643732+0000","last_unstale":"2023-10-06T04:39:21.633085+0000","last_undegraded":"2023-10-06T04:39:21.633085+0000","last_fullsized":"2023-10-06T04:39:21.633085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:25.801442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.638573+0000","last_change":"2023-10-06T04:39:21.638573+0000","last_active":"2023-10-06T04:39:21.638573+0000","last_peered":"2023-10-06T04:39:21.638573+0000","last_clean":"2023-10-06T04:39:21.638573+0000","last_became_active":"2023-10-06T04:39:21.638300+0000","last_became_peered":"2023-10-06T04:39:21.638300+0000","last_unstale":"2023-10-06T04:39:21.638573+0000","last_undegraded":"2023-10-06T04:39:21.638573+0000","last_fullsized":"2023-10-06T04:39:21.638573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:23.201656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.630974+0000","last_change":"2023-10-06T04:39:16.253021+0000","last_active":"2023-10-06T04:39:21.630974+0000","last_peered":"2023-10-06T04:39:21.630974+0000","last_clean":"2023-10-06T04:39:21.630974+0000","last_became_active":"2023-10-06T04:39:16.252478+0000","last_became_peered":"2023-10-06T04:39:16.252478+0000","last_unstale":"2023-10-06T04:39:21.630974+0000","last_undegraded":"2023-10-06T04:39:21.630974+0000","last_fullsized":"2023-10-06T04:39:21.630974+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:07.439434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-06T04:39:20.643946+0000","last_change":"2023-10-06T04:39:20.642608+0000","last_active":"2023-10-06T04:39:20.643946+0000","last_peered":"2023-10-06T04:39:20.643946+0000","last_clean":"2023-10-06T04:39:20.643946+0000","last_became_active":"2023-10-06T04:39:20.642287+0000","last_became_peered":"2023-10-06T04:39:20.642287+0000","last_unstale":"2023-10-06T04:39:20.643946+0000","last_undegraded":"2023-10-06T04:39:20.643946+0000","last_fullsized":"2023-10-06T04:39:20.643946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.956516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656717+0000","last_change":"2023-10-06T04:39:21.656717+0000","last_active":"2023-10-06T04:39:21.656717+0000","last_peered":"2023-10-06T04:39:21.656717+0000","last_clean":"2023-10-06T04:39:21.656717+0000","last_became_active":"2023-10-06T04:39:21.656373+0000","last_became_peered":"2023-10-06T04:39:21.656373+0000","last_unstale":"2023-10-06T04:39:21.656717+0000","last_undegraded":"2023-10-06T04:39:21.656717+0000","last_fullsized":"2023-10-06T04:39:21.656717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:51.885986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.630765+0000","last_change":"2023-10-06T04:39:15.587681+0000","last_active":"2023-10-06T04:39:21.630765+0000","last_peered":"2023-10-06T04:39:21.630765+0000","last_clean":"2023-10-06T04:39:21.630765+0000","last_became_active":"2023-10-06T04:39:15.587313+0000","last_became_peered":"2023-10-06T04:39:15.587313+0000","last_unstale":"2023-10-06T04:39:21.630765+0000","last_undegraded":"2023-10-06T04:39:21.630765+0000","last_fullsized":"2023-10-06T04:39:21.630765+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641010+0000","last_change":"2023-10-06T04:39:20.640831+0000","last_active":"2023-10-06T04:39:21.641010+0000","last_peered":"2023-10-06T04:39:21.641010+0000","last_clean":"2023-10-06T04:39:21.641010+0000","last_became_active":"2023-10-06T04:39:20.640545+0000","last_became_peered":"2023-10-06T04:39:20.640545+0000","last_unstale":"2023-10-06T04:39:21.641010+0000","last_undegraded":"2023-10-06T04:39:21.641010+0000","last_fullsized":"2023-10-06T04:39:21.641010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:41.984467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.644674+0000","last_change":"2023-10-06T04:39:21.644674+0000","last_active":"2023-10-06T04:39:21.644674+0000","last_peered":"2023-10-06T04:39:21.644674+0000","last_clean":"2023-10-06T04:39:21.644674+0000","last_became_active":"2023-10-06T04:39:21.644407+0000","last_became_peered":"2023-10-06T04:39:21.644407+0000","last_unstale":"2023-10-06T04:39:21.644674+0000","last_undegraded":"2023-10-06T04:39:21.644674+0000","last_fullsized":"2023-10-06T04:39:21.644674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:44.939595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.643379+0000","last_change":"2023-10-06T04:39:20.646257+0000","last_active":"2023-10-06T04:39:21.643379+0000","last_peered":"2023-10-06T04:39:21.643379+0000","last_clean":"2023-10-06T04:39:21.643379+0000","last_became_active":"2023-10-06T04:39:20.645914+0000","last_became_peered":"2023-10-06T04:39:20.645914+0000","last_unstale":"2023-10-06T04:39:21.643379+0000","last_undegraded":"2023-10-06T04:39:21.643379+0000","last_fullsized":"2023-10-06T04:39:21.643379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:20.086705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.638557+0000","last_change":"2023-10-06T04:39:21.638557+0000","last_active":"2023-10-06T04:39:21.638557+0000","last_peered":"2023-10-06T04:39:21.638557+0000","last_clean":"2023-10-06T04:39:21.638557+0000","last_became_active":"2023-10-06T04:39:21.638310+0000","last_became_peered":"2023-10-06T04:39:21.638310+0000","last_unstale":"2023-10-06T04:39:21.638557+0000","last_undegraded":"2023-10-06T04:39:21.638557+0000","last_fullsized":"2023-10-06T04:39:21.638557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:26.810840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654092+0000","last_change":"2023-10-06T04:39:20.639506+0000","last_active":"2023-10-06T04:39:21.654092+0000","last_peered":"2023-10-06T04:39:21.654092+0000","last_clean":"2023-10-06T04:39:21.654092+0000","last_became_active":"2023-10-06T04:39:20.639218+0000","last_became_peered":"2023-10-06T04:39:20.639218+0000","last_unstale":"2023-10-06T04:39:21.654092+0000","last_undegraded":"2023-10-06T04:39:21.654092+0000","last_fullsized":"2023-10-06T04:39:21.654092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:34.035323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653773+0000","last_change":"2023-10-06T04:39:21.642939+0000","last_active":"2023-10-06T04:39:21.653773+0000","last_peered":"2023-10-06T04:39:21.653773+0000","last_clean":"2023-10-06T04:39:21.653773+0000","last_became_active":"2023-10-06T04:39:21.642669+0000","last_became_peered":"2023-10-06T04:39:21.642669+0000","last_unstale":"2023-10-06T04:39:21.653773+0000","last_undegraded":"2023-10-06T04:39:21.653773+0000","last_fullsized":"2023-10-06T04:39:21.653773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:35.969836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654879+0000","last_change":"2023-10-06T04:39:20.642036+0000","last_active":"2023-10-06T04:39:21.654879+0000","last_peered":"2023-10-06T04:39:21.654879+0000","last_clean":"2023-10-06T04:39:21.654879+0000","last_became_active":"2023-10-06T04:39:20.641779+0000","last_became_peered":"2023-10-06T04:39:20.641779+0000","last_unstale":"2023-10-06T04:39:21.654879+0000","last_undegraded":"2023-10-06T04:39:21.654879+0000","last_fullsized":"2023-10-06T04:39:21.654879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:25.801442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653650+0000","last_change":"2023-10-06T04:39:21.642305+0000","last_active":"2023-10-06T04:39:21.653650+0000","last_peered":"2023-10-06T04:39:21.653650+0000","last_clean":"2023-10-06T04:39:21.653650+0000","last_became_active":"2023-10-06T04:39:21.642047+0000","last_became_peered":"2023-10-06T04:39:21.642047+0000","last_unstale":"2023-10-06T04:39:21.653650+0000","last_undegraded":"2023-10-06T04:39:21.653650+0000","last_fullsized":"2023-10-06T04:39:21.653650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:46.146563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.645322+0000","last_change":"2023-10-06T04:39:20.638812+0000","last_active":"2023-10-06T04:39:21.645322+0000","last_peered":"2023-10-06T04:39:21.645322+0000","last_clean":"2023-10-06T04:39:21.645322+0000","last_became_active":"2023-10-06T04:39:20.638433+0000","last_became_peered":"2023-10-06T04:39:20.638433+0000","last_unstale":"2023-10-06T04:39:21.645322+0000","last_undegraded":"2023-10-06T04:39:21.645322+0000","last_fullsized":"2023-10-06T04:39:21.645322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:25.801442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641299+0000","last_change":"2023-10-06T04:39:21.639406+0000","last_active":"2023-10-06T04:39:21.641299+0000","last_peered":"2023-10-06T04:39:21.641299+0000","last_clean":"2023-10-06T04:39:21.641299+0000","last_became_active":"2023-10-06T04:39:21.639016+0000","last_became_peered":"2023-10-06T04:39:21.639016+0000","last_unstale":"2023-10-06T04:39:21.641299+0000","last_undegraded":"2023-10-06T04:39:21.641299+0000","last_fullsized":"2023-10-06T04:39:21.641299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:33.545272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656802+0000","last_change":"2023-10-06T04:39:20.644648+0000","last_active":"2023-10-06T04:39:21.656802+0000","last_peered":"2023-10-06T04:39:21.656802+0000","last_clean":"2023-10-06T04:39:21.656802+0000","last_became_active":"2023-10-06T04:39:20.644394+0000","last_became_peered":"2023-10-06T04:39:20.644394+0000","last_unstale":"2023-10-06T04:39:21.656802+0000","last_undegraded":"2023-10-06T04:39:21.656802+0000","last_fullsized":"2023-10-06T04:39:21.656802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:30:33.654378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653532+0000","last_change":"2023-10-06T04:39:21.641164+0000","last_active":"2023-10-06T04:39:21.653532+0000","last_peered":"2023-10-06T04:39:21.653532+0000","last_clean":"2023-10-06T04:39:21.653532+0000","last_became_active":"2023-10-06T04:39:21.640905+0000","last_became_peered":"2023-10-06T04:39:21.640905+0000","last_unstale":"2023-10-06T04:39:21.653532+0000","last_undegraded":"2023-10-06T04:39:21.653532+0000","last_fullsized":"2023-10-06T04:39:21.653532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:08.780680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650176+0000","last_change":"2023-10-06T04:39:21.640076+0000","last_active":"2023-10-06T04:39:21.650176+0000","last_peered":"2023-10-06T04:39:21.650176+0000","last_clean":"2023-10-06T04:39:21.650176+0000","last_became_active":"2023-10-06T04:39:21.639818+0000","last_became_peered":"2023-10-06T04:39:21.639818+0000","last_unstale":"2023-10-06T04:39:21.650176+0000","last_undegraded":"2023-10-06T04:39:21.650176+0000","last_fullsized":"2023-10-06T04:39:21.650176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:14.517515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641319+0000","last_change":"2023-10-06T04:39:21.639647+0000","last_active":"2023-10-06T04:39:21.641319+0000","last_peered":"2023-10-06T04:39:21.641319+0000","last_clean":"2023-10-06T04:39:21.641319+0000","last_became_active":"2023-10-06T04:39:21.639337+0000","last_became_peered":"2023-10-06T04:39:21.639337+0000","last_unstale":"2023-10-06T04:39:21.641319+0000","last_undegraded":"2023-10-06T04:39:21.641319+0000","last_fullsized":"2023-10-06T04:39:21.641319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:50.708331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653972+0000","last_change":"2023-10-06T04:39:21.647332+0000","last_active":"2023-10-06T04:39:21.653972+0000","last_peered":"2023-10-06T04:39:21.653972+0000","last_clean":"2023-10-06T04:39:21.653972+0000","last_became_active":"2023-10-06T04:39:21.647076+0000","last_became_peered":"2023-10-06T04:39:21.647076+0000","last_unstale":"2023-10-06T04:39:21.653972+0000","last_undegraded":"2023-10-06T04:39:21.653972+0000","last_fullsized":"2023-10-06T04:39:21.653972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:31.156663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653564+0000","last_change":"2023-10-06T04:39:21.647332+0000","last_active":"2023-10-06T04:39:21.653564+0000","last_peered":"2023-10-06T04:39:21.653564+0000","last_clean":"2023-10-06T04:39:21.653564+0000","last_became_active":"2023-10-06T04:39:21.647082+0000","last_became_peered":"2023-10-06T04:39:21.647082+0000","last_unstale":"2023-10-06T04:39:21.653564+0000","last_undegraded":"2023-10-06T04:39:21.653564+0000","last_fullsized":"2023-10-06T04:39:21.653564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:53.420342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.646732+0000","last_change":"2023-10-06T04:39:21.646732+0000","last_active":"2023-10-06T04:39:21.646732+0000","last_peered":"2023-10-06T04:39:21.646732+0000","last_clean":"2023-10-06T04:39:21.646732+0000","last_became_active":"2023-10-06T04:39:21.646482+0000","last_became_peered":"2023-10-06T04:39:21.646482+0000","last_unstale":"2023-10-06T04:39:21.646732+0000","last_undegraded":"2023-10-06T04:39:21.646732+0000","last_fullsized":"2023-10-06T04:39:21.646732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:51.885986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":74184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073784,"statfs":{"total":96636764160,"available":96331554816,"internally_reserved":0,"allocated":786432,"data_stored":657911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":196608,"data_stored":68097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":192512,"data_stored":67543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":74274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":196608,"data_stored":66814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:39:25.693 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:39:25.707 INFO:tasks.ceph.mds.d.smithi179.stderr:2023-10-06T04:39:25.705+0000 7f4d9410b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:39:25.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.839+0000 7f1fd9ec7700 1 Processor -- start 2023-10-06T04:39:25.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.839+0000 7f1fd9ec7700 1 -- start start 2023-10-06T04:39:25.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.840+0000 7f1fd9ec7700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1fd40cd8c0 0x7f1fd406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:25.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.840+0000 7f1fd9ec7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1fd415a970 0x7f1fd4159850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:25.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.840+0000 7f1fd9ec7700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd406e280 con 0x7f1fd40c3370 2023-10-06T04:39:25.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.840+0000 7f1fd9ec7700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd4159e90 con 0x7f1fd415a970 2023-10-06T04:39:25.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.840+0000 7f1fd9ec7700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd415a170 con 0x7f1fd40cd8c0 2023-10-06T04:39:25.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.840+0000 7f1fd96c6700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1fd415a970 0x7f1fd4159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:25.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.840+0000 7f1fcbfff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1fd40c3370 0x7f1fd4159140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54720/0 (socket says 172.21.15.112:54720) 2023-10-06T04:39:25.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.840+0000 7f1fd96c6700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1fd415a970 0x7f1fd4159850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51158/0 (socket says 172.21.15.112:51158) 2023-10-06T04:39:25.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.840+0000 7f1fcbfff700 1 -- 172.21.15.112:0/2990294895 learned_addr learned my addr 172.21.15.112:0/2990294895 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:25.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.840+0000 7f1fd96c6700 1 -- 172.21.15.112:0/2990294895 >> v2:172.21.15.179:3300/0 conn(0x7f1fd40cd8c0 msgr2=0x7f1fd406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:25.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.840+0000 7f1fd8ec5700 1 --2- 172.21.15.112:0/2990294895 >> v2:172.21.15.179:3300/0 conn(0x7f1fd40cd8c0 0x7f1fd406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:25.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.840+0000 7f1fd96c6700 1 --2- 172.21.15.112:0/2990294895 >> v2:172.21.15.179:3300/0 conn(0x7f1fd40cd8c0 0x7f1fd406d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.840+0000 7f1fcb7fe700 1 -- 172.21.15.112:0/2990294895 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930625973 0 0) 0x7f1fd406e280 con 0x7f1fd40c3370 2023-10-06T04:39:25.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.840+0000 7f1fd96c6700 1 -- 172.21.15.112:0/2990294895 >> v1:172.21.15.112:6789/0 conn(0x7f1fd40c3370 legacy=0x7f1fd4159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:25.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.840+0000 7f1fd96c6700 1 -- 172.21.15.112:0/2990294895 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd415a450 con 0x7f1fd415a970 2023-10-06T04:39:25.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.840+0000 7f1fd8ec5700 1 --2- 172.21.15.112:0/2990294895 >> v2:172.21.15.179:3300/0 conn(0x7f1fd40cd8c0 0x7f1fd406d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:25.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.841+0000 7f1fd96c6700 1 --2- 172.21.15.112:0/2990294895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fd415a970 0x7f1fd4159850 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1fd406b910 tx=0x7f1fcc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f7bb10a859957 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:25.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.841+0000 7f1fcb7fe700 1 -- 172.21.15.112:0/2990294895 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc00b6b0 con 0x7f1fd415a970 2023-10-06T04:39:25.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.841+0000 7f1fcb7fe700 1 -- 172.21.15.112:0/2990294895 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc00b810 con 0x7f1fd415a970 2023-10-06T04:39:25.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.841+0000 7f1fcb7fe700 1 -- 172.21.15.112:0/2990294895 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc00bbb0 con 0x7f1fd415a970 2023-10-06T04:39:25.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.841+0000 7f1fd9ec7700 1 -- 172.21.15.112:0/2990294895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fd415a970 msgr2=0x7f1fd4159850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:25.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.841+0000 7f1fd9ec7700 1 --2- 172.21.15.112:0/2990294895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fd415a970 0x7f1fd4159850 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1fd406b910 tx=0x7f1fcc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.841+0000 7f1fd9ec7700 1 -- 172.21.15.112:0/2990294895 shutdown_connections 2023-10-06T04:39:25.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.841+0000 7f1fd9ec7700 1 --2- 172.21.15.112:0/2990294895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fd415a970 0x7f1fd4159850 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.841+0000 7f1fd9ec7700 1 --2- 172.21.15.112:0/2990294895 >> v2:172.21.15.179:3300/0 conn(0x7f1fd40cd8c0 0x7f1fd406d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.841+0000 7f1fd9ec7700 1 -- 172.21.15.112:0/2990294895 >> 172.21.15.112:0/2990294895 conn(0x7f1fd4068050 msgr2=0x7f1fd4068450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:25.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.841+0000 7f1fd9ec7700 1 -- 172.21.15.112:0/2990294895 shutdown_connections 2023-10-06T04:39:25.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.841+0000 7f1fd9ec7700 1 -- 172.21.15.112:0/2990294895 wait complete. 2023-10-06T04:39:25.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.842+0000 7f1fd9ec7700 1 Processor -- start 2023-10-06T04:39:25.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.842+0000 7f1fd9ec7700 1 -- start start 2023-10-06T04:39:25.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.843+0000 7f1fd9ec7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fd40c3370 0x7f1fd415c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:25.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.843+0000 7f1fd9ec7700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fd40cd8c0 0x7f1fd40b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:25.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.843+0000 7f1fd9ec7700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fd415a970 0x7f1fd4146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:25.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.843+0000 7f1fd9ec7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd415bee0 con 0x7f1fd40c3370 2023-10-06T04:39:25.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.843+0000 7f1fd9ec7700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd415b2d0 con 0x7f1fd40cd8c0 2023-10-06T04:39:25.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.843+0000 7f1fd9ec7700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd415b5b0 con 0x7f1fd415a970 2023-10-06T04:39:25.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.843+0000 7f1fd8ec5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fd40c3370 0x7f1fd415c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:25.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.843+0000 7f1fd8ec5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fd40c3370 0x7f1fd415c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51174/0 (socket says 172.21.15.112:51174) 2023-10-06T04:39:25.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.843+0000 7f1fd8ec5700 1 -- 172.21.15.112:0/2142636448 learned_addr learned my addr 172.21.15.112:0/2142636448 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:25.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.843+0000 7f1fcbfff700 1 --2- 172.21.15.112:0/2142636448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fd40cd8c0 0x7f1fd40b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:25.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.843+0000 7f1fd96c6700 1 --2- 172.21.15.112:0/2142636448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fd415a970 0x7f1fd4146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:25.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.844+0000 7f1fd8ec5700 1 -- 172.21.15.112:0/2142636448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fd415a970 msgr2=0x7f1fd4146e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:25.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.844+0000 7f1fd8ec5700 1 --2- 172.21.15.112:0/2142636448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fd415a970 0x7f1fd4146e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.844+0000 7f1fd8ec5700 1 -- 172.21.15.112:0/2142636448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fd40cd8c0 msgr2=0x7f1fd40b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:25.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.844+0000 7f1fd8ec5700 1 --2- 172.21.15.112:0/2142636448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fd40cd8c0 0x7f1fd40b3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:25.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.844+0000 7f1fd8ec5700 1 -- 172.21.15.112:0/2142636448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc009420 con 0x7f1fd40c3370 2023-10-06T04:39:25.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.844+0000 7f1fcbfff700 1 --2- 172.21.15.112:0/2142636448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fd40cd8c0 0x7f1fd40b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:25.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.844+0000 7f1fd8ec5700 1 --2- 172.21.15.112:0/2142636448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fd40c3370 0x7f1fd415c370 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000a400 tx=0x7f1fd0007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:25.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.844+0000 7f1fc8ff9700 1 -- 172.21.15.112:0/2142636448 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd000d650 con 0x7f1fd40c3370 2023-10-06T04:39:25.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.844+0000 7f1fc8ff9700 1 -- 172.21.15.112:0/2142636448 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd000d7b0 con 0x7f1fd40c3370 2023-10-06T04:39:25.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.844+0000 7f1fd9ec7700 1 -- 172.21.15.112:0/2142636448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd415b890 con 0x7f1fd40c3370 2023-10-06T04:39:25.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.844+0000 7f1fc8ff9700 1 -- 172.21.15.112:0/2142636448 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd000db50 con 0x7f1fd40c3370 2023-10-06T04:39:25.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.844+0000 7f1fd9ec7700 1 -- 172.21.15.112:0/2142636448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd4147360 con 0x7f1fd40c3370 2023-10-06T04:39:25.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.845+0000 7f1fd9ec7700 1 -- 172.21.15.112:0/2142636448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd415c1c0 con 0x7f1fd40c3370 2023-10-06T04:39:25.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.845+0000 7f1fc8ff9700 1 -- 172.21.15.112:0/2142636448 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1fd0015440 con 0x7f1fd40c3370 2023-10-06T04:39:25.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.846+0000 7f1fc8ff9700 1 --2- 172.21.15.112:0/2142636448 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1fc0066f30 0x7f1fc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:25.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.846+0000 7f1fc8ff9700 1 -- 172.21.15.112:0/2142636448 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1fd0084f40 con 0x7f1fd40c3370 2023-10-06T04:39:25.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.846+0000 7f1fcbfff700 1 --2- 172.21.15.112:0/2142636448 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1fc0066f30 0x7f1fc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:25.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.846+0000 7f1fcbfff700 1 --2- 172.21.15.112:0/2142636448 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1fc0066f30 0x7f1fc00693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40b45e0 tx=0x7f1fc4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:25.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:25.850+0000 7f1fc8ff9700 1 -- 172.21.15.112:0/2142636448 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1fd004e5a0 con 0x7f1fd40c3370 2023-10-06T04:39:26.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.028+0000 7f1fd9ec7700 1 -- 172.21.15.112:0/2142636448 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1fd415c020 con 0x7f1fc0066f30 2023-10-06T04:39:26.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.035+0000 7f1fc8ff9700 1 -- 172.21.15.112:0/2142636448 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286879 (secure 0 0 0) 0x7f1fc40058a0 con 0x7f1fc0066f30 2023-10-06T04:39:26.039 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:26.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.038+0000 7f1fd9ec7700 1 -- 172.21.15.112:0/2142636448 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1fc0066f30 msgr2=0x7f1fc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.038+0000 7f1fd9ec7700 1 --2- 172.21.15.112:0/2142636448 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1fc0066f30 0x7f1fc00693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40b45e0 tx=0x7f1fc4009040 comp rx=0 tx=0).stop 2023-10-06T04:39:26.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.038+0000 7f1fd9ec7700 1 -- 172.21.15.112:0/2142636448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fd40c3370 msgr2=0x7f1fd415c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.038+0000 7f1fd9ec7700 1 --2- 172.21.15.112:0/2142636448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fd40c3370 0x7f1fd415c370 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000a400 tx=0x7f1fd0007910 comp rx=0 tx=0).stop 2023-10-06T04:39:26.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.038+0000 7f1fd9ec7700 1 -- 172.21.15.112:0/2142636448 shutdown_connections 2023-10-06T04:39:26.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.038+0000 7f1fd9ec7700 1 --2- 172.21.15.112:0/2142636448 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1fc0066f30 0x7f1fc00693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.038+0000 7f1fd9ec7700 1 --2- 172.21.15.112:0/2142636448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fd415a970 0x7f1fd4146e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.038+0000 7f1fd9ec7700 1 --2- 172.21.15.112:0/2142636448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fd40c3370 0x7f1fd415c370 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.038+0000 7f1fd9ec7700 1 --2- 172.21.15.112:0/2142636448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fd40cd8c0 0x7f1fd40b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.038+0000 7f1fd9ec7700 1 -- 172.21.15.112:0/2142636448 >> 172.21.15.112:0/2142636448 conn(0x7f1fd4068050 msgr2=0x7f1fd4152840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:26.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.039+0000 7f1fd9ec7700 1 -- 172.21.15.112:0/2142636448 shutdown_connections 2023-10-06T04:39:26.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.039+0000 7f1fd9ec7700 1 -- 172.21.15.112:0/2142636448 wait complete. 2023-10-06T04:39:26.043 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-10-06T04:39:26.051 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-06T04:39:24.279109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381076,"kb_used_data":2772,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593644,"statfs":{"total":773094113280,"available":770655891456,"internally_reserved":0,"allocated":2838528,"data_stored":1750903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.659187"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.643644+0000","last_change":"2023-10-06T04:39:21.643644+0000","last_active":"2023-10-06T04:39:21.643644+0000","last_peered":"2023-10-06T04:39:21.643644+0000","last_clean":"2023-10-06T04:39:21.643644+0000","last_became_active":"2023-10-06T04:39:21.643389+0000","last_became_peered":"2023-10-06T04:39:21.643389+0000","last_unstale":"2023-10-06T04:39:21.643644+0000","last_undegraded":"2023-10-06T04:39:21.643644+0000","last_fullsized":"2023-10-06T04:39:21.643644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:14.965914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650050+0000","last_change":"2023-10-06T04:39:21.643603+0000","last_active":"2023-10-06T04:39:21.650050+0000","last_peered":"2023-10-06T04:39:21.650050+0000","last_clean":"2023-10-06T04:39:21.650050+0000","last_became_active":"2023-10-06T04:39:21.643357+0000","last_became_peered":"2023-10-06T04:39:21.643357+0000","last_unstale":"2023-10-06T04:39:21.650050+0000","last_undegraded":"2023-10-06T04:39:21.650050+0000","last_fullsized":"2023-10-06T04:39:21.650050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:15.667787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.659151+0000","last_change":"2023-10-06T04:39:21.656120+0000","last_active":"2023-10-06T04:39:21.659151+0000","last_peered":"2023-10-06T04:39:21.659151+0000","last_clean":"2023-10-06T04:39:21.659151+0000","last_became_active":"2023-10-06T04:39:21.655868+0000","last_became_peered":"2023-10-06T04:39:21.655868+0000","last_unstale":"2023-10-06T04:39:21.659151+0000","last_undegraded":"2023-10-06T04:39:21.659151+0000","last_fullsized":"2023-10-06T04:39:21.659151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:27.287173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651328+0000","last_change":"2023-10-06T04:39:21.647825+0000","last_active":"2023-10-06T04:39:21.651328+0000","last_peered":"2023-10-06T04:39:21.651328+0000","last_clean":"2023-10-06T04:39:21.651328+0000","last_became_active":"2023-10-06T04:39:21.647566+0000","last_became_peered":"2023-10-06T04:39:21.647566+0000","last_unstale":"2023-10-06T04:39:21.651328+0000","last_undegraded":"2023-10-06T04:39:21.651328+0000","last_fullsized":"2023-10-06T04:39:21.651328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:44.939595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656951+0000","last_change":"2023-10-06T04:39:21.656951+0000","last_active":"2023-10-06T04:39:21.656951+0000","last_peered":"2023-10-06T04:39:21.656951+0000","last_clean":"2023-10-06T04:39:21.656951+0000","last_became_active":"2023-10-06T04:39:21.656705+0000","last_became_peered":"2023-10-06T04:39:21.656705+0000","last_unstale":"2023-10-06T04:39:21.656951+0000","last_undegraded":"2023-10-06T04:39:21.656951+0000","last_fullsized":"2023-10-06T04:39:21.656951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:30.052905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656740+0000","last_change":"2023-10-06T04:39:21.651985+0000","last_active":"2023-10-06T04:39:21.656740+0000","last_peered":"2023-10-06T04:39:21.656740+0000","last_clean":"2023-10-06T04:39:21.656740+0000","last_became_active":"2023-10-06T04:39:21.649488+0000","last_became_peered":"2023-10-06T04:39:21.649488+0000","last_unstale":"2023-10-06T04:39:21.656740+0000","last_undegraded":"2023-10-06T04:39:21.656740+0000","last_fullsized":"2023-10-06T04:39:21.656740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:48:03.866418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657637+0000","last_change":"2023-10-06T04:39:21.653127+0000","last_active":"2023-10-06T04:39:21.657637+0000","last_peered":"2023-10-06T04:39:21.657637+0000","last_clean":"2023-10-06T04:39:21.657637+0000","last_became_active":"2023-10-06T04:39:21.652573+0000","last_became_peered":"2023-10-06T04:39:21.652573+0000","last_unstale":"2023-10-06T04:39:21.657637+0000","last_undegraded":"2023-10-06T04:39:21.657637+0000","last_fullsized":"2023-10-06T04:39:21.657637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:02.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654141+0000","last_change":"2023-10-06T04:39:21.651949+0000","last_active":"2023-10-06T04:39:21.654141+0000","last_peered":"2023-10-06T04:39:21.654141+0000","last_clean":"2023-10-06T04:39:21.654141+0000","last_became_active":"2023-10-06T04:39:21.651637+0000","last_became_peered":"2023-10-06T04:39:21.651637+0000","last_unstale":"2023-10-06T04:39:21.654141+0000","last_undegraded":"2023-10-06T04:39:21.654141+0000","last_fullsized":"2023-10-06T04:39:21.654141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:02.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.658016+0000","last_change":"2023-10-06T04:39:21.658016+0000","last_active":"2023-10-06T04:39:21.658016+0000","last_peered":"2023-10-06T04:39:21.658016+0000","last_clean":"2023-10-06T04:39:21.658016+0000","last_became_active":"2023-10-06T04:39:21.657149+0000","last_became_peered":"2023-10-06T04:39:21.657149+0000","last_unstale":"2023-10-06T04:39:21.658016+0000","last_undegraded":"2023-10-06T04:39:21.658016+0000","last_fullsized":"2023-10-06T04:39:21.658016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:53.420342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.658796+0000","last_change":"2023-10-06T04:39:21.656885+0000","last_active":"2023-10-06T04:39:21.658796+0000","last_peered":"2023-10-06T04:39:21.658796+0000","last_clean":"2023-10-06T04:39:21.658796+0000","last_became_active":"2023-10-06T04:39:21.656652+0000","last_became_peered":"2023-10-06T04:39:21.656652+0000","last_unstale":"2023-10-06T04:39:21.658796+0000","last_undegraded":"2023-10-06T04:39:21.658796+0000","last_fullsized":"2023-10-06T04:39:21.658796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:37.183346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656795+0000","last_change":"2023-10-06T04:39:21.652303+0000","last_active":"2023-10-06T04:39:21.656795+0000","last_peered":"2023-10-06T04:39:21.656795+0000","last_clean":"2023-10-06T04:39:21.656795+0000","last_became_active":"2023-10-06T04:39:21.652040+0000","last_became_peered":"2023-10-06T04:39:21.652040+0000","last_unstale":"2023-10-06T04:39:21.656795+0000","last_undegraded":"2023-10-06T04:39:21.656795+0000","last_fullsized":"2023-10-06T04:39:21.656795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:50.708331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.655931+0000","last_change":"2023-10-06T04:39:21.655931+0000","last_active":"2023-10-06T04:39:21.655931+0000","last_peered":"2023-10-06T04:39:21.655931+0000","last_clean":"2023-10-06T04:39:21.655931+0000","last_became_active":"2023-10-06T04:39:21.655663+0000","last_became_peered":"2023-10-06T04:39:21.655663+0000","last_unstale":"2023-10-06T04:39:21.655931+0000","last_undegraded":"2023-10-06T04:39:21.655931+0000","last_fullsized":"2023-10-06T04:39:21.655931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:30:34.663775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.643679+0000","last_change":"2023-10-06T04:39:21.643679+0000","last_active":"2023-10-06T04:39:21.643679+0000","last_peered":"2023-10-06T04:39:21.643679+0000","last_clean":"2023-10-06T04:39:21.643679+0000","last_became_active":"2023-10-06T04:39:21.643341+0000","last_became_peered":"2023-10-06T04:39:21.643341+0000","last_unstale":"2023-10-06T04:39:21.643679+0000","last_undegraded":"2023-10-06T04:39:21.643679+0000","last_fullsized":"2023-10-06T04:39:21.643679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:27.026173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653958+0000","last_change":"2023-10-06T04:39:21.651998+0000","last_active":"2023-10-06T04:39:21.653958+0000","last_peered":"2023-10-06T04:39:21.653958+0000","last_clean":"2023-10-06T04:39:21.653958+0000","last_became_active":"2023-10-06T04:39:21.651702+0000","last_became_peered":"2023-10-06T04:39:21.651702+0000","last_unstale":"2023-10-06T04:39:21.653958+0000","last_undegraded":"2023-10-06T04:39:21.653958+0000","last_fullsized":"2023-10-06T04:39:21.653958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:23.201656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657656+0000","last_change":"2023-10-06T04:39:21.653318+0000","last_active":"2023-10-06T04:39:21.657656+0000","last_peered":"2023-10-06T04:39:21.657656+0000","last_clean":"2023-10-06T04:39:21.657656+0000","last_became_active":"2023-10-06T04:39:21.652877+0000","last_became_peered":"2023-10-06T04:39:21.652877+0000","last_unstale":"2023-10-06T04:39:21.657656+0000","last_undegraded":"2023-10-06T04:39:21.657656+0000","last_fullsized":"2023-10-06T04:39:21.657656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:23.201656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656760+0000","last_change":"2023-10-06T04:39:21.649928+0000","last_active":"2023-10-06T04:39:21.656760+0000","last_peered":"2023-10-06T04:39:21.656760+0000","last_clean":"2023-10-06T04:39:21.656760+0000","last_became_active":"2023-10-06T04:39:21.649638+0000","last_became_peered":"2023-10-06T04:39:21.649638+0000","last_unstale":"2023-10-06T04:39:21.656760+0000","last_undegraded":"2023-10-06T04:39:21.656760+0000","last_fullsized":"2023-10-06T04:39:21.656760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:54.256525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657715+0000","last_change":"2023-10-06T04:39:21.657715+0000","last_active":"2023-10-06T04:39:21.657715+0000","last_peered":"2023-10-06T04:39:21.657715+0000","last_clean":"2023-10-06T04:39:21.657715+0000","last_became_active":"2023-10-06T04:39:21.656464+0000","last_became_peered":"2023-10-06T04:39:21.656464+0000","last_unstale":"2023-10-06T04:39:21.657715+0000","last_undegraded":"2023-10-06T04:39:21.657715+0000","last_fullsized":"2023-10-06T04:39:21.657715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:37.183346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.658960+0000","last_change":"2023-10-06T04:39:21.655935+0000","last_active":"2023-10-06T04:39:21.658960+0000","last_peered":"2023-10-06T04:39:21.658960+0000","last_clean":"2023-10-06T04:39:21.658960+0000","last_became_active":"2023-10-06T04:39:21.655700+0000","last_became_peered":"2023-10-06T04:39:21.655700+0000","last_unstale":"2023-10-06T04:39:21.658960+0000","last_undegraded":"2023-10-06T04:39:21.658960+0000","last_fullsized":"2023-10-06T04:39:21.658960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:30.052905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.642376+0000","last_change":"2023-10-06T04:39:21.642376+0000","last_active":"2023-10-06T04:39:21.642376+0000","last_peered":"2023-10-06T04:39:21.642376+0000","last_clean":"2023-10-06T04:39:21.642376+0000","last_became_active":"2023-10-06T04:39:21.642132+0000","last_became_peered":"2023-10-06T04:39:21.642132+0000","last_unstale":"2023-10-06T04:39:21.642376+0000","last_undegraded":"2023-10-06T04:39:21.642376+0000","last_fullsized":"2023-10-06T04:39:21.642376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:57:07.955415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657008+0000","last_change":"2023-10-06T04:39:21.651106+0000","last_active":"2023-10-06T04:39:21.657008+0000","last_peered":"2023-10-06T04:39:21.657008+0000","last_clean":"2023-10-06T04:39:21.657008+0000","last_became_active":"2023-10-06T04:39:21.650595+0000","last_became_peered":"2023-10-06T04:39:21.650595+0000","last_unstale":"2023-10-06T04:39:21.657008+0000","last_undegraded":"2023-10-06T04:39:21.657008+0000","last_fullsized":"2023-10-06T04:39:21.657008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:39.953564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657675+0000","last_change":"2023-10-06T04:39:21.654113+0000","last_active":"2023-10-06T04:39:21.657675+0000","last_peered":"2023-10-06T04:39:21.657675+0000","last_clean":"2023-10-06T04:39:21.657675+0000","last_became_active":"2023-10-06T04:39:21.653847+0000","last_became_peered":"2023-10-06T04:39:21.653847+0000","last_unstale":"2023-10-06T04:39:21.657675+0000","last_undegraded":"2023-10-06T04:39:21.657675+0000","last_fullsized":"2023-10-06T04:39:21.657675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:37.183346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656316+0000","last_change":"2023-10-06T04:39:21.656316+0000","last_active":"2023-10-06T04:39:21.656316+0000","last_peered":"2023-10-06T04:39:21.656316+0000","last_clean":"2023-10-06T04:39:21.656316+0000","last_became_active":"2023-10-06T04:39:21.655902+0000","last_became_peered":"2023-10-06T04:39:21.655902+0000","last_unstale":"2023-10-06T04:39:21.656316+0000","last_undegraded":"2023-10-06T04:39:21.656316+0000","last_fullsized":"2023-10-06T04:39:21.656316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:23.201656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654941+0000","last_change":"2023-10-06T04:39:21.651840+0000","last_active":"2023-10-06T04:39:21.654941+0000","last_peered":"2023-10-06T04:39:21.654941+0000","last_clean":"2023-10-06T04:39:21.654941+0000","last_became_active":"2023-10-06T04:39:21.651580+0000","last_became_peered":"2023-10-06T04:39:21.651580+0000","last_unstale":"2023-10-06T04:39:21.654941+0000","last_undegraded":"2023-10-06T04:39:21.654941+0000","last_fullsized":"2023-10-06T04:39:21.654941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:56.545180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657569+0000","last_change":"2023-10-06T04:39:21.650621+0000","last_active":"2023-10-06T04:39:21.657569+0000","last_peered":"2023-10-06T04:39:21.657569+0000","last_clean":"2023-10-06T04:39:21.657569+0000","last_became_active":"2023-10-06T04:39:21.650370+0000","last_became_peered":"2023-10-06T04:39:21.650370+0000","last_unstale":"2023-10-06T04:39:21.657569+0000","last_undegraded":"2023-10-06T04:39:21.657569+0000","last_fullsized":"2023-10-06T04:39:21.657569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.886362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649124+0000","last_change":"2023-10-06T04:39:21.649124+0000","last_active":"2023-10-06T04:39:21.649124+0000","last_peered":"2023-10-06T04:39:21.649124+0000","last_clean":"2023-10-06T04:39:21.649124+0000","last_became_active":"2023-10-06T04:39:21.648871+0000","last_became_peered":"2023-10-06T04:39:21.648871+0000","last_unstale":"2023-10-06T04:39:21.649124+0000","last_undegraded":"2023-10-06T04:39:21.649124+0000","last_fullsized":"2023-10-06T04:39:21.649124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:15.667787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.639325+0000","last_change":"2023-10-06T04:39:21.639325+0000","last_active":"2023-10-06T04:39:21.639325+0000","last_peered":"2023-10-06T04:39:21.639325+0000","last_clean":"2023-10-06T04:39:21.639325+0000","last_became_active":"2023-10-06T04:39:21.639068+0000","last_became_peered":"2023-10-06T04:39:21.639068+0000","last_unstale":"2023-10-06T04:39:21.639325+0000","last_undegraded":"2023-10-06T04:39:21.639325+0000","last_fullsized":"2023-10-06T04:39:21.639325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:52.077624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651949+0000","last_change":"2023-10-06T04:39:21.646735+0000","last_active":"2023-10-06T04:39:21.651949+0000","last_peered":"2023-10-06T04:39:21.651949+0000","last_clean":"2023-10-06T04:39:21.651949+0000","last_became_active":"2023-10-06T04:39:21.646325+0000","last_became_peered":"2023-10-06T04:39:21.646325+0000","last_unstale":"2023-10-06T04:39:21.651949+0000","last_undegraded":"2023-10-06T04:39:21.651949+0000","last_fullsized":"2023-10-06T04:39:21.651949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.886362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.652192+0000","last_change":"2023-10-06T04:39:20.642499+0000","last_active":"2023-10-06T04:39:21.652192+0000","last_peered":"2023-10-06T04:39:21.652192+0000","last_clean":"2023-10-06T04:39:21.652192+0000","last_became_active":"2023-10-06T04:39:20.642246+0000","last_became_peered":"2023-10-06T04:39:20.642246+0000","last_unstale":"2023-10-06T04:39:21.652192+0000","last_undegraded":"2023-10-06T04:39:21.652192+0000","last_fullsized":"2023-10-06T04:39:21.652192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.956516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649570+0000","last_change":"2023-10-06T04:39:21.644626+0000","last_active":"2023-10-06T04:39:21.649570+0000","last_peered":"2023-10-06T04:39:21.649570+0000","last_clean":"2023-10-06T04:39:21.649570+0000","last_became_active":"2023-10-06T04:39:21.644333+0000","last_became_peered":"2023-10-06T04:39:21.644333+0000","last_unstale":"2023-10-06T04:39:21.649570+0000","last_undegraded":"2023-10-06T04:39:21.649570+0000","last_fullsized":"2023-10-06T04:39:21.649570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:54.256525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-06T04:39:20.640506+0000","last_change":"2023-10-06T04:39:20.639697+0000","last_active":"2023-10-06T04:39:20.640506+0000","last_peered":"2023-10-06T04:39:20.640506+0000","last_clean":"2023-10-06T04:39:20.640506+0000","last_became_active":"2023-10-06T04:39:20.639431+0000","last_became_peered":"2023-10-06T04:39:20.639431+0000","last_unstale":"2023-10-06T04:39:20.640506+0000","last_undegraded":"2023-10-06T04:39:20.640506+0000","last_fullsized":"2023-10-06T04:39:20.640506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:20.086705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.659222+0000","last_change":"2023-10-06T04:39:21.659222+0000","last_active":"2023-10-06T04:39:21.659222+0000","last_peered":"2023-10-06T04:39:21.659222+0000","last_clean":"2023-10-06T04:39:21.659222+0000","last_became_active":"2023-10-06T04:39:21.659030+0000","last_became_peered":"2023-10-06T04:39:21.659030+0000","last_unstale":"2023-10-06T04:39:21.659222+0000","last_undegraded":"2023-10-06T04:39:21.659222+0000","last_fullsized":"2023-10-06T04:39:21.659222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.886362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.636144+0000","last_change":"2023-10-06T04:39:20.642433+0000","last_active":"2023-10-06T04:39:21.636144+0000","last_peered":"2023-10-06T04:39:21.636144+0000","last_clean":"2023-10-06T04:39:21.636144+0000","last_became_active":"2023-10-06T04:39:20.640984+0000","last_became_peered":"2023-10-06T04:39:20.640984+0000","last_unstale":"2023-10-06T04:39:21.636144+0000","last_undegraded":"2023-10-06T04:39:21.636144+0000","last_fullsized":"2023-10-06T04:39:21.636144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:41.984467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651186+0000","last_change":"2023-10-06T04:39:21.643087+0000","last_active":"2023-10-06T04:39:21.651186+0000","last_peered":"2023-10-06T04:39:21.651186+0000","last_clean":"2023-10-06T04:39:21.651186+0000","last_became_active":"2023-10-06T04:39:21.642825+0000","last_became_peered":"2023-10-06T04:39:21.642825+0000","last_unstale":"2023-10-06T04:39:21.651186+0000","last_undegraded":"2023-10-06T04:39:21.651186+0000","last_fullsized":"2023-10-06T04:39:21.651186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:38.337736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-06T04:39:20.645703+0000","last_change":"2023-10-06T04:39:20.644712+0000","last_active":"2023-10-06T04:39:20.645703+0000","last_peered":"2023-10-06T04:39:20.645703+0000","last_clean":"2023-10-06T04:39:20.645703+0000","last_became_active":"2023-10-06T04:39:20.644415+0000","last_became_peered":"2023-10-06T04:39:20.644415+0000","last_unstale":"2023-10-06T04:39:20.645703+0000","last_undegraded":"2023-10-06T04:39:20.645703+0000","last_fullsized":"2023-10-06T04:39:20.645703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.956516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641262+0000","last_change":"2023-10-06T04:39:21.638794+0000","last_active":"2023-10-06T04:39:21.641262+0000","last_peered":"2023-10-06T04:39:21.641262+0000","last_clean":"2023-10-06T04:39:21.641262+0000","last_became_active":"2023-10-06T04:39:21.638555+0000","last_became_peered":"2023-10-06T04:39:21.638555+0000","last_unstale":"2023-10-06T04:39:21.641262+0000","last_undegraded":"2023-10-06T04:39:21.641262+0000","last_fullsized":"2023-10-06T04:39:21.641262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:48.632302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.639947+0000","last_change":"2023-10-06T04:39:20.643255+0000","last_active":"2023-10-06T04:39:21.639947+0000","last_peered":"2023-10-06T04:39:21.639947+0000","last_clean":"2023-10-06T04:39:21.639947+0000","last_became_active":"2023-10-06T04:39:20.642932+0000","last_became_peered":"2023-10-06T04:39:20.642932+0000","last_unstale":"2023-10-06T04:39:21.639947+0000","last_undegraded":"2023-10-06T04:39:21.639947+0000","last_fullsized":"2023-10-06T04:39:21.639947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:20.086705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649490+0000","last_change":"2023-10-06T04:39:21.643526+0000","last_active":"2023-10-06T04:39:21.649490+0000","last_peered":"2023-10-06T04:39:21.649490+0000","last_clean":"2023-10-06T04:39:21.649490+0000","last_became_active":"2023-10-06T04:39:21.643270+0000","last_became_peered":"2023-10-06T04:39:21.643270+0000","last_unstale":"2023-10-06T04:39:21.649490+0000","last_undegraded":"2023-10-06T04:39:21.649490+0000","last_fullsized":"2023-10-06T04:39:21.649490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:47.582081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654054+0000","last_change":"2023-10-06T04:39:20.647036+0000","last_active":"2023-10-06T04:39:21.654054+0000","last_peered":"2023-10-06T04:39:21.654054+0000","last_clean":"2023-10-06T04:39:21.654054+0000","last_became_active":"2023-10-06T04:39:20.646772+0000","last_became_peered":"2023-10-06T04:39:20.646772+0000","last_unstale":"2023-10-06T04:39:21.654054+0000","last_undegraded":"2023-10-06T04:39:21.654054+0000","last_fullsized":"2023-10-06T04:39:21.654054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:13.508117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.648922+0000","last_change":"2023-10-06T04:39:21.648922+0000","last_active":"2023-10-06T04:39:21.648922+0000","last_peered":"2023-10-06T04:39:21.648922+0000","last_clean":"2023-10-06T04:39:21.648922+0000","last_became_active":"2023-10-06T04:39:21.648665+0000","last_became_peered":"2023-10-06T04:39:21.648665+0000","last_unstale":"2023-10-06T04:39:21.648922+0000","last_undegraded":"2023-10-06T04:39:21.648922+0000","last_fullsized":"2023-10-06T04:39:21.648922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:35:46.706541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.659518+0000","last_change":"2023-10-06T04:39:20.644243+0000","last_active":"2023-10-06T04:39:21.659518+0000","last_peered":"2023-10-06T04:39:21.659518+0000","last_clean":"2023-10-06T04:39:21.659518+0000","last_became_active":"2023-10-06T04:39:20.643934+0000","last_became_peered":"2023-10-06T04:39:20.643934+0000","last_unstale":"2023-10-06T04:39:21.659518+0000","last_undegraded":"2023-10-06T04:39:21.659518+0000","last_fullsized":"2023-10-06T04:39:21.659518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:30:33.654378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653554+0000","last_change":"2023-10-06T04:39:21.641258+0000","last_active":"2023-10-06T04:39:21.653554+0000","last_peered":"2023-10-06T04:39:21.653554+0000","last_clean":"2023-10-06T04:39:21.653554+0000","last_became_active":"2023-10-06T04:39:21.640963+0000","last_became_peered":"2023-10-06T04:39:21.640963+0000","last_unstale":"2023-10-06T04:39:21.653554+0000","last_undegraded":"2023-10-06T04:39:21.653554+0000","last_fullsized":"2023-10-06T04:39:21.653554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:30.317889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656880+0000","last_change":"2023-10-06T04:39:20.649614+0000","last_active":"2023-10-06T04:39:21.656880+0000","last_peered":"2023-10-06T04:39:21.656880+0000","last_clean":"2023-10-06T04:39:21.656880+0000","last_became_active":"2023-10-06T04:39:20.649327+0000","last_became_peered":"2023-10-06T04:39:20.649327+0000","last_unstale":"2023-10-06T04:39:21.656880+0000","last_undegraded":"2023-10-06T04:39:21.656880+0000","last_fullsized":"2023-10-06T04:39:21.656880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:34.104262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649589+0000","last_change":"2023-10-06T04:39:21.644535+0000","last_active":"2023-10-06T04:39:21.649589+0000","last_peered":"2023-10-06T04:39:21.649589+0000","last_clean":"2023-10-06T04:39:21.649589+0000","last_became_active":"2023-10-06T04:39:21.644260+0000","last_became_peered":"2023-10-06T04:39:21.644260+0000","last_unstale":"2023-10-06T04:39:21.649589+0000","last_undegraded":"2023-10-06T04:39:21.649589+0000","last_fullsized":"2023-10-06T04:39:21.649589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:30.052905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-06T04:39:20.644505+0000","last_change":"2023-10-06T04:39:20.641086+0000","last_active":"2023-10-06T04:39:20.644505+0000","last_peered":"2023-10-06T04:39:20.644505+0000","last_clean":"2023-10-06T04:39:20.644505+0000","last_became_active":"2023-10-06T04:39:20.640581+0000","last_became_peered":"2023-10-06T04:39:20.640581+0000","last_unstale":"2023-10-06T04:39:20.644505+0000","last_undegraded":"2023-10-06T04:39:20.644505+0000","last_fullsized":"2023-10-06T04:39:20.644505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:34.035323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651928+0000","last_change":"2023-10-06T04:39:21.646546+0000","last_active":"2023-10-06T04:39:21.651928+0000","last_peered":"2023-10-06T04:39:21.651928+0000","last_clean":"2023-10-06T04:39:21.651928+0000","last_became_active":"2023-10-06T04:39:21.645987+0000","last_became_peered":"2023-10-06T04:39:21.645987+0000","last_unstale":"2023-10-06T04:39:21.651928+0000","last_undegraded":"2023-10-06T04:39:21.651928+0000","last_fullsized":"2023-10-06T04:39:21.651928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:52.077624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641875+0000","last_change":"2023-10-06T04:39:20.648674+0000","last_active":"2023-10-06T04:39:21.641875+0000","last_peered":"2023-10-06T04:39:21.641875+0000","last_clean":"2023-10-06T04:39:21.641875+0000","last_became_active":"2023-10-06T04:39:20.648394+0000","last_became_peered":"2023-10-06T04:39:20.648394+0000","last_unstale":"2023-10-06T04:39:21.641875+0000","last_undegraded":"2023-10-06T04:39:21.641875+0000","last_fullsized":"2023-10-06T04:39:21.641875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:15.387433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656280+0000","last_change":"2023-10-06T04:39:21.656280+0000","last_active":"2023-10-06T04:39:21.656280+0000","last_peered":"2023-10-06T04:39:21.656280+0000","last_clean":"2023-10-06T04:39:21.656280+0000","last_became_active":"2023-10-06T04:39:21.655973+0000","last_became_peered":"2023-10-06T04:39:21.655973+0000","last_unstale":"2023-10-06T04:39:21.656280+0000","last_undegraded":"2023-10-06T04:39:21.656280+0000","last_fullsized":"2023-10-06T04:39:21.656280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:56.545180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650234+0000","last_change":"2023-10-06T04:39:20.641641+0000","last_active":"2023-10-06T04:39:21.650234+0000","last_peered":"2023-10-06T04:39:21.650234+0000","last_clean":"2023-10-06T04:39:21.650234+0000","last_became_active":"2023-10-06T04:39:20.641335+0000","last_became_peered":"2023-10-06T04:39:20.641335+0000","last_unstale":"2023-10-06T04:39:21.650234+0000","last_undegraded":"2023-10-06T04:39:21.650234+0000","last_fullsized":"2023-10-06T04:39:21.650234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.956516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649486+0000","last_change":"2023-10-06T04:39:21.642393+0000","last_active":"2023-10-06T04:39:21.649486+0000","last_peered":"2023-10-06T04:39:21.649486+0000","last_clean":"2023-10-06T04:39:21.649486+0000","last_became_active":"2023-10-06T04:39:21.641909+0000","last_became_peered":"2023-10-06T04:39:21.641909+0000","last_unstale":"2023-10-06T04:39:21.649486+0000","last_undegraded":"2023-10-06T04:39:21.649486+0000","last_fullsized":"2023-10-06T04:39:21.649486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:02.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656881+0000","last_change":"2023-10-06T04:39:20.648860+0000","last_active":"2023-10-06T04:39:21.656881+0000","last_peered":"2023-10-06T04:39:21.656881+0000","last_clean":"2023-10-06T04:39:21.656881+0000","last_became_active":"2023-10-06T04:39:20.648534+0000","last_became_peered":"2023-10-06T04:39:20.648534+0000","last_unstale":"2023-10-06T04:39:21.656881+0000","last_undegraded":"2023-10-06T04:39:21.656881+0000","last_fullsized":"2023-10-06T04:39:21.656881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:02.150888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651553+0000","last_change":"2023-10-06T04:39:21.644510+0000","last_active":"2023-10-06T04:39:21.651553+0000","last_peered":"2023-10-06T04:39:21.651553+0000","last_clean":"2023-10-06T04:39:21.651553+0000","last_became_active":"2023-10-06T04:39:21.644240+0000","last_became_peered":"2023-10-06T04:39:21.644240+0000","last_unstale":"2023-10-06T04:39:21.651553+0000","last_undegraded":"2023-10-06T04:39:21.651553+0000","last_fullsized":"2023-10-06T04:39:21.651553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:51.885986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654601+0000","last_change":"2023-10-06T04:39:20.649002+0000","last_active":"2023-10-06T04:39:21.654601+0000","last_peered":"2023-10-06T04:39:21.654601+0000","last_clean":"2023-10-06T04:39:21.654601+0000","last_became_active":"2023-10-06T04:39:20.648668+0000","last_became_peered":"2023-10-06T04:39:20.648668+0000","last_unstale":"2023-10-06T04:39:21.654601+0000","last_undegraded":"2023-10-06T04:39:21.654601+0000","last_fullsized":"2023-10-06T04:39:21.654601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:37.328339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650007+0000","last_change":"2023-10-06T04:39:21.636412+0000","last_active":"2023-10-06T04:39:21.650007+0000","last_peered":"2023-10-06T04:39:21.650007+0000","last_clean":"2023-10-06T04:39:21.650007+0000","last_became_active":"2023-10-06T04:39:21.636129+0000","last_became_peered":"2023-10-06T04:39:21.636129+0000","last_unstale":"2023-10-06T04:39:21.650007+0000","last_undegraded":"2023-10-06T04:39:21.650007+0000","last_fullsized":"2023-10-06T04:39:21.650007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:23.201656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.652225+0000","last_change":"2023-10-06T04:39:20.644212+0000","last_active":"2023-10-06T04:39:21.652225+0000","last_peered":"2023-10-06T04:39:21.652225+0000","last_clean":"2023-10-06T04:39:21.652225+0000","last_became_active":"2023-10-06T04:39:20.643961+0000","last_became_peered":"2023-10-06T04:39:20.643961+0000","last_unstale":"2023-10-06T04:39:21.652225+0000","last_undegraded":"2023-10-06T04:39:21.652225+0000","last_fullsized":"2023-10-06T04:39:21.652225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:43.930198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650010+0000","last_change":"2023-10-06T04:39:21.641026+0000","last_active":"2023-10-06T04:39:21.650010+0000","last_peered":"2023-10-06T04:39:21.650010+0000","last_clean":"2023-10-06T04:39:21.650010+0000","last_became_active":"2023-10-06T04:39:21.640757+0000","last_became_peered":"2023-10-06T04:39:21.640757+0000","last_unstale":"2023-10-06T04:39:21.650010+0000","last_undegraded":"2023-10-06T04:39:21.650010+0000","last_fullsized":"2023-10-06T04:39:21.650010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:35.113660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.639626+0000","last_change":"2023-10-06T04:39:20.637507+0000","last_active":"2023-10-06T04:39:21.639626+0000","last_peered":"2023-10-06T04:39:21.639626+0000","last_clean":"2023-10-06T04:39:21.639626+0000","last_became_active":"2023-10-06T04:39:20.637209+0000","last_became_peered":"2023-10-06T04:39:20.637209+0000","last_unstale":"2023-10-06T04:39:21.639626+0000","last_undegraded":"2023-10-06T04:39:21.639626+0000","last_fullsized":"2023-10-06T04:39:21.639626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:30:33.654378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.652401+0000","last_change":"2023-10-06T04:39:21.652401+0000","last_active":"2023-10-06T04:39:21.652401+0000","last_peered":"2023-10-06T04:39:21.652401+0000","last_clean":"2023-10-06T04:39:21.652401+0000","last_became_active":"2023-10-06T04:39:21.652150+0000","last_became_peered":"2023-10-06T04:39:21.652150+0000","last_unstale":"2023-10-06T04:39:21.652401+0000","last_undegraded":"2023-10-06T04:39:21.652401+0000","last_fullsized":"2023-10-06T04:39:21.652401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:02.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651501+0000","last_change":"2023-10-06T04:39:20.643661+0000","last_active":"2023-10-06T04:39:21.651501+0000","last_peered":"2023-10-06T04:39:21.651501+0000","last_clean":"2023-10-06T04:39:21.651501+0000","last_became_active":"2023-10-06T04:39:20.643353+0000","last_became_peered":"2023-10-06T04:39:20.643353+0000","last_unstale":"2023-10-06T04:39:21.651501+0000","last_undegraded":"2023-10-06T04:39:21.651501+0000","last_fullsized":"2023-10-06T04:39:21.651501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:37.328339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656988+0000","last_change":"2023-10-06T04:39:21.650918+0000","last_active":"2023-10-06T04:39:21.656988+0000","last_peered":"2023-10-06T04:39:21.656988+0000","last_clean":"2023-10-06T04:39:21.656988+0000","last_became_active":"2023-10-06T04:39:21.650308+0000","last_became_peered":"2023-10-06T04:39:21.650308+0000","last_unstale":"2023-10-06T04:39:21.656988+0000","last_undegraded":"2023-10-06T04:39:21.656988+0000","last_fullsized":"2023-10-06T04:39:21.656988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:54.734766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.631765+0000","last_change":"2023-10-06T04:39:20.643726+0000","last_active":"2023-10-06T04:39:21.631765+0000","last_peered":"2023-10-06T04:39:21.631765+0000","last_clean":"2023-10-06T04:39:21.631765+0000","last_became_active":"2023-10-06T04:39:20.643431+0000","last_became_peered":"2023-10-06T04:39:20.643431+0000","last_unstale":"2023-10-06T04:39:21.631765+0000","last_undegraded":"2023-10-06T04:39:21.631765+0000","last_fullsized":"2023-10-06T04:39:21.631765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:26.016776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.659132+0000","last_change":"2023-10-06T04:39:21.656050+0000","last_active":"2023-10-06T04:39:21.659132+0000","last_peered":"2023-10-06T04:39:21.659132+0000","last_clean":"2023-10-06T04:39:21.659132+0000","last_became_active":"2023-10-06T04:39:21.655770+0000","last_became_peered":"2023-10-06T04:39:21.655770+0000","last_unstale":"2023-10-06T04:39:21.659132+0000","last_undegraded":"2023-10-06T04:39:21.659132+0000","last_fullsized":"2023-10-06T04:39:21.659132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:48.632302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.632742+0000","last_change":"2023-10-06T04:39:20.646573+0000","last_active":"2023-10-06T04:39:21.632742+0000","last_peered":"2023-10-06T04:39:21.632742+0000","last_clean":"2023-10-06T04:39:21.632742+0000","last_became_active":"2023-10-06T04:39:20.646304+0000","last_became_peered":"2023-10-06T04:39:20.646304+0000","last_unstale":"2023-10-06T04:39:21.632742+0000","last_undegraded":"2023-10-06T04:39:21.632742+0000","last_fullsized":"2023-10-06T04:39:21.632742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:34.035323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653927+0000","last_change":"2023-10-06T04:39:21.647116+0000","last_active":"2023-10-06T04:39:21.653927+0000","last_peered":"2023-10-06T04:39:21.653927+0000","last_clean":"2023-10-06T04:39:21.653927+0000","last_became_active":"2023-10-06T04:39:21.646843+0000","last_became_peered":"2023-10-06T04:39:21.646843+0000","last_unstale":"2023-10-06T04:39:21.653927+0000","last_undegraded":"2023-10-06T04:39:21.653927+0000","last_fullsized":"2023-10-06T04:39:21.653927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:44.744728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.636029+0000","last_change":"2023-10-06T04:39:20.643002+0000","last_active":"2023-10-06T04:39:21.636029+0000","last_peered":"2023-10-06T04:39:21.636029+0000","last_clean":"2023-10-06T04:39:21.636029+0000","last_became_active":"2023-10-06T04:39:20.642751+0000","last_became_peered":"2023-10-06T04:39:20.642751+0000","last_unstale":"2023-10-06T04:39:21.636029+0000","last_undegraded":"2023-10-06T04:39:21.636029+0000","last_fullsized":"2023-10-06T04:39:21.636029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:34.035323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.644991+0000","last_change":"2023-10-06T04:39:21.644991+0000","last_active":"2023-10-06T04:39:21.644991+0000","last_peered":"2023-10-06T04:39:21.644991+0000","last_clean":"2023-10-06T04:39:21.644991+0000","last_became_active":"2023-10-06T04:39:21.644463+0000","last_became_peered":"2023-10-06T04:39:21.644463+0000","last_unstale":"2023-10-06T04:39:21.644991+0000","last_undegraded":"2023-10-06T04:39:21.644991+0000","last_fullsized":"2023-10-06T04:39:21.644991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.886362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.646559+0000","last_change":"2023-10-06T04:39:20.644886+0000","last_active":"2023-10-06T04:39:21.646559+0000","last_peered":"2023-10-06T04:39:21.646559+0000","last_clean":"2023-10-06T04:39:21.646559+0000","last_became_active":"2023-10-06T04:39:20.644539+0000","last_became_peered":"2023-10-06T04:39:20.644539+0000","last_unstale":"2023-10-06T04:39:21.646559+0000","last_undegraded":"2023-10-06T04:39:21.646559+0000","last_fullsized":"2023-10-06T04:39:21.646559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.956516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.636207+0000","last_change":"2023-10-06T04:39:16.067723+0000","last_active":"2023-10-06T04:39:21.636207+0000","last_peered":"2023-10-06T04:39:21.636207+0000","last_clean":"2023-10-06T04:39:21.636207+0000","last_became_active":"2023-10-06T04:39:16.067325+0000","last_became_peered":"2023-10-06T04:39:16.067325+0000","last_unstale":"2023-10-06T04:39:21.636207+0000","last_undegraded":"2023-10-06T04:39:21.636207+0000","last_fullsized":"2023-10-06T04:39:21.636207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649652+0000","last_change":"2023-10-06T04:39:21.645095+0000","last_active":"2023-10-06T04:39:21.649652+0000","last_peered":"2023-10-06T04:39:21.649652+0000","last_clean":"2023-10-06T04:39:21.649652+0000","last_became_active":"2023-10-06T04:39:21.643941+0000","last_became_peered":"2023-10-06T04:39:21.643941+0000","last_unstale":"2023-10-06T04:39:21.649652+0000","last_undegraded":"2023-10-06T04:39:21.649652+0000","last_fullsized":"2023-10-06T04:39:21.649652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:37.183346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.636787+0000","last_change":"2023-10-06T04:39:15.592391+0000","last_active":"2023-10-06T04:39:21.636787+0000","last_peered":"2023-10-06T04:39:21.636787+0000","last_clean":"2023-10-06T04:39:21.636787+0000","last_became_active":"2023-10-06T04:39:15.592094+0000","last_became_peered":"2023-10-06T04:39:15.592094+0000","last_unstale":"2023-10-06T04:39:21.636787+0000","last_undegraded":"2023-10-06T04:39:21.636787+0000","last_fullsized":"2023-10-06T04:39:21.636787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.280766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-06T04:39:20.645256+0000","last_change":"2023-10-06T04:39:20.641845+0000","last_active":"2023-10-06T04:39:20.645256+0000","last_peered":"2023-10-06T04:39:20.645256+0000","last_clean":"2023-10-06T04:39:20.645256+0000","last_became_active":"2023-10-06T04:39:20.641582+0000","last_became_peered":"2023-10-06T04:39:20.641582+0000","last_unstale":"2023-10-06T04:39:20.645256+0000","last_undegraded":"2023-10-06T04:39:20.645256+0000","last_fullsized":"2023-10-06T04:39:20.645256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:25.801442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650028+0000","last_change":"2023-10-06T04:39:21.640130+0000","last_active":"2023-10-06T04:39:21.650028+0000","last_peered":"2023-10-06T04:39:21.650028+0000","last_clean":"2023-10-06T04:39:21.650028+0000","last_became_active":"2023-10-06T04:39:21.639874+0000","last_became_peered":"2023-10-06T04:39:21.639874+0000","last_unstale":"2023-10-06T04:39:21.650028+0000","last_undegraded":"2023-10-06T04:39:21.650028+0000","last_fullsized":"2023-10-06T04:39:21.650028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:33.545272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-06T04:39:20.632526+0000","last_change":"2023-10-06T04:39:15.585112+0000","last_active":"2023-10-06T04:39:20.632526+0000","last_peered":"2023-10-06T04:39:20.632526+0000","last_clean":"2023-10-06T04:39:20.632526+0000","last_became_active":"2023-10-06T04:39:15.584853+0000","last_became_peered":"2023-10-06T04:39:15.584853+0000","last_unstale":"2023-10-06T04:39:20.632526+0000","last_undegraded":"2023-10-06T04:39:20.632526+0000","last_fullsized":"2023-10-06T04:39:20.632526+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641467+0000","last_change":"2023-10-06T04:39:15.588017+0000","last_active":"2023-10-06T04:39:21.641467+0000","last_peered":"2023-10-06T04:39:21.641467+0000","last_clean":"2023-10-06T04:39:21.641467+0000","last_became_active":"2023-10-06T04:39:15.586771+0000","last_became_peered":"2023-10-06T04:39:15.586771+0000","last_unstale":"2023-10-06T04:39:21.641467+0000","last_undegraded":"2023-10-06T04:39:21.641467+0000","last_fullsized":"2023-10-06T04:39:21.641467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:35.225282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-06T04:39:20.647172+0000","last_change":"2023-10-06T04:39:20.646203+0000","last_active":"2023-10-06T04:39:20.647172+0000","last_peered":"2023-10-06T04:39:20.647172+0000","last_clean":"2023-10-06T04:39:20.647172+0000","last_became_active":"2023-10-06T04:39:20.645902+0000","last_became_peered":"2023-10-06T04:39:20.645902+0000","last_unstale":"2023-10-06T04:39:20.647172+0000","last_undegraded":"2023-10-06T04:39:20.647172+0000","last_fullsized":"2023-10-06T04:39:20.647172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:26.016776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656264+0000","last_change":"2023-10-06T04:39:21.656264+0000","last_active":"2023-10-06T04:39:21.656264+0000","last_peered":"2023-10-06T04:39:21.656264+0000","last_clean":"2023-10-06T04:39:21.656264+0000","last_became_active":"2023-10-06T04:39:21.655944+0000","last_became_peered":"2023-10-06T04:39:21.655944+0000","last_unstale":"2023-10-06T04:39:21.656264+0000","last_undegraded":"2023-10-06T04:39:21.656264+0000","last_fullsized":"2023-10-06T04:39:21.656264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:47.582081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641321+0000","last_change":"2023-10-06T04:39:16.252521+0000","last_active":"2023-10-06T04:39:21.641321+0000","last_peered":"2023-10-06T04:39:21.641321+0000","last_clean":"2023-10-06T04:39:21.641321+0000","last_became_active":"2023-10-06T04:39:16.252245+0000","last_became_peered":"2023-10-06T04:39:16.252245+0000","last_unstale":"2023-10-06T04:39:21.641321+0000","last_undegraded":"2023-10-06T04:39:21.641321+0000","last_fullsized":"2023-10-06T04:39:21.641321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:17.694713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-06T04:39:20.643610+0000","last_change":"2023-10-06T04:39:20.641992+0000","last_active":"2023-10-06T04:39:20.643610+0000","last_peered":"2023-10-06T04:39:20.643610+0000","last_clean":"2023-10-06T04:39:20.643610+0000","last_became_active":"2023-10-06T04:39:20.641741+0000","last_became_peered":"2023-10-06T04:39:20.641741+0000","last_unstale":"2023-10-06T04:39:20.643610+0000","last_undegraded":"2023-10-06T04:39:20.643610+0000","last_fullsized":"2023-10-06T04:39:20.643610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:26.016776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.645153+0000","last_change":"2023-10-06T04:39:21.645153+0000","last_active":"2023-10-06T04:39:21.645153+0000","last_peered":"2023-10-06T04:39:21.645153+0000","last_clean":"2023-10-06T04:39:21.645153+0000","last_became_active":"2023-10-06T04:39:21.644766+0000","last_became_peered":"2023-10-06T04:39:21.644766+0000","last_unstale":"2023-10-06T04:39:21.645153+0000","last_undegraded":"2023-10-06T04:39:21.645153+0000","last_fullsized":"2023-10-06T04:39:21.645153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:40.720886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.640765+0000","last_change":"2023-10-06T04:39:16.252493+0000","last_active":"2023-10-06T04:39:21.640765+0000","last_peered":"2023-10-06T04:39:21.640765+0000","last_clean":"2023-10-06T04:39:21.640765+0000","last_became_active":"2023-10-06T04:39:16.252190+0000","last_became_peered":"2023-10-06T04:39:16.252190+0000","last_unstale":"2023-10-06T04:39:21.640765+0000","last_undegraded":"2023-10-06T04:39:21.640765+0000","last_fullsized":"2023-10-06T04:39:21.640765+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:59.554724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.636098+0000","last_change":"2023-10-06T04:39:20.639854+0000","last_active":"2023-10-06T04:39:21.636098+0000","last_peered":"2023-10-06T04:39:21.636098+0000","last_clean":"2023-10-06T04:39:21.636098+0000","last_became_active":"2023-10-06T04:39:20.639584+0000","last_became_peered":"2023-10-06T04:39:20.639584+0000","last_unstale":"2023-10-06T04:39:21.636098+0000","last_undegraded":"2023-10-06T04:39:21.636098+0000","last_fullsized":"2023-10-06T04:39:21.636098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:02.150888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656202+0000","last_change":"2023-10-06T04:39:21.653017+0000","last_active":"2023-10-06T04:39:21.656202+0000","last_peered":"2023-10-06T04:39:21.656202+0000","last_clean":"2023-10-06T04:39:21.656202+0000","last_became_active":"2023-10-06T04:39:21.652754+0000","last_became_peered":"2023-10-06T04:39:21.652754+0000","last_unstale":"2023-10-06T04:39:21.656202+0000","last_undegraded":"2023-10-06T04:39:21.656202+0000","last_fullsized":"2023-10-06T04:39:21.656202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:40.720886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.639474+0000","last_change":"2023-10-06T04:39:16.252554+0000","last_active":"2023-10-06T04:39:21.639474+0000","last_peered":"2023-10-06T04:39:21.639474+0000","last_clean":"2023-10-06T04:39:21.639474+0000","last_became_active":"2023-10-06T04:39:16.252225+0000","last_became_peered":"2023-10-06T04:39:16.252225+0000","last_unstale":"2023-10-06T04:39:21.639474+0000","last_undegraded":"2023-10-06T04:39:21.639474+0000","last_fullsized":"2023-10-06T04:39:21.639474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.280766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.633085+0000","last_change":"2023-10-06T04:39:20.644016+0000","last_active":"2023-10-06T04:39:21.633085+0000","last_peered":"2023-10-06T04:39:21.633085+0000","last_clean":"2023-10-06T04:39:21.633085+0000","last_became_active":"2023-10-06T04:39:20.643732+0000","last_became_peered":"2023-10-06T04:39:20.643732+0000","last_unstale":"2023-10-06T04:39:21.633085+0000","last_undegraded":"2023-10-06T04:39:21.633085+0000","last_fullsized":"2023-10-06T04:39:21.633085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:25.801442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.638573+0000","last_change":"2023-10-06T04:39:21.638573+0000","last_active":"2023-10-06T04:39:21.638573+0000","last_peered":"2023-10-06T04:39:21.638573+0000","last_clean":"2023-10-06T04:39:21.638573+0000","last_became_active":"2023-10-06T04:39:21.638300+0000","last_became_peered":"2023-10-06T04:39:21.638300+0000","last_unstale":"2023-10-06T04:39:21.638573+0000","last_undegraded":"2023-10-06T04:39:21.638573+0000","last_fullsized":"2023-10-06T04:39:21.638573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:23.201656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.630974+0000","last_change":"2023-10-06T04:39:16.253021+0000","last_active":"2023-10-06T04:39:21.630974+0000","last_peered":"2023-10-06T04:39:21.630974+0000","last_clean":"2023-10-06T04:39:21.630974+0000","last_became_active":"2023-10-06T04:39:16.252478+0000","last_became_peered":"2023-10-06T04:39:16.252478+0000","last_unstale":"2023-10-06T04:39:21.630974+0000","last_undegraded":"2023-10-06T04:39:21.630974+0000","last_fullsized":"2023-10-06T04:39:21.630974+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:07.439434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-06T04:39:20.643946+0000","last_change":"2023-10-06T04:39:20.642608+0000","last_active":"2023-10-06T04:39:20.643946+0000","last_peered":"2023-10-06T04:39:20.643946+0000","last_clean":"2023-10-06T04:39:20.643946+0000","last_became_active":"2023-10-06T04:39:20.642287+0000","last_became_peered":"2023-10-06T04:39:20.642287+0000","last_unstale":"2023-10-06T04:39:20.643946+0000","last_undegraded":"2023-10-06T04:39:20.643946+0000","last_fullsized":"2023-10-06T04:39:20.643946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.956516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656717+0000","last_change":"2023-10-06T04:39:21.656717+0000","last_active":"2023-10-06T04:39:21.656717+0000","last_peered":"2023-10-06T04:39:21.656717+0000","last_clean":"2023-10-06T04:39:21.656717+0000","last_became_active":"2023-10-06T04:39:21.656373+0000","last_became_peered":"2023-10-06T04:39:21.656373+0000","last_unstale":"2023-10-06T04:39:21.656717+0000","last_undegraded":"2023-10-06T04:39:21.656717+0000","last_fullsized":"2023-10-06T04:39:21.656717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:51.885986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.630765+0000","last_change":"2023-10-06T04:39:15.587681+0000","last_active":"2023-10-06T04:39:21.630765+0000","last_peered":"2023-10-06T04:39:21.630765+0000","last_clean":"2023-10-06T04:39:21.630765+0000","last_became_active":"2023-10-06T04:39:15.587313+0000","last_became_peered":"2023-10-06T04:39:15.587313+0000","last_unstale":"2023-10-06T04:39:21.630765+0000","last_undegraded":"2023-10-06T04:39:21.630765+0000","last_fullsized":"2023-10-06T04:39:21.630765+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641010+0000","last_change":"2023-10-06T04:39:20.640831+0000","last_active":"2023-10-06T04:39:21.641010+0000","last_peered":"2023-10-06T04:39:21.641010+0000","last_clean":"2023-10-06T04:39:21.641010+0000","last_became_active":"2023-10-06T04:39:20.640545+0000","last_became_peered":"2023-10-06T04:39:20.640545+0000","last_unstale":"2023-10-06T04:39:21.641010+0000","last_undegraded":"2023-10-06T04:39:21.641010+0000","last_fullsized":"2023-10-06T04:39:21.641010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:41.984467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.644674+0000","last_change":"2023-10-06T04:39:21.644674+0000","last_active":"2023-10-06T04:39:21.644674+0000","last_peered":"2023-10-06T04:39:21.644674+0000","last_clean":"2023-10-06T04:39:21.644674+0000","last_became_active":"2023-10-06T04:39:21.644407+0000","last_became_peered":"2023-10-06T04:39:21.644407+0000","last_unstale":"2023-10-06T04:39:21.644674+0000","last_undegraded":"2023-10-06T04:39:21.644674+0000","last_fullsized":"2023-10-06T04:39:21.644674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:44.939595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.643379+0000","last_change":"2023-10-06T04:39:20.646257+0000","last_active":"2023-10-06T04:39:21.643379+0000","last_peered":"2023-10-06T04:39:21.643379+0000","last_clean":"2023-10-06T04:39:21.643379+0000","last_became_active":"2023-10-06T04:39:20.645914+0000","last_became_peered":"2023-10-06T04:39:20.645914+0000","last_unstale":"2023-10-06T04:39:21.643379+0000","last_undegraded":"2023-10-06T04:39:21.643379+0000","last_fullsized":"2023-10-06T04:39:21.643379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:20.086705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.638557+0000","last_change":"2023-10-06T04:39:21.638557+0000","last_active":"2023-10-06T04:39:21.638557+0000","last_peered":"2023-10-06T04:39:21.638557+0000","last_clean":"2023-10-06T04:39:21.638557+0000","last_became_active":"2023-10-06T04:39:21.638310+0000","last_became_peered":"2023-10-06T04:39:21.638310+0000","last_unstale":"2023-10-06T04:39:21.638557+0000","last_undegraded":"2023-10-06T04:39:21.638557+0000","last_fullsized":"2023-10-06T04:39:21.638557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:26.810840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654092+0000","last_change":"2023-10-06T04:39:20.639506+0000","last_active":"2023-10-06T04:39:21.654092+0000","last_peered":"2023-10-06T04:39:21.654092+0000","last_clean":"2023-10-06T04:39:21.654092+0000","last_became_active":"2023-10-06T04:39:20.639218+0000","last_became_peered":"2023-10-06T04:39:20.639218+0000","last_unstale":"2023-10-06T04:39:21.654092+0000","last_undegraded":"2023-10-06T04:39:21.654092+0000","last_fullsized":"2023-10-06T04:39:21.654092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:34.035323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653773+0000","last_change":"2023-10-06T04:39:21.642939+0000","last_active":"2023-10-06T04:39:21.653773+0000","last_peered":"2023-10-06T04:39:21.653773+0000","last_clean":"2023-10-06T04:39:21.653773+0000","last_became_active":"2023-10-06T04:39:21.642669+0000","last_became_peered":"2023-10-06T04:39:21.642669+0000","last_unstale":"2023-10-06T04:39:21.653773+0000","last_undegraded":"2023-10-06T04:39:21.653773+0000","last_fullsized":"2023-10-06T04:39:21.653773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:35.969836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654879+0000","last_change":"2023-10-06T04:39:20.642036+0000","last_active":"2023-10-06T04:39:21.654879+0000","last_peered":"2023-10-06T04:39:21.654879+0000","last_clean":"2023-10-06T04:39:21.654879+0000","last_became_active":"2023-10-06T04:39:20.641779+0000","last_became_peered":"2023-10-06T04:39:20.641779+0000","last_unstale":"2023-10-06T04:39:21.654879+0000","last_undegraded":"2023-10-06T04:39:21.654879+0000","last_fullsized":"2023-10-06T04:39:21.654879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:25.801442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653650+0000","last_change":"2023-10-06T04:39:21.642305+0000","last_active":"2023-10-06T04:39:21.653650+0000","last_peered":"2023-10-06T04:39:21.653650+0000","last_clean":"2023-10-06T04:39:21.653650+0000","last_became_active":"2023-10-06T04:39:21.642047+0000","last_became_peered":"2023-10-06T04:39:21.642047+0000","last_unstale":"2023-10-06T04:39:21.653650+0000","last_undegraded":"2023-10-06T04:39:21.653650+0000","last_fullsized":"2023-10-06T04:39:21.653650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:46.146563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.645322+0000","last_change":"2023-10-06T04:39:20.638812+0000","last_active":"2023-10-06T04:39:21.645322+0000","last_peered":"2023-10-06T04:39:21.645322+0000","last_clean":"2023-10-06T04:39:21.645322+0000","last_became_active":"2023-10-06T04:39:20.638433+0000","last_became_peered":"2023-10-06T04:39:20.638433+0000","last_unstale":"2023-10-06T04:39:21.645322+0000","last_undegraded":"2023-10-06T04:39:21.645322+0000","last_fullsized":"2023-10-06T04:39:21.645322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:25.801442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641299+0000","last_change":"2023-10-06T04:39:21.639406+0000","last_active":"2023-10-06T04:39:21.641299+0000","last_peered":"2023-10-06T04:39:21.641299+0000","last_clean":"2023-10-06T04:39:21.641299+0000","last_became_active":"2023-10-06T04:39:21.639016+0000","last_became_peered":"2023-10-06T04:39:21.639016+0000","last_unstale":"2023-10-06T04:39:21.641299+0000","last_undegraded":"2023-10-06T04:39:21.641299+0000","last_fullsized":"2023-10-06T04:39:21.641299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:33.545272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656802+0000","last_change":"2023-10-06T04:39:20.644648+0000","last_active":"2023-10-06T04:39:21.656802+0000","last_peered":"2023-10-06T04:39:21.656802+0000","last_clean":"2023-10-06T04:39:21.656802+0000","last_became_active":"2023-10-06T04:39:20.644394+0000","last_became_peered":"2023-10-06T04:39:20.644394+0000","last_unstale":"2023-10-06T04:39:21.656802+0000","last_undegraded":"2023-10-06T04:39:21.656802+0000","last_fullsized":"2023-10-06T04:39:21.656802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:30:33.654378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653532+0000","last_change":"2023-10-06T04:39:21.641164+0000","last_active":"2023-10-06T04:39:21.653532+0000","last_peered":"2023-10-06T04:39:21.653532+0000","last_clean":"2023-10-06T04:39:21.653532+0000","last_became_active":"2023-10-06T04:39:21.640905+0000","last_became_peered":"2023-10-06T04:39:21.640905+0000","last_unstale":"2023-10-06T04:39:21.653532+0000","last_undegraded":"2023-10-06T04:39:21.653532+0000","last_fullsized":"2023-10-06T04:39:21.653532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:08.780680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650176+0000","last_change":"2023-10-06T04:39:21.640076+0000","last_active":"2023-10-06T04:39:21.650176+0000","last_peered":"2023-10-06T04:39:21.650176+0000","last_clean":"2023-10-06T04:39:21.650176+0000","last_became_active":"2023-10-06T04:39:21.639818+0000","last_became_peered":"2023-10-06T04:39:21.639818+0000","last_unstale":"2023-10-06T04:39:21.650176+0000","last_undegraded":"2023-10-06T04:39:21.650176+0000","last_fullsized":"2023-10-06T04:39:21.650176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:14.517515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641319+0000","last_change":"2023-10-06T04:39:21.639647+0000","last_active":"2023-10-06T04:39:21.641319+0000","last_peered":"2023-10-06T04:39:21.641319+0000","last_clean":"2023-10-06T04:39:21.641319+0000","last_became_active":"2023-10-06T04:39:21.639337+0000","last_became_peered":"2023-10-06T04:39:21.639337+0000","last_unstale":"2023-10-06T04:39:21.641319+0000","last_undegraded":"2023-10-06T04:39:21.641319+0000","last_fullsized":"2023-10-06T04:39:21.641319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:50.708331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653972+0000","last_change":"2023-10-06T04:39:21.647332+0000","last_active":"2023-10-06T04:39:21.653972+0000","last_peered":"2023-10-06T04:39:21.653972+0000","last_clean":"2023-10-06T04:39:21.653972+0000","last_became_active":"2023-10-06T04:39:21.647076+0000","last_became_peered":"2023-10-06T04:39:21.647076+0000","last_unstale":"2023-10-06T04:39:21.653972+0000","last_undegraded":"2023-10-06T04:39:21.653972+0000","last_fullsized":"2023-10-06T04:39:21.653972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:31.156663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653564+0000","last_change":"2023-10-06T04:39:21.647332+0000","last_active":"2023-10-06T04:39:21.653564+0000","last_peered":"2023-10-06T04:39:21.653564+0000","last_clean":"2023-10-06T04:39:21.653564+0000","last_became_active":"2023-10-06T04:39:21.647082+0000","last_became_peered":"2023-10-06T04:39:21.647082+0000","last_unstale":"2023-10-06T04:39:21.653564+0000","last_undegraded":"2023-10-06T04:39:21.653564+0000","last_fullsized":"2023-10-06T04:39:21.653564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:53.420342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.646732+0000","last_change":"2023-10-06T04:39:21.646732+0000","last_active":"2023-10-06T04:39:21.646732+0000","last_peered":"2023-10-06T04:39:21.646732+0000","last_clean":"2023-10-06T04:39:21.646732+0000","last_became_active":"2023-10-06T04:39:21.646482+0000","last_became_peered":"2023-10-06T04:39:21.646482+0000","last_unstale":"2023-10-06T04:39:21.646732+0000","last_undegraded":"2023-10-06T04:39:21.646732+0000","last_fullsized":"2023-10-06T04:39:21.646732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:51.885986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":74184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073784,"statfs":{"total":96636764160,"available":96331554816,"internally_reserved":0,"allocated":786432,"data_stored":657911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":196608,"data_stored":68097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":192512,"data_stored":67543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":74274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":196608,"data_stored":66814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:39:26.058 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T04:39:26.058 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T04:39:26.058 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T04:39:26.059 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T04:39:26.059 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T04:39:26.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.205+0000 7fa447fff700 1 Processor -- start 2023-10-06T04:39:26.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.205+0000 7fa447fff700 1 -- start start 2023-10-06T04:39:26.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.206+0000 7fa447fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa4480b11a0 0x7fa4480d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.206+0000 7fa447fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa4480b3810 0x7fa4480b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.206+0000 7fa447fff700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4480afed0 con 0x7fa44806d3b0 2023-10-06T04:39:26.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.206+0000 7fa447fff700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4480b6170 con 0x7fa4480b3810 2023-10-06T04:39:26.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.206+0000 7fa447fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4480b6450 con 0x7fa4480b11a0 2023-10-06T04:39:26.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.206+0000 7fa4477fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa4480b3810 0x7fa4480b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.206+0000 7fa43e7fc700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa44806d3b0 0x7fa4480b1570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54734/0 (socket says 172.21.15.112:54734) 2023-10-06T04:39:26.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.206+0000 7fa43e7fc700 1 -- 172.21.15.112:0/3899023182 learned_addr learned my addr 172.21.15.112:0/3899023182 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:26.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.206+0000 7fa4477fe700 1 -- 172.21.15.112:0/3899023182 >> v2:172.21.15.179:3300/0 conn(0x7fa4480b11a0 msgr2=0x7fa4480d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:26.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.206+0000 7fa446ffd700 1 --2- 172.21.15.112:0/3899023182 >> v2:172.21.15.179:3300/0 conn(0x7fa4480b11a0 0x7fa4480d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.206+0000 7fa4477fe700 1 --2- 172.21.15.112:0/3899023182 >> v2:172.21.15.179:3300/0 conn(0x7fa4480b11a0 0x7fa4480d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.206+0000 7fa4467fc700 1 -- 172.21.15.112:0/3899023182 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252004912 0 0) 0x7fa4480afed0 con 0x7fa44806d3b0 2023-10-06T04:39:26.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.206+0000 7fa4477fe700 1 -- 172.21.15.112:0/3899023182 >> v1:172.21.15.112:6789/0 conn(0x7fa44806d3b0 legacy=0x7fa4480b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.206+0000 7fa4477fe700 1 -- 172.21.15.112:0/3899023182 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4480b6730 con 0x7fa4480b3810 2023-10-06T04:39:26.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.206+0000 7fa446ffd700 1 --2- 172.21.15.112:0/3899023182 >> v2:172.21.15.179:3300/0 conn(0x7fa4480b11a0 0x7fa4480d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:26.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.207+0000 7fa4477fe700 1 --2- 172.21.15.112:0/3899023182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4480b3810 0x7fa4480b3cb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa448088ee0 tx=0x7fa440009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa00b1377ee7ab0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:26.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.207+0000 7fa4467fc700 1 -- 172.21.15.112:0/3899023182 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44000e070 con 0x7fa4480b3810 2023-10-06T04:39:26.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.207+0000 7fa4467fc700 1 -- 172.21.15.112:0/3899023182 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44000bc30 con 0x7fa4480b3810 2023-10-06T04:39:26.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.207+0000 7fa4467fc700 1 -- 172.21.15.112:0/3899023182 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa440012430 con 0x7fa4480b3810 2023-10-06T04:39:26.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.207+0000 7fa447fff700 1 -- 172.21.15.112:0/3899023182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4480b3810 msgr2=0x7fa4480b3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.207+0000 7fa447fff700 1 --2- 172.21.15.112:0/3899023182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4480b3810 0x7fa4480b3cb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa448088ee0 tx=0x7fa440009780 comp rx=0 tx=0).stop 2023-10-06T04:39:26.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.207+0000 7fa447fff700 1 -- 172.21.15.112:0/3899023182 shutdown_connections 2023-10-06T04:39:26.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.207+0000 7fa447fff700 1 --2- 172.21.15.112:0/3899023182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4480b3810 0x7fa4480b3cb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.207+0000 7fa447fff700 1 --2- 172.21.15.112:0/3899023182 >> v2:172.21.15.179:3300/0 conn(0x7fa4480b11a0 0x7fa4480d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.207+0000 7fa447fff700 1 -- 172.21.15.112:0/3899023182 >> 172.21.15.112:0/3899023182 conn(0x7fa44806cfb0 msgr2=0x7fa4480d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:26.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.207+0000 7fa447fff700 1 -- 172.21.15.112:0/3899023182 shutdown_connections 2023-10-06T04:39:26.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.207+0000 7fa447fff700 1 -- 172.21.15.112:0/3899023182 wait complete. 2023-10-06T04:39:26.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.208+0000 7fa447fff700 1 Processor -- start 2023-10-06T04:39:26.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.208+0000 7fa447fff700 1 -- start start 2023-10-06T04:39:26.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.209+0000 7fa447fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa44806d3b0 0x7fa44815c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.209+0000 7fa447fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4480b11a0 0x7fa4480b5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.209+0000 7fa447fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4480b3810 0x7fa448155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.209+0000 7fa447fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480b4f90 con 0x7fa4480b11a0 2023-10-06T04:39:26.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.209+0000 7fa447fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480b4b00 con 0x7fa4480b3810 2023-10-06T04:39:26.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.209+0000 7fa447fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480b3c10 con 0x7fa44806d3b0 2023-10-06T04:39:26.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.209+0000 7fa43e7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4480b11a0 0x7fa4480b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.209+0000 7fa43e7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4480b11a0 0x7fa4480b5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51198/0 (socket says 172.21.15.112:51198) 2023-10-06T04:39:26.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.209+0000 7fa43e7fc700 1 -- 172.21.15.112:0/2892518421 learned_addr learned my addr 172.21.15.112:0/2892518421 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:26.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.209+0000 7fa4477fe700 1 --2- 172.21.15.112:0/2892518421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4480b3810 0x7fa448155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.209+0000 7fa446ffd700 1 --2- 172.21.15.112:0/2892518421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa44806d3b0 0x7fa44815c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.210+0000 7fa43e7fc700 1 -- 172.21.15.112:0/2892518421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa44806d3b0 msgr2=0x7fa44815c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.210+0000 7fa43e7fc700 1 --2- 172.21.15.112:0/2892518421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa44806d3b0 0x7fa44815c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.210+0000 7fa43e7fc700 1 -- 172.21.15.112:0/2892518421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4480b3810 msgr2=0x7fa448155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.210+0000 7fa43e7fc700 1 --2- 172.21.15.112:0/2892518421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4480b3810 0x7fa448155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.210+0000 7fa43e7fc700 1 -- 172.21.15.112:0/2892518421 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa440009a20 con 0x7fa4480b11a0 2023-10-06T04:39:26.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.210+0000 7fa446ffd700 1 --2- 172.21.15.112:0/2892518421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa44806d3b0 0x7fa44815c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:26.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.210+0000 7fa4477fe700 1 --2- 172.21.15.112:0/2892518421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4480b3810 0x7fa448155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:26.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.210+0000 7fa43e7fc700 1 --2- 172.21.15.112:0/2892518421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4480b11a0 0x7fa4480b5410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa43000c5b0 tx=0x7fa430001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:26.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.210+0000 7fa43f7fe700 1 -- 172.21.15.112:0/2892518421 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430005b30 con 0x7fa4480b11a0 2023-10-06T04:39:26.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.210+0000 7fa43f7fe700 1 -- 172.21.15.112:0/2892518421 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa430005c90 con 0x7fa4480b11a0 2023-10-06T04:39:26.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.210+0000 7fa43f7fe700 1 -- 172.21.15.112:0/2892518421 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430007300 con 0x7fa4480b11a0 2023-10-06T04:39:26.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.210+0000 7fa447fff700 1 -- 172.21.15.112:0/2892518421 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4480b3ef0 con 0x7fa4480b11a0 2023-10-06T04:39:26.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.210+0000 7fa447fff700 1 -- 172.21.15.112:0/2892518421 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4480b44b0 con 0x7fa4480b11a0 2023-10-06T04:39:26.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.211+0000 7fa447fff700 1 -- 172.21.15.112:0/2892518421 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44805f230 con 0x7fa4480b11a0 2023-10-06T04:39:26.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.211+0000 7fa43f7fe700 1 -- 172.21.15.112:0/2892518421 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4300076b0 con 0x7fa4480b11a0 2023-10-06T04:39:26.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.212+0000 7fa43f7fe700 1 --2- 172.21.15.112:0/2892518421 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa428066f30 0x7fa4280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.212+0000 7fa446ffd700 1 --2- 172.21.15.112:0/2892518421 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa428066f30 0x7fa4280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.212+0000 7fa43f7fe700 1 -- 172.21.15.112:0/2892518421 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa430083bd0 con 0x7fa4480b11a0 2023-10-06T04:39:26.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.212+0000 7fa446ffd700 1 --2- 172.21.15.112:0/2892518421 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa428066f30 0x7fa4280693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa438006fd0 tx=0x7fa438008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:26.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.216+0000 7fa43f7fe700 1 -- 172.21.15.112:0/2892518421 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa430050c40 con 0x7fa4480b11a0 2023-10-06T04:39:26.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.454+0000 7fa447fff700 1 -- 172.21.15.112:0/2892518421 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa4480b4c40 con 0x7fa4480b11a0 2023-10-06T04:39:26.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.457+0000 7fa43f7fe700 1 -- 172.21.15.112:0/2892518421 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163705 (secure 0 0 0) 0x7fa430017090 con 0x7fa4480b11a0 2023-10-06T04:39:26.460 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:26.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.459+0000 7fa447fff700 1 -- 172.21.15.112:0/2892518421 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa428066f30 msgr2=0x7fa4280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.459+0000 7fa447fff700 1 --2- 172.21.15.112:0/2892518421 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa428066f30 0x7fa4280693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa438006fd0 tx=0x7fa438008040 comp rx=0 tx=0).stop 2023-10-06T04:39:26.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.459+0000 7fa447fff700 1 -- 172.21.15.112:0/2892518421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4480b11a0 msgr2=0x7fa4480b5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.459+0000 7fa447fff700 1 --2- 172.21.15.112:0/2892518421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4480b11a0 0x7fa4480b5410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa43000c5b0 tx=0x7fa430001070 comp rx=0 tx=0).stop 2023-10-06T04:39:26.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.459+0000 7fa447fff700 1 -- 172.21.15.112:0/2892518421 shutdown_connections 2023-10-06T04:39:26.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.459+0000 7fa447fff700 1 --2- 172.21.15.112:0/2892518421 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa428066f30 0x7fa4280693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.459+0000 7fa447fff700 1 --2- 172.21.15.112:0/2892518421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4480b3810 0x7fa448155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.459+0000 7fa447fff700 1 --2- 172.21.15.112:0/2892518421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa44806d3b0 0x7fa44815c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.459+0000 7fa447fff700 1 --2- 172.21.15.112:0/2892518421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4480b11a0 0x7fa4480b5410 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.459+0000 7fa447fff700 1 -- 172.21.15.112:0/2892518421 >> 172.21.15.112:0/2892518421 conn(0x7fa44806cfb0 msgr2=0x7fa4480d09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:26.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.459+0000 7fa447fff700 1 -- 172.21.15.112:0/2892518421 shutdown_connections 2023-10-06T04:39:26.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.459+0000 7fa447fff700 1 -- 172.21.15.112:0/2892518421 wait complete. 2023-10-06T04:39:26.472 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":5,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":90409},{"type":"v1","addr":"172.21.15.112:6833","nonce":90409}]},"active_addr":"172.21.15.112:6833/90409","active_change":"2023-10-06T04:39:08.268958+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":3861466522}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":1224448916}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":135902333}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":1590427899}]}]} 2023-10-06T04:39:26.476 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T04:39:26.476 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T04:39:26.477 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:26.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.589+0000 7f475d31a700 1 Processor -- start 2023-10-06T04:39:26.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.589+0000 7f475d31a700 1 -- start start 2023-10-06T04:39:26.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.590+0000 7f475d31a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4758159d50 0x7f47580b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.590+0000 7f475d31a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f475815a120 0x7f47580cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.590+0000 7f475d31a700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47580cd740 con 0x7f47580b0e70 2023-10-06T04:39:26.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.590+0000 7f475d31a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47580ccb30 con 0x7f475815a120 2023-10-06T04:39:26.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.590+0000 7f475d31a700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47580cce10 con 0x7f4758159d50 2023-10-06T04:39:26.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.590+0000 7f474e7fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f475815a120 0x7f47580cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.590+0000 7f474e7fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f475815a120 0x7f47580cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51212/0 (socket says 172.21.15.112:51212) 2023-10-06T04:39:26.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.590+0000 7f474e7fc700 1 -- 172.21.15.112:0/961926913 learned_addr learned my addr 172.21.15.112:0/961926913 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:26.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.590+0000 7f4756ffd700 1 --2- 172.21.15.112:0/961926913 >> v2:172.21.15.179:3300/0 conn(0x7f4758159d50 0x7f47580b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.590+0000 7f474e7fc700 1 -- 172.21.15.112:0/961926913 >> v2:172.21.15.179:3300/0 conn(0x7f4758159d50 msgr2=0x7f47580b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:26.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.590+0000 7f474e7fc700 1 --2- 172.21.15.112:0/961926913 >> v2:172.21.15.179:3300/0 conn(0x7f4758159d50 0x7f47580b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.590+0000 7f474e7fc700 1 -- 172.21.15.112:0/961926913 >> v1:172.21.15.179:6789/0 conn(0x7f47580b0e70 legacy=0x7f47580b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:26.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.590+0000 7f474e7fc700 1 -- 172.21.15.112:0/961926913 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47580cd0f0 con 0x7f475815a120 2023-10-06T04:39:26.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.590+0000 7f474e7fc700 1 --2- 172.21.15.112:0/961926913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f475815a120 0x7f47580cdbd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4758088770 tx=0x7f4740009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa8b589c9abddf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:26.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.591+0000 7f47567fc700 1 -- 172.21.15.112:0/961926913 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474000b820 con 0x7f475815a120 2023-10-06T04:39:26.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.591+0000 7f47567fc700 1 -- 172.21.15.112:0/961926913 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474000b980 con 0x7f475815a120 2023-10-06T04:39:26.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.591+0000 7f47567fc700 1 -- 172.21.15.112:0/961926913 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474000bd20 con 0x7f475815a120 2023-10-06T04:39:26.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.591+0000 7f475d31a700 1 -- 172.21.15.112:0/961926913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f475815a120 msgr2=0x7f47580cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.591+0000 7f475d31a700 1 --2- 172.21.15.112:0/961926913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f475815a120 0x7f47580cdbd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4758088770 tx=0x7f4740009250 comp rx=0 tx=0).stop 2023-10-06T04:39:26.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.591+0000 7f475d31a700 1 -- 172.21.15.112:0/961926913 shutdown_connections 2023-10-06T04:39:26.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.591+0000 7f475d31a700 1 --2- 172.21.15.112:0/961926913 >> v2:172.21.15.179:3300/0 conn(0x7f4758159d50 0x7f47580b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.591+0000 7f475d31a700 1 --2- 172.21.15.112:0/961926913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f475815a120 0x7f47580cdbd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.591+0000 7f475d31a700 1 -- 172.21.15.112:0/961926913 >> 172.21.15.112:0/961926913 conn(0x7f4758099b60 msgr2=0x7f475806cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:26.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.591+0000 7f475d31a700 1 -- 172.21.15.112:0/961926913 shutdown_connections 2023-10-06T04:39:26.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.591+0000 7f475d31a700 1 -- 172.21.15.112:0/961926913 wait complete. 2023-10-06T04:39:26.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.592+0000 7f475d31a700 1 Processor -- start 2023-10-06T04:39:26.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.592+0000 7f475d31a700 1 -- start start 2023-10-06T04:39:26.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.593+0000 7f475d31a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47580b0e70 0x7f475814de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.593+0000 7f475d31a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4758159d50 0x7f475809e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.593+0000 7f475d31a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f475815a120 0x7f4758140de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.593+0000 7f475d31a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4758141320 con 0x7f475815a120 2023-10-06T04:39:26.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.593+0000 7f475d31a700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475815da80 con 0x7f47580b0e70 2023-10-06T04:39:26.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.593+0000 7f475d31a700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475815dd60 con 0x7f4758159d50 2023-10-06T04:39:26.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.593+0000 7f47577fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f475815a120 0x7f4758140de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.593+0000 7f47577fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f475815a120 0x7f4758140de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51228/0 (socket says 172.21.15.112:51228) 2023-10-06T04:39:26.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.593+0000 7f47577fe700 1 -- 172.21.15.112:0/3776613561 learned_addr learned my addr 172.21.15.112:0/3776613561 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:26.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.593+0000 7f4756ffd700 1 --2- 172.21.15.112:0/3776613561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47580b0e70 0x7f475814de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.593+0000 7f474e7fc700 1 --2- 172.21.15.112:0/3776613561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4758159d50 0x7f475809e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.593+0000 7f47577fe700 1 -- 172.21.15.112:0/3776613561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4758159d50 msgr2=0x7f475809e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.593+0000 7f47577fe700 1 --2- 172.21.15.112:0/3776613561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4758159d50 0x7f475809e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.593+0000 7f47577fe700 1 -- 172.21.15.112:0/3776613561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47580b0e70 msgr2=0x7f475814de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.593+0000 7f47577fe700 1 --2- 172.21.15.112:0/3776613561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47580b0e70 0x7f475814de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.593+0000 7f47577fe700 1 -- 172.21.15.112:0/3776613561 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47400094f0 con 0x7f475815a120 2023-10-06T04:39:26.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.593+0000 7f4756ffd700 1 --2- 172.21.15.112:0/3776613561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47580b0e70 0x7f475814de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:26.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.593+0000 7f474e7fc700 1 --2- 172.21.15.112:0/3776613561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4758159d50 0x7f475809e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:26.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.594+0000 7f47577fe700 1 --2- 172.21.15.112:0/3776613561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f475815a120 0x7f4758140de0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f475000bbb0 tx=0x7f4750009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:26.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.594+0000 7f474f7fe700 1 -- 172.21.15.112:0/3776613561 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47500092e0 con 0x7f475815a120 2023-10-06T04:39:26.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.594+0000 7f474f7fe700 1 -- 172.21.15.112:0/3776613561 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475000c7a0 con 0x7f475815a120 2023-10-06T04:39:26.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.594+0000 7f475d31a700 1 -- 172.21.15.112:0/3776613561 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475815e040 con 0x7f475815a120 2023-10-06T04:39:26.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.594+0000 7f474f7fe700 1 -- 172.21.15.112:0/3776613561 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475000cb40 con 0x7f475815a120 2023-10-06T04:39:26.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.594+0000 7f475d31a700 1 -- 172.21.15.112:0/3776613561 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475815e600 con 0x7f475815a120 2023-10-06T04:39:26.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.595+0000 7f475d31a700 1 -- 172.21.15.112:0/3776613561 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475805f230 con 0x7f475815a120 2023-10-06T04:39:26.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.596+0000 7f474f7fe700 1 -- 172.21.15.112:0/3776613561 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4750012070 con 0x7f475815a120 2023-10-06T04:39:26.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.596+0000 7f474f7fe700 1 --2- 172.21.15.112:0/3776613561 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4738066f30 0x7f47380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.596+0000 7f474f7fe700 1 -- 172.21.15.112:0/3776613561 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4750084470 con 0x7f475815a120 2023-10-06T04:39:26.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.596+0000 7f4756ffd700 1 --2- 172.21.15.112:0/3776613561 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4738066f30 0x7f47380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.596+0000 7f4756ffd700 1 --2- 172.21.15.112:0/3776613561 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4738066f30 0x7f47380693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4748008a80 tx=0x7f4748008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:26.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.600+0000 7f474f7fe700 1 -- 172.21.15.112:0/3776613561 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f475004d5a0 con 0x7f475815a120 2023-10-06T04:39:26.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.788+0000 7f475d31a700 1 -- 172.21.15.112:0/3776613561 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f475808a910 con 0x7f475815a120 2023-10-06T04:39:26.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.789+0000 7f474f7fe700 1 -- 172.21.15.112:0/3776613561 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f4750051600 con 0x7f475815a120 2023-10-06T04:39:26.790 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:26.790 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:39:22.637355+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:18.657040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:19.972295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:26.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.791+0000 7f475d31a700 1 -- 172.21.15.112:0/3776613561 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4738066f30 msgr2=0x7f47380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.791+0000 7f475d31a700 1 --2- 172.21.15.112:0/3776613561 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4738066f30 0x7f47380693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4748008a80 tx=0x7f4748008040 comp rx=0 tx=0).stop 2023-10-06T04:39:26.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.791+0000 7f475d31a700 1 -- 172.21.15.112:0/3776613561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f475815a120 msgr2=0x7f4758140de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.791+0000 7f475d31a700 1 --2- 172.21.15.112:0/3776613561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f475815a120 0x7f4758140de0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f475000bbb0 tx=0x7f4750009840 comp rx=0 tx=0).stop 2023-10-06T04:39:26.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.791+0000 7f475d31a700 1 -- 172.21.15.112:0/3776613561 shutdown_connections 2023-10-06T04:39:26.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.791+0000 7f475d31a700 1 --2- 172.21.15.112:0/3776613561 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4738066f30 0x7f47380693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.791+0000 7f475d31a700 1 --2- 172.21.15.112:0/3776613561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f475815a120 0x7f4758140de0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.791+0000 7f475d31a700 1 --2- 172.21.15.112:0/3776613561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47580b0e70 0x7f475814de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.791+0000 7f475d31a700 1 --2- 172.21.15.112:0/3776613561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4758159d50 0x7f475809e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.791+0000 7f475d31a700 1 -- 172.21.15.112:0/3776613561 >> 172.21.15.112:0/3776613561 conn(0x7f4758099b60 msgr2=0x7f47580ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:26.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.791+0000 7f475d31a700 1 -- 172.21.15.112:0/3776613561 shutdown_connections 2023-10-06T04:39:26.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.791+0000 7f475d31a700 1 -- 172.21.15.112:0/3776613561 wait complete. 2023-10-06T04:39:26.804 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T04:39:26.804 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:26.882 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:39:26.884 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:39:26.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.920+0000 7fb69de81700 1 Processor -- start 2023-10-06T04:39:26.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.920+0000 7fb69de81700 1 -- start start 2023-10-06T04:39:26.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.921+0000 7fb69de81700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb69815aa00 0x7fb6981585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.921+0000 7fb69de81700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb698067eb0 0x7fb698068320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.921+0000 7fb69de81700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb698068860 con 0x7fb698069690 2023-10-06T04:39:26.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.921+0000 7fb69de81700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb698158b30 con 0x7fb698067eb0 2023-10-06T04:39:26.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.921+0000 7fb69de81700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69815b500 con 0x7fb69815aa00 2023-10-06T04:39:26.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.921+0000 7fb696ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb698067eb0 0x7fb698068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.921+0000 7fb697fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb698069690 0x7fb698069a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54736/0 (socket says 172.21.15.112:54736) 2023-10-06T04:39:26.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.921+0000 7fb697fff700 1 -- 172.21.15.112:0/1819178208 learned_addr learned my addr 172.21.15.112:0/1819178208 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:26.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.921+0000 7fb6977fe700 1 --2- 172.21.15.112:0/1819178208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb69815aa00 0x7fb6981585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.921+0000 7fb696ffd700 1 -- 172.21.15.112:0/1819178208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb69815aa00 msgr2=0x7fb6981585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:26.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.921+0000 7fb696ffd700 1 --2- 172.21.15.112:0/1819178208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb69815aa00 0x7fb6981585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.921+0000 7fb696ffd700 1 -- 172.21.15.112:0/1819178208 >> v1:172.21.15.112:6789/0 conn(0x7fb698069690 legacy=0x7fb698069a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.921+0000 7fb6967fc700 1 -- 172.21.15.112:0/1819178208 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247706059 0 0) 0x7fb698068860 con 0x7fb698069690 2023-10-06T04:39:26.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.921+0000 7fb696ffd700 1 -- 172.21.15.112:0/1819178208 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69815b7e0 con 0x7fb698067eb0 2023-10-06T04:39:26.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.921+0000 7fb6977fe700 1 --2- 172.21.15.112:0/1819178208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb69815aa00 0x7fb6981585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:26.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.921+0000 7fb696ffd700 1 --2- 172.21.15.112:0/1819178208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb698067eb0 0x7fb698068320 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb6880098e0 tx=0x7fb6880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5fe062378a5951 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:26.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.921+0000 7fb6967fc700 1 -- 172.21.15.112:0/1819178208 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb688009e80 con 0x7fb698067eb0 2023-10-06T04:39:26.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.921+0000 7fb6967fc700 1 -- 172.21.15.112:0/1819178208 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68800b860 con 0x7fb698067eb0 2023-10-06T04:39:26.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.921+0000 7fb6967fc700 1 -- 172.21.15.112:0/1819178208 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68800bbe0 con 0x7fb698067eb0 2023-10-06T04:39:26.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.922+0000 7fb69de81700 1 -- 172.21.15.112:0/1819178208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb698067eb0 msgr2=0x7fb698068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.922+0000 7fb69de81700 1 --2- 172.21.15.112:0/1819178208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb698067eb0 0x7fb698068320 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb6880098e0 tx=0x7fb6880091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.922+0000 7fb69de81700 1 -- 172.21.15.112:0/1819178208 shutdown_connections 2023-10-06T04:39:26.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.922+0000 7fb69de81700 1 --2- 172.21.15.112:0/1819178208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb69815aa00 0x7fb6981585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.922+0000 7fb69de81700 1 --2- 172.21.15.112:0/1819178208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb698067eb0 0x7fb698068320 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.922+0000 7fb69de81700 1 -- 172.21.15.112:0/1819178208 >> 172.21.15.112:0/1819178208 conn(0x7fb6980ce5e0 msgr2=0x7fb6980ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:26.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.922+0000 7fb69de81700 1 -- 172.21.15.112:0/1819178208 shutdown_connections 2023-10-06T04:39:26.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.922+0000 7fb69de81700 1 -- 172.21.15.112:0/1819178208 wait complete. 2023-10-06T04:39:26.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.923+0000 7fb69de81700 1 Processor -- start 2023-10-06T04:39:26.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.923+0000 7fb69de81700 1 -- start start 2023-10-06T04:39:26.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.924+0000 7fb69de81700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb698067eb0 0x7fb6981568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.924+0000 7fb69de81700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb698069690 0x7fb6981561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.924+0000 7fb69de81700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb69815aa00 0x7fb6980c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.924+0000 7fb69de81700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6980b3860 con 0x7fb698067eb0 2023-10-06T04:39:26.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.924+0000 7fb69de81700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb698156730 con 0x7fb69815aa00 2023-10-06T04:39:26.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.924+0000 7fb69de81700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6980b3580 con 0x7fb698069690 2023-10-06T04:39:26.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.924+0000 7fb6977fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb698067eb0 0x7fb6981568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.924+0000 7fb6977fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb698067eb0 0x7fb6981568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51252/0 (socket says 172.21.15.112:51252) 2023-10-06T04:39:26.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.924+0000 7fb6977fe700 1 -- 172.21.15.112:0/875204093 learned_addr learned my addr 172.21.15.112:0/875204093 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:26.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.924+0000 7fb696ffd700 1 --2- 172.21.15.112:0/875204093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb698069690 0x7fb6981561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.924+0000 7fb6977fe700 1 -- 172.21.15.112:0/875204093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb698069690 msgr2=0x7fb6981561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.924+0000 7fb6977fe700 1 --2- 172.21.15.112:0/875204093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb698069690 0x7fb6981561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.924+0000 7fb6977fe700 1 -- 172.21.15.112:0/875204093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb69815aa00 msgr2=0x7fb6980c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:26.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.924+0000 7fb6977fe700 1 --2- 172.21.15.112:0/875204093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb69815aa00 0x7fb6980c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:26.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.924+0000 7fb6977fe700 1 -- 172.21.15.112:0/875204093 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb688009420 con 0x7fb698067eb0 2023-10-06T04:39:26.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.924+0000 7fb6977fe700 1 --2- 172.21.15.112:0/875204093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb698067eb0 0x7fb6981568c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00c850 tx=0x7fb68c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:26.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.924+0000 7fb67f7fe700 1 -- 172.21.15.112:0/875204093 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c011600 con 0x7fb698067eb0 2023-10-06T04:39:26.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.924+0000 7fb67f7fe700 1 -- 172.21.15.112:0/875204093 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c011760 con 0x7fb698067eb0 2023-10-06T04:39:26.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.924+0000 7fb69de81700 1 -- 172.21.15.112:0/875204093 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6980c2a70 con 0x7fb698067eb0 2023-10-06T04:39:26.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.925+0000 7fb67f7fe700 1 -- 172.21.15.112:0/875204093 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c011b00 con 0x7fb698067eb0 2023-10-06T04:39:26.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.925+0000 7fb69de81700 1 -- 172.21.15.112:0/875204093 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6980b09b0 con 0x7fb698067eb0 2023-10-06T04:39:26.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.925+0000 7fb69de81700 1 -- 172.21.15.112:0/875204093 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69805f230 con 0x7fb698067eb0 2023-10-06T04:39:26.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.926+0000 7fb67f7fe700 1 -- 172.21.15.112:0/875204093 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb68c0073b0 con 0x7fb698067eb0 2023-10-06T04:39:26.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.926+0000 7fb67f7fe700 1 --2- 172.21.15.112:0/875204093 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb684066f30 0x7fb6840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:26.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.926+0000 7fb67f7fe700 1 -- 172.21.15.112:0/875204093 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb68c084690 con 0x7fb698067eb0 2023-10-06T04:39:26.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.926+0000 7fb696ffd700 1 --2- 172.21.15.112:0/875204093 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb684066f30 0x7fb6840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:26.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.927+0000 7fb696ffd700 1 --2- 172.21.15.112:0/875204093 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb684066f30 0x7fb6840693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb6880091e0 tx=0x7fb688017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:26.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:26.931+0000 7fb67f7fe700 1 -- 172.21.15.112:0/875204093 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb68c055230 con 0x7fb698067eb0 2023-10-06T04:39:27.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.114+0000 7fb69de81700 1 -- 172.21.15.112:0/875204093 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb69815bac0 con 0x7fb698067eb0 2023-10-06T04:39:27.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.115+0000 7fb67f7fe700 1 -- 172.21.15.112:0/875204093 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7fb68c054dc0 con 0x7fb698067eb0 2023-10-06T04:39:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:27.116 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:39:22.637355+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:18.657040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:19.972295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:27.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.117+0000 7fb69de81700 1 -- 172.21.15.112:0/875204093 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb684066f30 msgr2=0x7fb6840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.117+0000 7fb69de81700 1 --2- 172.21.15.112:0/875204093 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb684066f30 0x7fb6840693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb6880091e0 tx=0x7fb688017000 comp rx=0 tx=0).stop 2023-10-06T04:39:27.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.117+0000 7fb69de81700 1 -- 172.21.15.112:0/875204093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb698067eb0 msgr2=0x7fb6981568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.117+0000 7fb69de81700 1 --2- 172.21.15.112:0/875204093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb698067eb0 0x7fb6981568c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00c850 tx=0x7fb68c008040 comp rx=0 tx=0).stop 2023-10-06T04:39:27.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.117+0000 7fb69de81700 1 -- 172.21.15.112:0/875204093 shutdown_connections 2023-10-06T04:39:27.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.117+0000 7fb69de81700 1 --2- 172.21.15.112:0/875204093 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb684066f30 0x7fb6840693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.117+0000 7fb69de81700 1 --2- 172.21.15.112:0/875204093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb69815aa00 0x7fb6980c7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.117+0000 7fb69de81700 1 --2- 172.21.15.112:0/875204093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb698067eb0 0x7fb6981568c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.117+0000 7fb69de81700 1 --2- 172.21.15.112:0/875204093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb698069690 0x7fb6981561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.117+0000 7fb69de81700 1 -- 172.21.15.112:0/875204093 >> 172.21.15.112:0/875204093 conn(0x7fb6980ce5e0 msgr2=0x7fb6980682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.117+0000 7fb69de81700 1 -- 172.21.15.112:0/875204093 shutdown_connections 2023-10-06T04:39:27.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.117+0000 7fb69de81700 1 -- 172.21.15.112:0/875204093 wait complete. 2023-10-06T04:39:27.131 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T04:39:27.131 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T04:39:27.132 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T04:39:27.132 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T04:39:27.133 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T04:39:27.133 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T04:39:27.134 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T04:39:27.134 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T04:39:27.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.321+0000 7fa73e620700 1 Processor -- start 2023-10-06T04:39:27.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.323+0000 7fa73e620700 1 -- start start 2023-10-06T04:39:27.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.324+0000 7fa73e620700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa73806df90 0x7fa7380ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.324+0000 7fa73e620700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa73815d8b0 0x7fa73815dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.324+0000 7fa73e620700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73806d3e0 con 0x7fa73806e360 2023-10-06T04:39:27.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.324+0000 7fa73e620700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73806c7d0 con 0x7fa73806df90 2023-10-06T04:39:27.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.324+0000 7fa73e620700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73806cab0 con 0x7fa73815d8b0 2023-10-06T04:39:27.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.326+0000 7f1bd3471700 1 Processor -- start 2023-10-06T04:39:27.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.326+0000 7f1bd3471700 1 -- start start 2023-10-06T04:39:27.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.327+0000 7f1bd3471700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bcc06dce0 0x7f1bcc06bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.327+0000 7f1bd3471700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1bcc06e0b0 0x7f1bcc0c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.327+0000 7f1bd3471700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bcc06b7b0 con 0x7f1bcc0c9c20 2023-10-06T04:39:27.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.327+0000 7f1bd3471700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bcc0ca1a0 con 0x7f1bcc06e0b0 2023-10-06T04:39:27.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.327+0000 7f1bd3471700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc06ae80 con 0x7f1bcc06dce0 2023-10-06T04:39:27.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.328+0000 7f1bd0a0c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1bcc06e0b0 0x7f1bcc0c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.328+0000 7f1bd0a0c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1bcc06e0b0 0x7f1bcc0c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51276/0 (socket says 172.21.15.112:51276) 2023-10-06T04:39:27.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.328+0000 7f1bd0a0c700 1 -- 172.21.15.112:0/267094217 learned_addr learned my addr 172.21.15.112:0/267094217 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.328+0000 7fa73d61e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa73806df90 0x7fa7380ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.328+0000 7fa73d61e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa73806df90 0x7fa7380ad4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51260/0 (socket says 172.21.15.112:51260) 2023-10-06T04:39:27.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.328+0000 7fa73d61e700 1 -- 172.21.15.112:0/3550625099 learned_addr learned my addr 172.21.15.112:0/3550625099 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.328+0000 7f1bd120d700 1 --2- 172.21.15.112:0/267094217 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bcc06dce0 0x7f1bcc06bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.328+0000 7f1bd0a0c700 1 -- 172.21.15.112:0/267094217 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bcc06dce0 msgr2=0x7f1bcc06bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:27.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.328+0000 7f1bd0a0c700 1 --2- 172.21.15.112:0/267094217 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bcc06dce0 0x7f1bcc06bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.328+0000 7f1bd0a0c700 1 -- 172.21.15.112:0/267094217 >> v1:172.21.15.112:6789/0 conn(0x7f1bcc0c9c20 legacy=0x7f1bcc06c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:27.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.328+0000 7f1bd0a0c700 1 -- 172.21.15.112:0/267094217 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc06b160 con 0x7f1bcc06e0b0 2023-10-06T04:39:27.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.328+0000 7fa73d61e700 1 -- 172.21.15.112:0/3550625099 >> v2:172.21.15.179:3300/0 conn(0x7fa73815d8b0 msgr2=0x7fa73815dd10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T04:39:27.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.328+0000 7fa73d61e700 1 --2- 172.21.15.112:0/3550625099 >> v2:172.21.15.179:3300/0 conn(0x7fa73815d8b0 0x7fa73815dd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.328+0000 7fa73d61e700 1 -- 172.21.15.112:0/3550625099 >> v1:172.21.15.179:6789/0 conn(0x7fa73806e360 legacy=0x7fa7380ada10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T04:39:27.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.328+0000 7fa73d61e700 1 -- 172.21.15.112:0/3550625099 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73806cd90 con 0x7fa73806df90 2023-10-06T04:39:27.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.328+0000 7f1bd0a0c700 1 --2- 172.21.15.112:0/267094217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bcc06e0b0 0x7f1bcc0c96e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80099b0 tx=0x7f1bc8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ebc8554baf727a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.329+0000 7f1bc3fff700 1 -- 172.21.15.112:0/267094217 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc800b820 con 0x7f1bcc06e0b0 2023-10-06T04:39:27.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.328+0000 7fa73d61e700 1 --2- 172.21.15.112:0/3550625099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa73806df90 0x7fa7380ad4d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa734009990 tx=0x7fa734009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f6029b327413ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.329+0000 7f1bc3fff700 1 -- 172.21.15.112:0/267094217 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc800b980 con 0x7f1bcc06e0b0 2023-10-06T04:39:27.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.329+0000 7f1bc3fff700 1 -- 172.21.15.112:0/267094217 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc800bd20 con 0x7f1bcc06e0b0 2023-10-06T04:39:27.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.329+0000 7fa72ffff700 1 -- 172.21.15.112:0/3550625099 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734005c10 con 0x7fa73806df90 2023-10-06T04:39:27.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.329+0000 7fa72ffff700 1 -- 172.21.15.112:0/3550625099 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa734005d70 con 0x7fa73806df90 2023-10-06T04:39:27.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.329+0000 7fa72ffff700 1 -- 172.21.15.112:0/3550625099 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400b890 con 0x7fa73806df90 2023-10-06T04:39:27.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.329+0000 7f1bd3471700 1 -- 172.21.15.112:0/267094217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bcc06e0b0 msgr2=0x7f1bcc0c96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.329+0000 7f1bd3471700 1 --2- 172.21.15.112:0/267094217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bcc06e0b0 0x7f1bcc0c96e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80099b0 tx=0x7f1bc8009250 comp rx=0 tx=0).stop 2023-10-06T04:39:27.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.330+0000 7f1bd3471700 1 -- 172.21.15.112:0/267094217 shutdown_connections 2023-10-06T04:39:27.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.330+0000 7f1bd3471700 1 --2- 172.21.15.112:0/267094217 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bcc06dce0 0x7f1bcc06bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.330+0000 7f1bd3471700 1 --2- 172.21.15.112:0/267094217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bcc06e0b0 0x7f1bcc0c96e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.330+0000 7f1bd3471700 1 -- 172.21.15.112:0/267094217 >> 172.21.15.112:0/267094217 conn(0x7f1bcc06d8e0 msgr2=0x7f1bcc0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.330+0000 7fe656899700 1 Processor -- start 2023-10-06T04:39:27.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.330+0000 7fa73e620700 1 -- 172.21.15.112:0/3550625099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa73806df90 msgr2=0x7fa7380ad4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.330+0000 7fa73e620700 1 --2- 172.21.15.112:0/3550625099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa73806df90 0x7fa7380ad4d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa734009990 tx=0x7fa734009220 comp rx=0 tx=0).stop 2023-10-06T04:39:27.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.330+0000 7fe656899700 1 -- start start 2023-10-06T04:39:27.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.331+0000 7f1bd3471700 1 -- 172.21.15.112:0/267094217 shutdown_connections 2023-10-06T04:39:27.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.331+0000 7fbafc804700 1 Processor -- start 2023-10-06T04:39:27.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.331+0000 7fbafc804700 1 -- start start 2023-10-06T04:39:27.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.331+0000 7fe656899700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe650161710 0x7fe6500ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.331+0000 7fe656899700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65015e520 con 0x7fe650161340 2023-10-06T04:39:27.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.331+0000 7fe656899700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65006be70 con 0x7fe6500acfe0 2023-10-06T04:39:27.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.331+0000 7fe656899700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe65006e7b0 con 0x7fe650161710 2023-10-06T04:39:27.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.331+0000 7fa73e620700 1 -- 172.21.15.112:0/3550625099 shutdown_connections 2023-10-06T04:39:27.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.331+0000 7fa73e620700 1 --2- 172.21.15.112:0/3550625099 >> v2:172.21.15.179:3300/0 conn(0x7fa73815d8b0 0x7fa73815dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.331+0000 7fa73e620700 1 --2- 172.21.15.112:0/3550625099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa73806df90 0x7fa7380ad4d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.331+0000 7fa73e620700 1 -- 172.21.15.112:0/3550625099 >> 172.21.15.112:0/3550625099 conn(0x7fa73806d8e0 msgr2=0x7fa7380b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.331+0000 7f1bd3471700 1 -- 172.21.15.112:0/267094217 wait complete. 2023-10-06T04:39:27.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.331+0000 7fa73e620700 1 -- 172.21.15.112:0/3550625099 shutdown_connections 2023-10-06T04:39:27.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.331+0000 7fe64ffff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe650161340 0x7fe6500ac8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54740/0 (socket says 172.21.15.112:54740) 2023-10-06T04:39:27.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.331+0000 7fe64ffff700 1 -- 172.21.15.112:0/2448318250 learned_addr learned my addr 172.21.15.112:0/2448318250 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:27.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.331+0000 7fa73e620700 1 -- 172.21.15.112:0/3550625099 wait complete. 2023-10-06T04:39:27.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.332+0000 7fbafc804700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbaf8159b00 0x7fbaf8157f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.332+0000 7fbafc804700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf806cf30 con 0x7fbaf8159ed0 2023-10-06T04:39:27.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.332+0000 7fbafc804700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf80af550 con 0x7fbaf80cae00 2023-10-06T04:39:27.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.332+0000 7fbafc804700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf806b790 con 0x7fbaf8159b00 2023-10-06T04:39:27.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.332+0000 7fbaf5d9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fbaf8159ed0 0x7fbaf80ca6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54748/0 (socket says 172.21.15.112:54748) 2023-10-06T04:39:27.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.332+0000 7fbaf5d9b700 1 -- 172.21.15.112:0/1253981473 learned_addr learned my addr 172.21.15.112:0/1253981473 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:27.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.333+0000 7fbaf659c700 1 --2- 172.21.15.112:0/1253981473 >> v2:172.21.15.179:3300/0 conn(0x7fbaf8159b00 0x7fbaf8157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.333+0000 7fbaf659c700 1 -- 172.21.15.112:0/1253981473 >> v1:172.21.15.179:6789/0 conn(0x7fbaf80cae00 legacy=0x7fbaf806d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:27.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.333+0000 7fbaf659c700 1 -- 172.21.15.112:0/1253981473 >> v1:172.21.15.112:6789/0 conn(0x7fbaf8159ed0 legacy=0x7fbaf80ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.333+0000 7fbaf659c700 1 -- 172.21.15.112:0/1253981473 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf80af270 con 0x7fbaf8159b00 2023-10-06T04:39:27.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.332+0000 7fe654e36700 1 --2- 172.21.15.112:0/2448318250 >> v2:172.21.15.112:3300/0 conn(0x7fe650161710 0x7fe6500ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.332+0000 7fe64effd700 1 -- 172.21.15.112:0/2448318250 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260979094 0 0) 0x7fe65006be70 con 0x7fe6500acfe0 2023-10-06T04:39:27.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.332+0000 7fe654e36700 1 -- 172.21.15.112:0/2448318250 >> v1:172.21.15.179:6789/0 conn(0x7fe6500acfe0 legacy=0x7fe650069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.332+0000 7fe654e36700 1 -- 172.21.15.112:0/2448318250 >> v1:172.21.15.112:6789/0 conn(0x7fe650161340 legacy=0x7fe6500ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.332+0000 7fe654e36700 1 -- 172.21.15.112:0/2448318250 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65006b260 con 0x7fe650161710 2023-10-06T04:39:27.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.332+0000 7fe654e36700 1 --2- 172.21.15.112:0/2448318250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe650161710 0x7fe6500ae7e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe648009e60 tx=0x7fe648009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3136b681395f887 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.332+0000 7fe64effd700 1 -- 172.21.15.112:0/2448318250 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64800e070 con 0x7fe650161710 2023-10-06T04:39:27.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.332+0000 7fe64effd700 1 -- 172.21.15.112:0/2448318250 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64800bcc0 con 0x7fe650161710 2023-10-06T04:39:27.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.333+0000 7f1bd3471700 1 Processor -- start 2023-10-06T04:39:27.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.332+0000 7fe64effd700 1 -- 172.21.15.112:0/2448318250 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe648012680 con 0x7fe650161710 2023-10-06T04:39:27.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.333+0000 7fa73e620700 1 Processor -- start 2023-10-06T04:39:27.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.333+0000 7f1bd3471700 1 -- start start 2023-10-06T04:39:27.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.333+0000 7fbaf659c700 1 --2- 172.21.15.112:0/1253981473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbaf8159b00 0x7fbaf8157f20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbae80098e0 tx=0x7fbae80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fb8518ddd059c03 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.333+0000 7fe656899700 1 -- 172.21.15.112:0/2448318250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe650161710 msgr2=0x7fe6500ae7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.333+0000 7fe656899700 1 --2- 172.21.15.112:0/2448318250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe650161710 0x7fe6500ae7e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe648009e60 tx=0x7fe648009780 comp rx=0 tx=0).stop 2023-10-06T04:39:27.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.334+0000 7fe656899700 1 -- 172.21.15.112:0/2448318250 shutdown_connections 2023-10-06T04:39:27.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.334+0000 7fe656899700 1 --2- 172.21.15.112:0/2448318250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe650161710 0x7fe6500ae7e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.334+0000 7fe656899700 1 -- 172.21.15.112:0/2448318250 >> 172.21.15.112:0/2448318250 conn(0x7fe65006d2a0 msgr2=0x7fe6500cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.334+0000 7fbaf559a700 1 -- 172.21.15.112:0/1253981473 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae8009e80 con 0x7fbaf8159b00 2023-10-06T04:39:27.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.334+0000 7fe656899700 1 -- 172.21.15.112:0/2448318250 shutdown_connections 2023-10-06T04:39:27.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.334+0000 7fbaf559a700 1 -- 172.21.15.112:0/1253981473 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae800b760 con 0x7fbaf8159b00 2023-10-06T04:39:27.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.334+0000 7fbaf559a700 1 -- 172.21.15.112:0/1253981473 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae800bb00 con 0x7fbaf8159b00 2023-10-06T04:39:27.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.334+0000 7fe656899700 1 -- 172.21.15.112:0/2448318250 wait complete. 2023-10-06T04:39:27.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.334+0000 7f1bd3471700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bcc06dce0 0x7f1bcc14bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7f1bd3471700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bcc06e0b0 0x7f1bcc143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7f1bd3471700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bcc0c9c20 0x7f1bcc143100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7f1bd3471700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc143b70 con 0x7f1bcc06dce0 2023-10-06T04:39:27.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7f1bd3471700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc0aeae0 con 0x7f1bcc06e0b0 2023-10-06T04:39:27.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7f1bd3471700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc0ae1f0 con 0x7f1bcc0c9c20 2023-10-06T04:39:27.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.333+0000 7fa73e620700 1 -- start start 2023-10-06T04:39:27.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.334+0000 7fa73e620700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa73806df90 0x7fa738140da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.334+0000 7fa73e620700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa73806e360 0x7fa7381602e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.334+0000 7fa73e620700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa73815d8b0 0x7fa738160820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.334+0000 7fa73e620700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73814b1d0 con 0x7fa73806df90 2023-10-06T04:39:27.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.334+0000 7fa73e620700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7381412e0 con 0x7fa73815d8b0 2023-10-06T04:39:27.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.334+0000 7fa73e620700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73814a330 con 0x7fa73806e360 2023-10-06T04:39:27.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7fa73d61e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa73806df90 0x7fa738140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7fa73d61e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa73806df90 0x7fa738140da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51302/0 (socket says 172.21.15.112:51302) 2023-10-06T04:39:27.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7fa73d61e700 1 -- 172.21.15.112:0/3413611917 learned_addr learned my addr 172.21.15.112:0/3413611917 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7fa73ce1d700 1 --2- 172.21.15.112:0/3413611917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa73806e360 0x7fa7381602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7fa73de1f700 1 --2- 172.21.15.112:0/3413611917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa73815d8b0 0x7fa738160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7f1bd120d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bcc06dce0 0x7f1bcc14bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7f1bd120d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bcc06dce0 0x7f1bcc14bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51314/0 (socket says 172.21.15.112:51314) 2023-10-06T04:39:27.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7f1bd120d700 1 -- 172.21.15.112:0/771125279 learned_addr learned my addr 172.21.15.112:0/771125279 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7f487f734700 1 Processor -- start 2023-10-06T04:39:27.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.334+0000 7f7c8d572700 1 Processor -- start 2023-10-06T04:39:27.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.334+0000 7f7c8d572700 1 -- start start 2023-10-06T04:39:27.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7fbafc804700 1 -- 172.21.15.112:0/1253981473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbaf8159b00 msgr2=0x7fbaf8157f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7fbafc804700 1 --2- 172.21.15.112:0/1253981473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbaf8159b00 0x7fbaf8157f20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbae80098e0 tx=0x7fbae80091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7fce88c35700 1 Processor -- start 2023-10-06T04:39:27.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7f487f734700 1 -- start start 2023-10-06T04:39:27.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7fe656899700 1 Processor -- start 2023-10-06T04:39:27.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7fe656899700 1 -- start start 2023-10-06T04:39:27.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7fce88c35700 1 -- start start 2023-10-06T04:39:27.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7fa73ce1d700 1 -- 172.21.15.112:0/3413611917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa73815d8b0 msgr2=0x7fa738160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7fa73ce1d700 1 --2- 172.21.15.112:0/3413611917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa73815d8b0 0x7fa738160820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7fa73ce1d700 1 -- 172.21.15.112:0/3413611917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa73806df90 msgr2=0x7fa738140da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7fa73ce1d700 1 --2- 172.21.15.112:0/3413611917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa73806df90 0x7fa738140da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7fa73ce1d700 1 -- 172.21.15.112:0/3413611917 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa734009480 con 0x7fa73806e360 2023-10-06T04:39:27.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7f7c8d572700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7c8806e400 0x7f7c88087460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7f7c8d572700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c88087e20 con 0x7f7c880acff0 2023-10-06T04:39:27.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7f7c8d572700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c8806af70 con 0x7f7c880879a0 2023-10-06T04:39:27.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7f7c8d572700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8806b910 con 0x7f7c8806e400 2023-10-06T04:39:27.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7f7c86ffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7c880acff0 0x7f7c8806dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54750/0 (socket says 172.21.15.112:54750) 2023-10-06T04:39:27.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7f7c86ffd700 1 -- 172.21.15.112:0/4170216082 learned_addr learned my addr 172.21.15.112:0/4170216082 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:27.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7f7c867fc700 1 --2- 172.21.15.112:0/4170216082 >> v2:172.21.15.179:3300/0 conn(0x7f7c8806e400 0x7f7c88087460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7f7c85ffb700 1 -- 172.21.15.112:0/4170216082 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503226146 0 0) 0x7f7c88087e20 con 0x7f7c880acff0 2023-10-06T04:39:27.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7f7c85ffb700 1 -- 172.21.15.112:0/4170216082 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c70003570 con 0x7f7c880acff0 2023-10-06T04:39:27.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7fa73ce1d700 1 --2- 172.21.15.112:0/3413611917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa73806e360 0x7fa7381602e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa72800b5b0 tx=0x7fa7280090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7f7c867fc700 1 -- 172.21.15.112:0/4170216082 >> v1:172.21.15.179:6789/0 conn(0x7f7c880879a0 legacy=0x7f7c880cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7f7c85ffb700 1 -- 172.21.15.112:0/4170216082 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187061030 0 0) 0x7f7c8806af70 con 0x7f7c880879a0 2023-10-06T04:39:27.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7f7c867fc700 1 -- 172.21.15.112:0/4170216082 >> v1:172.21.15.112:6789/0 conn(0x7f7c880acff0 legacy=0x7f7c8806dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7f7c867fc700 1 -- 172.21.15.112:0/4170216082 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8806b250 con 0x7f7c8806e400 2023-10-06T04:39:27.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7fa72d7fa700 1 -- 172.21.15.112:0/3413611917 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72800f510 con 0x7fa73806e360 2023-10-06T04:39:27.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7fa72d7fa700 1 -- 172.21.15.112:0/3413611917 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72800f690 con 0x7fa73806e360 2023-10-06T04:39:27.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7fa72d7fa700 1 -- 172.21.15.112:0/3413611917 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72800fa50 con 0x7fa73806e360 2023-10-06T04:39:27.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7fbafc804700 1 -- 172.21.15.112:0/1253981473 shutdown_connections 2023-10-06T04:39:27.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7fbafc804700 1 --2- 172.21.15.112:0/1253981473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbaf8159b00 0x7fbaf8157f20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7fbafc804700 1 -- 172.21.15.112:0/1253981473 >> 172.21.15.112:0/1253981473 conn(0x7fbaf80cd6e0 msgr2=0x7fbaf80ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fe656899700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6500acfe0 0x7fe650159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fe656899700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe650161340 0x7fe6500a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fe656899700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe650161710 0x7fe6500a7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fe656899700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6500ab100 con 0x7fe650161340 2023-10-06T04:39:27.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fe656899700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6500a6760 con 0x7fe6500acfe0 2023-10-06T04:39:27.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fe656899700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6500aa4f0 con 0x7fe650161710 2023-10-06T04:39:27.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fbafc804700 1 -- 172.21.15.112:0/1253981473 shutdown_connections 2023-10-06T04:39:27.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.335+0000 7f1bd0a0c700 1 --2- 172.21.15.112:0/771125279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bcc06e0b0 0x7f1bcc143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7f1bd120d700 1 -- 172.21.15.112:0/771125279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bcc0c9c20 msgr2=0x7f1bcc143100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:39:27.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7f1bd120d700 1 --2- 172.21.15.112:0/771125279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bcc0c9c20 0x7f1bcc143100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7f1bd120d700 1 -- 172.21.15.112:0/771125279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bcc06e0b0 msgr2=0x7f1bcc143e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7f1bd120d700 1 --2- 172.21.15.112:0/771125279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bcc06e0b0 0x7f1bcc143e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7f1bd120d700 1 -- 172.21.15.112:0/771125279 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc80094f0 con 0x7f1bcc06dce0 2023-10-06T04:39:27.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.336+0000 7f1bd120d700 1 --2- 172.21.15.112:0/771125279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bcc06dce0 0x7f1bcc14bbc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00c7d0 tx=0x7f1bbc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fe64f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe650161340 0x7fe6500a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fe654e36700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe650161710 0x7fe6500a7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fe64f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe650161340 0x7fe6500a6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51322/0 (socket says 172.21.15.112:51322) 2023-10-06T04:39:27.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fe64f7fe700 1 -- 172.21.15.112:0/1751426181 learned_addr learned my addr 172.21.15.112:0/1751426181 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7f487f734700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f48780acaf0 0x7f4878068290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7f487f734700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4878156680 0x7f487806b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7f487f734700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487806af70 con 0x7f48780c9e90 2023-10-06T04:39:27.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7f487f734700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4878156ad0 con 0x7f48780acaf0 2023-10-06T04:39:27.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7f487f734700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48780cacf0 con 0x7f4878156680 2023-10-06T04:39:27.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fe64ffff700 1 --2- 172.21.15.112:0/1751426181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6500acfe0 0x7fe650159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7f487d4d0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f48780acaf0 0x7f4878068290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7f487d4d0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f48780acaf0 0x7f4878068290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51330/0 (socket says 172.21.15.112:51330) 2023-10-06T04:39:27.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7f487d4d0700 1 -- 172.21.15.112:0/4127332161 learned_addr learned my addr 172.21.15.112:0/4127332161 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fe64f7fe700 1 -- 172.21.15.112:0/1751426181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe650161710 msgr2=0x7fe6500a7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fe64f7fe700 1 --2- 172.21.15.112:0/1751426181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe650161710 0x7fe6500a7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fe64f7fe700 1 -- 172.21.15.112:0/1751426181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6500acfe0 msgr2=0x7fe650159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fe64f7fe700 1 --2- 172.21.15.112:0/1751426181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6500acfe0 0x7fe650159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fe64f7fe700 1 -- 172.21.15.112:0/1751426181 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe648009a20 con 0x7fe650161340 2023-10-06T04:39:27.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fce88c35700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce8406aa60 0x7fce841613a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fce88c35700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce84157680 con 0x7fce84150ab0 2023-10-06T04:39:27.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fce88c35700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce84150e80 con 0x7fce8406dd20 2023-10-06T04:39:27.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fce88c35700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce84156d50 con 0x7fce8406aa60 2023-10-06T04:39:27.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.338+0000 7fce82ffd700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fce8406dd20 0x7fce8406a350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.112:58794/0 (socket says 172.21.15.112:58794) 2023-10-06T04:39:27.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.338+0000 7fce82ffd700 1 -- 172.21.15.112:0/3325341147 learned_addr learned my addr 172.21.15.112:0/3325341147 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:27.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.338+0000 7f1bc17fa700 1 -- 172.21.15.112:0/771125279 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc011600 con 0x7f1bcc06dce0 2023-10-06T04:39:27.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.338+0000 7f1bc17fa700 1 -- 172.21.15.112:0/771125279 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc011760 con 0x7f1bcc06dce0 2023-10-06T04:39:27.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.338+0000 7f1bc17fa700 1 -- 172.21.15.112:0/771125279 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc011b20 con 0x7f1bcc06dce0 2023-10-06T04:39:27.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.338+0000 7fbafc804700 1 -- 172.21.15.112:0/1253981473 wait complete. 2023-10-06T04:39:27.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fa73e620700 1 -- 172.21.15.112:0/3413611917 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73814a5c0 con 0x7fa73806e360 2023-10-06T04:39:27.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7fa73e620700 1 -- 172.21.15.112:0/3413611917 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73814ab80 con 0x7fa73806e360 2023-10-06T04:39:27.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7f487d4d0700 1 -- 172.21.15.112:0/4127332161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4878156680 msgr2=0x7f487806b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:27.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7f487d4d0700 1 --2- 172.21.15.112:0/4127332161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4878156680 0x7f487806b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7f487d4d0700 1 -- 172.21.15.112:0/4127332161 >> v1:172.21.15.112:6789/0 conn(0x7f48780c9e90 legacy=0x7f48780ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7f487d4d0700 1 -- 172.21.15.112:0/4127332161 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487815d4f0 con 0x7f48780acaf0 2023-10-06T04:39:27.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.338+0000 7f487d4d0700 1 --2- 172.21.15.112:0/4127332161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48780acaf0 0x7f4878068290 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f48740099b0 tx=0x7f4874009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aeecd4dbc1808e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7f7c867fc700 1 --2- 172.21.15.112:0/4170216082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c8806e400 0x7f7c88087460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7c780098e0 tx=0x7f7c780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=513d0131333fc517 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7f7c85ffb700 1 -- 172.21.15.112:0/4170216082 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c001470 con 0x7f7c8806e400 2023-10-06T04:39:27.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7f7c85ffb700 1 -- 172.21.15.112:0/4170216082 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7800f540 con 0x7f7c8806e400 2023-10-06T04:39:27.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.337+0000 7f7c85ffb700 1 -- 172.21.15.112:0/4170216082 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7800f8e0 con 0x7f7c8806e400 2023-10-06T04:39:27.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.338+0000 7fce83fff700 1 --2- 172.21.15.112:0/3325341147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce8406aa60 0x7fce841613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.338+0000 7f7c8d572700 1 -- 172.21.15.112:0/4170216082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c8806e400 msgr2=0x7f7c88087460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.338+0000 7f7c8d572700 1 --2- 172.21.15.112:0/4170216082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c8806e400 0x7f7c88087460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7c780098e0 tx=0x7f7c780091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.338+0000 7f7c8d572700 1 -- 172.21.15.112:0/4170216082 shutdown_connections 2023-10-06T04:39:27.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.338+0000 7f7c8d572700 1 --2- 172.21.15.112:0/4170216082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c8806e400 0x7f7c88087460 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.338+0000 7f7c8d572700 1 -- 172.21.15.112:0/4170216082 >> 172.21.15.112:0/4170216082 conn(0x7f7c8806d260 msgr2=0x7f7c880cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.338+0000 7fa73e620700 1 -- 172.21.15.112:0/3413611917 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa73805f230 con 0x7fa73806e360 2023-10-06T04:39:27.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.339+0000 7fce83fff700 1 -- 172.21.15.112:0/3325341147 >> v1:172.21.15.179:6789/0 conn(0x7fce8406dd20 legacy=0x7fce8406a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.339+0000 7fce83fff700 1 -- 172.21.15.112:0/3325341147 >> v1:172.21.15.112:6789/0 conn(0x7fce84150ab0 legacy=0x7fce8406b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.339+0000 7fce83fff700 1 -- 172.21.15.112:0/3325341147 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce84157030 con 0x7fce8406aa60 2023-10-06T04:39:27.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.338+0000 7f1bd3471700 1 -- 172.21.15.112:0/771125279 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bcc0ae490 con 0x7f1bcc06dce0 2023-10-06T04:39:27.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.338+0000 7f1bd3471700 1 -- 172.21.15.112:0/771125279 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bcc14c100 con 0x7f1bcc06dce0 2023-10-06T04:39:27.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.339+0000 7f1bd3471700 1 -- 172.21.15.112:0/771125279 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1bac000fd0 con 0x7f1bcc06dce0 2023-10-06T04:39:27.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.339+0000 7f486ffff700 1 -- 172.21.15.112:0/4127332161 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487400b860 con 0x7f48780acaf0 2023-10-06T04:39:27.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.338+0000 7fe64f7fe700 1 --2- 172.21.15.112:0/1751426181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe650161340 0x7fe6500a6de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe64400c5b0 tx=0x7fe644007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.339+0000 7fce83fff700 1 --2- 172.21.15.112:0/3325341147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce8406aa60 0x7fce841613a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fce7c009e10 tx=0x7fce7c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f206d606f5833d6b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.339+0000 7fce827fc700 1 -- 172.21.15.112:0/3325341147 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c00e070 con 0x7fce8406aa60 2023-10-06T04:39:27.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.339+0000 7fce827fc700 1 -- 172.21.15.112:0/3325341147 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7c00bbb0 con 0x7fce8406aa60 2023-10-06T04:39:27.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.339+0000 7fce827fc700 1 -- 172.21.15.112:0/3325341147 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c012430 con 0x7fce8406aa60 2023-10-06T04:39:27.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.339+0000 7fbafc804700 1 Processor -- start 2023-10-06T04:39:27.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.339+0000 7fa72d7fa700 1 -- 172.21.15.112:0/3413611917 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa72801a400 con 0x7fa73806e360 2023-10-06T04:39:27.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.339+0000 7f486ffff700 1 -- 172.21.15.112:0/4127332161 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487400b9c0 con 0x7f48780acaf0 2023-10-06T04:39:27.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.339+0000 7f486ffff700 1 -- 172.21.15.112:0/4127332161 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487400bd40 con 0x7f48780acaf0 2023-10-06T04:39:27.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.340+0000 7f487f734700 1 -- 172.21.15.112:0/4127332161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48780acaf0 msgr2=0x7f4878068290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.340+0000 7f487f734700 1 --2- 172.21.15.112:0/4127332161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48780acaf0 0x7f4878068290 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f48740099b0 tx=0x7f4874009250 comp rx=0 tx=0).stop 2023-10-06T04:39:27.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.340+0000 7fce88c35700 1 -- 172.21.15.112:0/3325341147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce8406aa60 msgr2=0x7fce841613a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.340+0000 7fce88c35700 1 --2- 172.21.15.112:0/3325341147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce8406aa60 0x7fce841613a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fce7c009e10 tx=0x7fce7c009780 comp rx=0 tx=0).stop 2023-10-06T04:39:27.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.340+0000 7fce88c35700 1 -- 172.21.15.112:0/3325341147 shutdown_connections 2023-10-06T04:39:27.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.340+0000 7fce88c35700 1 --2- 172.21.15.112:0/3325341147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce8406aa60 0x7fce841613a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.340+0000 7fce88c35700 1 -- 172.21.15.112:0/3325341147 >> 172.21.15.112:0/3325341147 conn(0x7fce8406e830 msgr2=0x7fce8406ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.340+0000 7fce88c35700 1 -- 172.21.15.112:0/3325341147 shutdown_connections 2023-10-06T04:39:27.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.340+0000 7f487f734700 1 -- 172.21.15.112:0/4127332161 shutdown_connections 2023-10-06T04:39:27.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.340+0000 7f487f734700 1 --2- 172.21.15.112:0/4127332161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48780acaf0 0x7f4878068290 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.340+0000 7f487f734700 1 --2- 172.21.15.112:0/4127332161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4878156680 0x7f487806b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.340+0000 7f487f734700 1 -- 172.21.15.112:0/4127332161 >> 172.21.15.112:0/4127332161 conn(0x7f487806e350 msgr2=0x7f4878067b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.340+0000 7fa72d7fa700 1 --2- 172.21.15.112:0/3413611917 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa71c066fb0 0x7fa71c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.340+0000 7fa72d7fa700 1 -- 172.21.15.112:0/3413611917 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa728084020 con 0x7fa73806e360 2023-10-06T04:39:27.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.340+0000 7fa72d7fa700 1 --2- 172.21.15.112:0/3413611917 >> [v2:172.21.15.179:6824/90879,v1:172.21.15.179:6825/90879] conn(0x7fa71c06f860 0x7fa71c071c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.340+0000 7fa72d7fa700 1 -- 172.21.15.112:0/3413611917 --> [v2:172.21.15.179:6824/90879,v1:172.21.15.179:6825/90879] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa71c072320 con 0x7fa71c06f860 2023-10-06T04:39:27.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.340+0000 7fa72d7fa700 1 -- 172.21.15.112:0/3413611917 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa728086560 con 0x7fa73806e360 2023-10-06T04:39:27.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.339+0000 7f7c8d572700 1 -- 172.21.15.112:0/4170216082 shutdown_connections 2023-10-06T04:39:27.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.339+0000 7f7c8d572700 1 -- 172.21.15.112:0/4170216082 wait complete. 2023-10-06T04:39:27.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fa73d61e700 1 --2- 172.21.15.112:0/3413611917 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa71c066fb0 0x7fa71c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7f1bc17fa700 1 -- 172.21.15.112:0/771125279 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1bbc0193f0 con 0x7f1bcc06dce0 2023-10-06T04:39:27.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fa73de1f700 1 --2- 172.21.15.112:0/3413611917 >> [v2:172.21.15.179:6824/90879,v1:172.21.15.179:6825/90879] conn(0x7fa71c06f860 0x7fa71c071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.339+0000 7fbafc804700 1 -- start start 2023-10-06T04:39:27.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fbafc804700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbaf80cae00 0x7fbaf8134960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fbafc804700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbaf8159b00 0x7fbaf816ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fbafc804700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbaf8159ed0 0x7fbaf8135220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fbafc804700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf81703f0 con 0x7fbaf8159ed0 2023-10-06T04:39:27.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fbafc804700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf816f010 con 0x7fbaf8159b00 2023-10-06T04:39:27.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fbafc804700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf816f7e0 con 0x7fbaf80cae00 2023-10-06T04:39:27.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fe637fff700 1 -- 172.21.15.112:0/1751426181 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe644011590 con 0x7fe650161340 2023-10-06T04:39:27.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fe637fff700 1 -- 172.21.15.112:0/1751426181 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe644011710 con 0x7fe650161340 2023-10-06T04:39:27.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fe637fff700 1 -- 172.21.15.112:0/1751426181 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe644011ad0 con 0x7fe650161340 2023-10-06T04:39:27.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fbaf6d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbaf8159ed0 0x7fbaf8135220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fbaf6d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbaf8159ed0 0x7fbaf8135220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51342/0 (socket says 172.21.15.112:51342) 2023-10-06T04:39:27.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fbaf6d9d700 1 -- 172.21.15.112:0/2299349816 learned_addr learned my addr 172.21.15.112:0/2299349816 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fbaf5d9b700 1 --2- 172.21.15.112:0/2299349816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbaf8159b00 0x7fbaf816ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fe656899700 1 -- 172.21.15.112:0/1751426181 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6500aa7d0 con 0x7fe650161340 2023-10-06T04:39:27.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fe656899700 1 -- 172.21.15.112:0/1751426181 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6500aad90 con 0x7fe650161340 2023-10-06T04:39:27.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7f1bc17fa700 1 --2- 172.21.15.112:0/771125279 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1bb0066fb0 0x7f1bb0069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.340+0000 7fce88c35700 1 -- 172.21.15.112:0/3325341147 wait complete. 2023-10-06T04:39:27.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.342+0000 7fce88c35700 1 Processor -- start 2023-10-06T04:39:27.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7f1bd0a0c700 1 --2- 172.21.15.112:0/771125279 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1bb0066fb0 0x7f1bb0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7f1bc17fa700 1 -- 172.21.15.112:0/771125279 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1bbc0851a0 con 0x7f1bcc06dce0 2023-10-06T04:39:27.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7f1bc17fa700 1 --2- 172.21.15.112:0/771125279 >> [v2:172.21.15.112:6824/90672,v1:172.21.15.112:6825/90672] conn(0x7f1bb006f860 0x7f1bb0071c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7f1bc17fa700 1 -- 172.21.15.112:0/771125279 --> [v2:172.21.15.112:6824/90672,v1:172.21.15.112:6825/90672] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1bb0072320 con 0x7f1bb006f860 2023-10-06T04:39:27.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7f1bc17fa700 1 -- 172.21.15.112:0/771125279 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bbc0854d0 con 0x7f1bcc06dce0 2023-10-06T04:39:27.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.342+0000 7f1bd1a0e700 1 --2- 172.21.15.112:0/771125279 >> [v2:172.21.15.112:6824/90672,v1:172.21.15.112:6825/90672] conn(0x7f1bb006f860 0x7f1bb0071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7f7c8d572700 1 Processor -- start 2023-10-06T04:39:27.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7f7c8d572700 1 -- start start 2023-10-06T04:39:27.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fbaf6d9d700 1 -- 172.21.15.112:0/2299349816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbaf80cae00 msgr2=0x7fbaf8134960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:39:27.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fbaf6d9d700 1 --2- 172.21.15.112:0/2299349816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbaf80cae00 0x7fbaf8134960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fbaf6d9d700 1 -- 172.21.15.112:0/2299349816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbaf8159b00 msgr2=0x7fbaf816ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fbaf6d9d700 1 --2- 172.21.15.112:0/2299349816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbaf8159b00 0x7fbaf816ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fbaf6d9d700 1 -- 172.21.15.112:0/2299349816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae8009420 con 0x7fbaf8159ed0 2023-10-06T04:39:27.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.341+0000 7fbaf5d9b700 1 --2- 172.21.15.112:0/2299349816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbaf8159b00 0x7fbaf816ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:27.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.342+0000 7fbaf6d9d700 1 --2- 172.21.15.112:0/2299349816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbaf8159ed0 0x7fbaf8135220 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000bbb0 tx=0x7fbaf0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.342+0000 7fa73d61e700 1 --2- 172.21.15.112:0/3413611917 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa71c066fb0 0x7fa71c069460 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa734009fd0 tx=0x7fa734015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.342+0000 7fbaee7fc700 1 -- 172.21.15.112:0/2299349816 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf00092e0 con 0x7fbaf8159ed0 2023-10-06T04:39:27.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.342+0000 7fbaee7fc700 1 -- 172.21.15.112:0/2299349816 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf000c6f0 con 0x7fbaf8159ed0 2023-10-06T04:39:27.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.342+0000 7fbaee7fc700 1 -- 172.21.15.112:0/2299349816 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf000ca90 con 0x7fbaf8159ed0 2023-10-06T04:39:27.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.342+0000 7f1bd0a0c700 1 --2- 172.21.15.112:0/771125279 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1bb0066fb0 0x7f1bb0069460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80099b0 tx=0x7f1bc8016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.342+0000 7fbafc804700 1 -- 172.21.15.112:0/2299349816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf816fac0 con 0x7fbaf8159ed0 2023-10-06T04:39:27.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.342+0000 7fbafc804700 1 -- 172.21.15.112:0/2299349816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf8170080 con 0x7fbaf8159ed0 2023-10-06T04:39:27.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.342+0000 7f1bd1a0e700 1 --2- 172.21.15.112:0/771125279 >> [v2:172.21.15.112:6824/90672,v1:172.21.15.112:6825/90672] conn(0x7f1bb006f860 0x7f1bb0071c70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.342+0000 7fce88c35700 1 -- start start 2023-10-06T04:39:27.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7fce88c35700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce8406aa60 0x7fce841761e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7fce88c35700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce8406dd20 0x7fce84179000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7fce88c35700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce84150ab0 0x7fce8415a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7fce88c35700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce84150070 con 0x7fce8406aa60 2023-10-06T04:39:27.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7fce88c35700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8415b1d0 con 0x7fce84150ab0 2023-10-06T04:39:27.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7fce88c35700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8415e2b0 con 0x7fce8406dd20 2023-10-06T04:39:27.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7f7c8d572700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c8806e400 0x7f7c88181b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7f7c8d572700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c880879a0 0x7f7c88172fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7f7c8d572700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c880acff0 0x7f7c881734f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7f7c8d572700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c880ca5b0 con 0x7f7c880acff0 2023-10-06T04:39:27.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7f7c8d572700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c880ca890 con 0x7f7c880879a0 2023-10-06T04:39:27.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7f7c8d572700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c880cab70 con 0x7f7c8806e400 2023-10-06T04:39:27.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7fce82ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce8406dd20 0x7fce84179000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7fce82ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce8406dd20 0x7fce84179000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.112:47270/0 (socket says 172.21.15.112:47270) 2023-10-06T04:39:27.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7fce82ffd700 1 -- 172.21.15.112:0/3217143321 learned_addr learned my addr 172.21.15.112:0/3217143321 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7fce83fff700 1 --2- 172.21.15.112:0/3217143321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce84150ab0 0x7fce8415a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7f7c86ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c8806e400 0x7f7c88181b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7f7c86ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c8806e400 0x7f7c88181b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.112:47254/0 (socket says 172.21.15.112:47254) 2023-10-06T04:39:27.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7f7c86ffd700 1 -- 172.21.15.112:0/1480839205 learned_addr learned my addr 172.21.15.112:0/1480839205 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7f7c867fc700 1 --2- 172.21.15.112:0/1480839205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c880879a0 0x7f7c88172fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7fe656899700 1 -- 172.21.15.112:0/1751426181 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe630000fd0 con 0x7fe650161340 2023-10-06T04:39:27.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.343+0000 7fbafc804700 1 -- 172.21.15.112:0/2299349816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbaf805f230 con 0x7fbaf8159ed0 2023-10-06T04:39:27.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.344+0000 7f487f734700 1 -- 172.21.15.112:0/4127332161 shutdown_connections 2023-10-06T04:39:27.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.344+0000 7f7c86ffd700 1 -- 172.21.15.112:0/1480839205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c880879a0 msgr2=0x7f7c88172fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.344+0000 7f7c86ffd700 1 --2- 172.21.15.112:0/1480839205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c880879a0 0x7f7c88172fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.344+0000 7f7c86ffd700 1 -- 172.21.15.112:0/1480839205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c880acff0 msgr2=0x7f7c881734f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.344+0000 7f7c86ffd700 1 --2- 172.21.15.112:0/1480839205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c880acff0 0x7f7c881734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.344+0000 7f7c86ffd700 1 -- 172.21.15.112:0/1480839205 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c78009420 con 0x7f7c8806e400 2023-10-06T04:39:27.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.344+0000 7f1bc17fa700 1 -- 172.21.15.112:0/771125279 <== osd.3 v2:172.21.15.112:6824/90672 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1bb0072320 con 0x7f1bb006f860 2023-10-06T04:39:27.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.344+0000 7f7c86ffd700 1 --2- 172.21.15.112:0/1480839205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c8806e400 0x7f7c88181b40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c0015a0 tx=0x7f7c7c001bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.344+0000 7fce83fff700 1 -- 172.21.15.112:0/3217143321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce8406dd20 msgr2=0x7fce84179000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.344+0000 7fce83fff700 1 --2- 172.21.15.112:0/3217143321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce8406dd20 0x7fce84179000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.344+0000 7fce83fff700 1 -- 172.21.15.112:0/3217143321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce8406aa60 msgr2=0x7fce841761e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.344+0000 7fce83fff700 1 --2- 172.21.15.112:0/3217143321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce8406aa60 0x7fce841761e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.344+0000 7fce83fff700 1 -- 172.21.15.112:0/3217143321 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c009a20 con 0x7fce84150ab0 2023-10-06T04:39:27.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.344+0000 7f7c6effd700 1 -- 172.21.15.112:0/1480839205 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c007360 con 0x7f7c8806e400 2023-10-06T04:39:27.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.344+0000 7f7c6effd700 1 -- 172.21.15.112:0/1480839205 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7c0074e0 con 0x7f7c8806e400 2023-10-06T04:39:27.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.344+0000 7f7c6effd700 1 -- 172.21.15.112:0/1480839205 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c004830 con 0x7f7c8806e400 2023-10-06T04:39:27.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.344+0000 7fe637fff700 1 -- 172.21.15.112:0/1751426181 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe64401b3b0 con 0x7fe650161340 2023-10-06T04:39:27.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.345+0000 7f7c8d572700 1 -- 172.21.15.112:0/1480839205 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c880cae50 con 0x7f7c8806e400 2023-10-06T04:39:27.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.345+0000 7f7c8d572700 1 -- 172.21.15.112:0/1480839205 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c88182080 con 0x7f7c8806e400 2023-10-06T04:39:27.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.345+0000 7fe637fff700 1 --2- 172.21.15.112:0/1751426181 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe63c067000 0x7fe63c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.345+0000 7fe637fff700 1 -- 172.21.15.112:0/1751426181 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe6440840d0 con 0x7fe650161340 2023-10-06T04:39:27.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.345+0000 7fbaee7fc700 1 -- 172.21.15.112:0/2299349816 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbaf0012070 con 0x7fbaf8159ed0 2023-10-06T04:39:27.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.345+0000 7fe64ffff700 1 --2- 172.21.15.112:0/1751426181 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe63c067000 0x7fe63c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.345+0000 7fe637fff700 1 --2- 172.21.15.112:0/1751426181 >> [v2:172.21.15.112:6816/90651,v1:172.21.15.112:6817/90651] conn(0x7fe63c06f8b0 0x7fe63c071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.345+0000 7fe637fff700 1 -- 172.21.15.112:0/1751426181 --> [v2:172.21.15.112:6816/90651,v1:172.21.15.112:6817/90651] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe63c072370 con 0x7fe63c06f8b0 2023-10-06T04:39:27.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.345+0000 7fe637fff700 1 -- 172.21.15.112:0/1751426181 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6440844a0 con 0x7fe650161340 2023-10-06T04:39:27.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.345+0000 7fe654e36700 1 --2- 172.21.15.112:0/1751426181 >> [v2:172.21.15.112:6816/90651,v1:172.21.15.112:6817/90651] conn(0x7fe63c06f8b0 0x7fe63c071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.345+0000 7fbaee7fc700 1 --2- 172.21.15.112:0/2299349816 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fbae0067000 0x7fbae00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.345+0000 7fe64ffff700 1 --2- 172.21.15.112:0/1751426181 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe63c067000 0x7fe63c0694b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe640007130 tx=0x7fe640007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.346+0000 7fbaee7fc700 1 -- 172.21.15.112:0/2299349816 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbaf0084520 con 0x7fbaf8159ed0 2023-10-06T04:39:27.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.346+0000 7f7c8d572700 1 -- 172.21.15.112:0/1480839205 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7c68000fd0 con 0x7f7c8806e400 2023-10-06T04:39:27.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.346+0000 7fe654e36700 1 --2- 172.21.15.112:0/1751426181 >> [v2:172.21.15.112:6816/90651,v1:172.21.15.112:6817/90651] conn(0x7fe63c06f8b0 0x7fe63c071cc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.346+0000 7fbaee7fc700 1 --2- 172.21.15.112:0/2299349816 >> [v2:172.21.15.179:6816/90872,v1:172.21.15.179:6817/90872] conn(0x7fbae006f8b0 0x7fbae0071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.346+0000 7fbaee7fc700 1 -- 172.21.15.112:0/2299349816 --> [v2:172.21.15.179:6816/90872,v1:172.21.15.179:6817/90872] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbae0072370 con 0x7fbae006f8b0 2023-10-06T04:39:27.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.346+0000 7fbaee7fc700 1 -- 172.21.15.112:0/2299349816 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbaf0084810 con 0x7fbaf8159ed0 2023-10-06T04:39:27.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.346+0000 7fbaf5d9b700 1 --2- 172.21.15.112:0/2299349816 >> [v2:172.21.15.179:6816/90872,v1:172.21.15.179:6817/90872] conn(0x7fbae006f8b0 0x7fbae0071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.346+0000 7fbaf5d9b700 1 --2- 172.21.15.112:0/2299349816 >> [v2:172.21.15.179:6816/90872,v1:172.21.15.179:6817/90872] conn(0x7fbae006f8b0 0x7fbae0071cc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.346+0000 7f7c6effd700 1 -- 172.21.15.112:0/1480839205 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c7c004bc0 con 0x7f7c8806e400 2023-10-06T04:39:27.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.347+0000 7f487f734700 1 -- 172.21.15.112:0/4127332161 wait complete. 2023-10-06T04:39:27.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.347+0000 7fe637fff700 1 -- 172.21.15.112:0/1751426181 <== osd.0 v2:172.21.15.112:6816/90651 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe63c072370 con 0x7fe63c06f8b0 2023-10-06T04:39:27.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.347+0000 7fbaf659c700 1 --2- 172.21.15.112:0/2299349816 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fbae0067000 0x7fbae00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.347+0000 7f7c6effd700 1 --2- 172.21.15.112:0/1480839205 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7c74066f30 0x7f7c740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.347+0000 7f7c6effd700 1 -- 172.21.15.112:0/1480839205 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7c7c083ab0 con 0x7f7c8806e400 2023-10-06T04:39:27.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.347+0000 7fbaf659c700 1 --2- 172.21.15.112:0/2299349816 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fbae0067000 0x7fbae00694b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8164760 tx=0x7fbae8016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.347+0000 7f7c6effd700 1 --2- 172.21.15.112:0/1480839205 >> [v2:172.21.15.179:6800/90848,v1:172.21.15.179:6801/90848] conn(0x7f7c7406f7e0 0x7f7c74071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.347+0000 7f7c6effd700 1 -- 172.21.15.112:0/1480839205 --> [v2:172.21.15.179:6800/90848,v1:172.21.15.179:6801/90848] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c740722a0 con 0x7f7c7406f7e0 2023-10-06T04:39:27.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.347+0000 7f7c6effd700 1 -- 172.21.15.112:0/1480839205 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c7c088240 con 0x7f7c8806e400 2023-10-06T04:39:27.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.347+0000 7fbaee7fc700 1 -- 172.21.15.112:0/2299349816 <== osd.5 v2:172.21.15.179:6816/90872 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fbae0072370 con 0x7fbae006f8b0 2023-10-06T04:39:27.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.347+0000 7f7c867fc700 1 --2- 172.21.15.112:0/1480839205 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7c74066f30 0x7f7c740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.347+0000 7f7c877fe700 1 --2- 172.21.15.112:0/1480839205 >> [v2:172.21.15.179:6800/90848,v1:172.21.15.179:6801/90848] conn(0x7f7c7406f7e0 0x7f7c74071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.348+0000 7f7c867fc700 1 --2- 172.21.15.112:0/1480839205 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7c74066f30 0x7f7c740693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7c8806e800 tx=0x7f7c78019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.348+0000 7f7c877fe700 1 --2- 172.21.15.112:0/1480839205 >> [v2:172.21.15.179:6800/90848,v1:172.21.15.179:6801/90848] conn(0x7f7c7406f7e0 0x7f7c74071bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.348+0000 7fa73de1f700 1 --2- 172.21.15.112:0/3413611917 >> [v2:172.21.15.179:6824/90879,v1:172.21.15.179:6825/90879] conn(0x7fa71c06f860 0x7fa71c071c70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.348+0000 7fce83fff700 1 --2- 172.21.15.112:0/3217143321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce84150ab0 0x7fce8415a000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fce7c015000 tx=0x7fce7c018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.348+0000 7f487f734700 1 Processor -- start 2023-10-06T04:39:27.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.348+0000 7f487f734700 1 -- start start 2023-10-06T04:39:27.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.348+0000 7fce6b7fe700 1 -- 172.21.15.112:0/3217143321 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c027470 con 0x7fce84150ab0 2023-10-06T04:39:27.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.348+0000 7fce6b7fe700 1 -- 172.21.15.112:0/3217143321 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7c027630 con 0x7fce84150ab0 2023-10-06T04:39:27.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.348+0000 7fce88c35700 1 -- 172.21.15.112:0/3217143321 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce8415dfd0 con 0x7fce84150ab0 2023-10-06T04:39:27.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.348+0000 7fce88c35700 1 -- 172.21.15.112:0/3217143321 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8415b750 con 0x7fce84150ab0 2023-10-06T04:39:27.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.349+0000 7fce6b7fe700 1 -- 172.21.15.112:0/3217143321 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c0279f0 con 0x7fce84150ab0 2023-10-06T04:39:27.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.349+0000 7fa72d7fa700 1 -- 172.21.15.112:0/3413611917 <== osd.6 v2:172.21.15.179:6824/90879 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa71c072320 con 0x7fa71c06f860 2023-10-06T04:39:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.349+0000 7f487f734700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48780acaf0 0x7f48780ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.349+0000 7f487f734700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48780c9e90 0x7f48780ae960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.349+0000 7f487f734700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4878156680 0x7f48781551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.349+0000 7f487f734700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48780ae4d0 con 0x7f4878156680 2023-10-06T04:39:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.349+0000 7f487f734700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4878146450 con 0x7f48780c9e90 2023-10-06T04:39:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.349+0000 7f487f734700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48780ad8c0 con 0x7f48780acaf0 2023-10-06T04:39:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.350+0000 7f487cccf700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48780c9e90 0x7f48780ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.350+0000 7f487cccf700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48780c9e90 0x7f48780ae960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.112:35176/0 (socket says 172.21.15.112:35176) 2023-10-06T04:39:27.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.350+0000 7f487cccf700 1 -- 172.21.15.112:0/4265890118 learned_addr learned my addr 172.21.15.112:0/4265890118 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.350+0000 7f487dcd1700 1 --2- 172.21.15.112:0/4265890118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4878156680 0x7f48781551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.350+0000 7f487dcd1700 1 -- 172.21.15.112:0/4265890118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48780acaf0 msgr2=0x7f48780ad1c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:39:27.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.350+0000 7f487dcd1700 1 --2- 172.21.15.112:0/4265890118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48780acaf0 0x7f48780ad1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.350+0000 7f487dcd1700 1 -- 172.21.15.112:0/4265890118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48780c9e90 msgr2=0x7f48780ae960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.350+0000 7f487dcd1700 1 --2- 172.21.15.112:0/4265890118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48780c9e90 0x7f48780ae960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.350+0000 7f487dcd1700 1 -- 172.21.15.112:0/4265890118 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48740094f0 con 0x7f4878156680 2023-10-06T04:39:27.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.350+0000 7f487dcd1700 1 --2- 172.21.15.112:0/4265890118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4878156680 0x7f48781551d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f487000c790 tx=0x7f48700015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.351+0000 7f486d7fa700 1 -- 172.21.15.112:0/4265890118 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4870012630 con 0x7f4878156680 2023-10-06T04:39:27.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.351+0000 7f486d7fa700 1 -- 172.21.15.112:0/4265890118 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48700127b0 con 0x7f4878156680 2023-10-06T04:39:27.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.351+0000 7f486d7fa700 1 -- 172.21.15.112:0/4265890118 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4870012b70 con 0x7f4878156680 2023-10-06T04:39:27.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.351+0000 7fce6b7fe700 1 -- 172.21.15.112:0/3217143321 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce7c024070 con 0x7fce84150ab0 2023-10-06T04:39:27.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.351+0000 7fce6b7fe700 1 --2- 172.21.15.112:0/3217143321 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fce70066fb0 0x7fce70069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.351+0000 7fce6b7fe700 1 -- 172.21.15.112:0/3217143321 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fce7c086f80 con 0x7fce84150ab0 2023-10-06T04:39:27.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.352+0000 7fce88c35700 1 --2- 172.21.15.112:0/3217143321 >> [v2:172.21.15.112:6800/90641,v1:172.21.15.112:6801/90641] conn(0x7fce640015f0 0x7fce64003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.352+0000 7fce88c35700 1 -- 172.21.15.112:0/3217143321 --> [v2:172.21.15.112:6800/90641,v1:172.21.15.112:6801/90641] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce64006b90 con 0x7fce640015f0 2023-10-06T04:39:27.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.351+0000 7f487f734700 1 -- 172.21.15.112:0/4265890118 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48780adba0 con 0x7f4878156680 2023-10-06T04:39:27.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.351+0000 7f487f734700 1 -- 172.21.15.112:0/4265890118 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48780ae160 con 0x7f4878156680 2023-10-06T04:39:27.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.353+0000 7f7c6effd700 1 -- 172.21.15.112:0/1480839205 <== osd.4 v2:172.21.15.179:6800/90848 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f7c740722a0 con 0x7f7c7406f7e0 2023-10-06T04:39:27.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.354+0000 7f486d7fa700 1 -- 172.21.15.112:0/4265890118 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f487001a3a0 con 0x7f4878156680 2023-10-06T04:39:27.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.354+0000 7f486d7fa700 1 --2- 172.21.15.112:0/4265890118 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f485c066f30 0x7f485c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.354+0000 7f486d7fa700 1 -- 172.21.15.112:0/4265890118 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4870084770 con 0x7f4878156680 2023-10-06T04:39:27.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.355+0000 7f487d4d0700 1 --2- 172.21.15.112:0/4265890118 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f485c066f30 0x7f485c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.355+0000 7fce82ffd700 1 --2- 172.21.15.112:0/3217143321 >> [v2:172.21.15.112:6800/90641,v1:172.21.15.112:6801/90641] conn(0x7fce640015f0 0x7fce64003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.355+0000 7f487d4d0700 1 --2- 172.21.15.112:0/4265890118 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f485c066f30 0x7f485c0693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f48740099b0 tx=0x7f4874017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.357+0000 7f8ec1cc8700 1 Processor -- start 2023-10-06T04:39:27.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.357+0000 7f8ec1cc8700 1 -- start start 2023-10-06T04:39:27.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.358+0000 7fce837fe700 1 --2- 172.21.15.112:0/3217143321 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fce70066fb0 0x7fce70069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.358+0000 7fce82ffd700 1 --2- 172.21.15.112:0/3217143321 >> [v2:172.21.15.112:6800/90641,v1:172.21.15.112:6801/90641] conn(0x7fce640015f0 0x7fce64003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.358+0000 7f8ec1cc8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8ebc157410 0x7f8ebc06ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.358+0000 7f8ec1cc8700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ebc0b2ef0 0x7f8ebc0c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.358+0000 7f8ec1cc8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ebc15be30 con 0x7f8ebc1577e0 2023-10-06T04:39:27.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.358+0000 7f8ec1cc8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ebc15bc20 con 0x7f8ebc157410 2023-10-06T04:39:27.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.358+0000 7f8ec1cc8700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ebc15c110 con 0x7f8ebc0b2ef0 2023-10-06T04:39:27.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.358+0000 7fce837fe700 1 --2- 172.21.15.112:0/3217143321 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fce70066fb0 0x7fce70069460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fce74001690 tx=0x7fce74007b40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.358+0000 7f8ebaffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8ebc1577e0 0x7f8ebc0b27e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54786/0 (socket says 172.21.15.112:54786) 2023-10-06T04:39:27.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.359+0000 7f8ebaffd700 1 -- 172.21.15.112:0/3108515986 learned_addr learned my addr 172.21.15.112:0/3108515986 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:27.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.360+0000 7f8ebbfff700 1 --2- 172.21.15.112:0/3108515986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ebc0b2ef0 0x7f8ebc0c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.360+0000 7f8ebbfff700 1 -- 172.21.15.112:0/3108515986 >> v2:172.21.15.112:3300/0 conn(0x7f8ebc157410 msgr2=0x7f8ebc06ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:27.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.360+0000 7f8ebbfff700 1 --2- 172.21.15.112:0/3108515986 >> v2:172.21.15.112:3300/0 conn(0x7f8ebc157410 0x7f8ebc06ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.360+0000 7f8ebbfff700 1 -- 172.21.15.112:0/3108515986 >> v1:172.21.15.112:6789/0 conn(0x7f8ebc1577e0 legacy=0x7f8ebc0b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.360+0000 7f8ebbfff700 1 -- 172.21.15.112:0/3108515986 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ebc06b6d0 con 0x7f8ebc0b2ef0 2023-10-06T04:39:27.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.360+0000 7f8ebbfff700 1 --2- 172.21.15.112:0/3108515986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ebc0b2ef0 0x7f8ebc0c9d70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4009e60 tx=0x7f8eb4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f91fe0aed3345143 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.361+0000 7fce6b7fe700 1 -- 172.21.15.112:0/3217143321 <== osd.2 v2:172.21.15.112:6800/90641 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fce64006b90 con 0x7fce640015f0 2023-10-06T04:39:27.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.360+0000 7f8eba7fc700 1 -- 172.21.15.112:0/3108515986 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb400e070 con 0x7f8ebc0b2ef0 2023-10-06T04:39:27.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.361+0000 7f8eba7fc700 1 -- 172.21.15.112:0/3108515986 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb400bc30 con 0x7f8ebc0b2ef0 2023-10-06T04:39:27.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.361+0000 7f8eba7fc700 1 -- 172.21.15.112:0/3108515986 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb4012430 con 0x7f8ebc0b2ef0 2023-10-06T04:39:27.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.366+0000 7f1bd3471700 1 -- 172.21.15.112:0/771125279 --> [v2:172.21.15.112:6824/90672,v1:172.21.15.112:6825/90672] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1bac002d30 con 0x7f1bb006f860 2023-10-06T04:39:27.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.366+0000 7f487f734700 1 --2- 172.21.15.112:0/4265890118 >> [v2:172.21.15.179:6808/90849,v1:172.21.15.179:6809/90849] conn(0x7f4878155710 0x7f48781527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.366+0000 7f487f734700 1 -- 172.21.15.112:0/4265890118 --> [v2:172.21.15.179:6808/90849,v1:172.21.15.179:6809/90849] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f48780caad0 con 0x7f4878155710 2023-10-06T04:39:27.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.362+0000 7f8ec1cc8700 1 -- 172.21.15.112:0/3108515986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ebc0b2ef0 msgr2=0x7f8ebc0c9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.362+0000 7f8ec1cc8700 1 --2- 172.21.15.112:0/3108515986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ebc0b2ef0 0x7f8ebc0c9d70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4009e60 tx=0x7f8eb4009780 comp rx=0 tx=0).stop 2023-10-06T04:39:27.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.366+0000 7f8ec1cc8700 1 -- 172.21.15.112:0/3108515986 shutdown_connections 2023-10-06T04:39:27.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.366+0000 7f8ec1cc8700 1 --2- 172.21.15.112:0/3108515986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ebc0b2ef0 0x7f8ebc0c9d70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.366+0000 7f8ec1cc8700 1 --2- 172.21.15.112:0/3108515986 >> v2:172.21.15.112:3300/0 conn(0x7f8ebc157410 0x7f8ebc06ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.366+0000 7f8ec1cc8700 1 -- 172.21.15.112:0/3108515986 >> 172.21.15.112:0/3108515986 conn(0x7f8ebc06e350 msgr2=0x7f8ebc067b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.366+0000 7f1bc17fa700 1 -- 172.21.15.112:0/771125279 <== osd.3 v2:172.21.15.112:6824/90672 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1bac002d30 con 0x7f1bb006f860 2023-10-06T04:39:27.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.366+0000 7f487cccf700 1 --2- 172.21.15.112:0/4265890118 >> [v2:172.21.15.179:6808/90849,v1:172.21.15.179:6809/90849] conn(0x7f4878155710 0x7f48781527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.367+0000 7f487cccf700 1 --2- 172.21.15.112:0/4265890118 >> [v2:172.21.15.179:6808/90849,v1:172.21.15.179:6809/90849] conn(0x7f4878155710 0x7f48781527e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.367+0000 7fbafc804700 1 -- 172.21.15.112:0/2299349816 --> [v2:172.21.15.179:6816/90872,v1:172.21.15.179:6817/90872] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbaf806c8e0 con 0x7fbae006f8b0 2023-10-06T04:39:27.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.367+0000 7f1bd3471700 1 -- 172.21.15.112:0/771125279 >> [v2:172.21.15.112:6824/90672,v1:172.21.15.112:6825/90672] conn(0x7f1bb006f860 msgr2=0x7f1bb0071c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.367+0000 7f1bd3471700 1 --2- 172.21.15.112:0/771125279 >> [v2:172.21.15.112:6824/90672,v1:172.21.15.112:6825/90672] conn(0x7f1bb006f860 0x7f1bb0071c70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.367+0000 7f1bd3471700 1 -- 172.21.15.112:0/771125279 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1bb0066fb0 msgr2=0x7f1bb0069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.367+0000 7f1bd3471700 1 --2- 172.21.15.112:0/771125279 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1bb0066fb0 0x7f1bb0069460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80099b0 tx=0x7f1bc8016000 comp rx=0 tx=0).stop 2023-10-06T04:39:27.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.367+0000 7f1bd3471700 1 -- 172.21.15.112:0/771125279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bcc06dce0 msgr2=0x7f1bcc14bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.367+0000 7f1bd3471700 1 --2- 172.21.15.112:0/771125279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bcc06dce0 0x7f1bcc14bbc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00c7d0 tx=0x7f1bbc008040 comp rx=0 tx=0).stop 2023-10-06T04:39:27.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.367+0000 7f1bd1a0e700 1 -- 172.21.15.112:0/771125279 reap_dead start 2023-10-06T04:39:27.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.367+0000 7fbaee7fc700 1 -- 172.21.15.112:0/2299349816 <== osd.5 v2:172.21.15.179:6816/90872 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbaf806c8e0 con 0x7fbae006f8b0 2023-10-06T04:39:27.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.367+0000 7f1bd3471700 1 -- 172.21.15.112:0/771125279 shutdown_connections 2023-10-06T04:39:27.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.367+0000 7f1bd3471700 1 -- 172.21.15.112:0/771125279 >> 172.21.15.112:0/771125279 conn(0x7f1bcc06d8e0 msgr2=0x7f1bcc156750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.367+0000 7f1bd3471700 1 -- 172.21.15.112:0/771125279 shutdown_connections 2023-10-06T04:39:27.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.368+0000 7f1bd3471700 1 -- 172.21.15.112:0/771125279 wait complete. 2023-10-06T04:39:27.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.368+0000 7f486d7fa700 1 -- 172.21.15.112:0/4265890118 <== osd.7 v2:172.21.15.179:6808/90849 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f48780caad0 con 0x7f4878155710 2023-10-06T04:39:27.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.372+0000 7fe656899700 1 -- 172.21.15.112:0/1751426181 --> [v2:172.21.15.112:6816/90651,v1:172.21.15.112:6817/90651] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe630002d30 con 0x7fe63c06f8b0 2023-10-06T04:39:27.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.374+0000 7f8ec1cc8700 1 -- 172.21.15.112:0/3108515986 shutdown_connections 2023-10-06T04:39:27.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.374+0000 7f8ec1cc8700 1 -- 172.21.15.112:0/3108515986 wait complete. 2023-10-06T04:39:27.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.375+0000 7f8ec1cc8700 1 Processor -- start 2023-10-06T04:39:27.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.375+0000 7f8ec1cc8700 1 -- start start 2023-10-06T04:39:27.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.376+0000 7f8ec1cc8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ebc0b2ef0 0x7f8ebc14c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.376+0000 7f8ec1cc8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ebc157410 0x7f8ebc0af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.376+0000 7f8ec1cc8700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ebc1577e0 0x7f8ebc147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.376+0000 7f8ec1cc8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ebc14d920 con 0x7f8ebc157410 2023-10-06T04:39:27.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.376+0000 7f8ec1cc8700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ebc14cd10 con 0x7f8ebc0b2ef0 2023-10-06T04:39:27.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.376+0000 7f8ec1cc8700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ebc14cff0 con 0x7f8ebc1577e0 2023-10-06T04:39:27.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.376+0000 7f8ebaffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ebc157410 0x7f8ebc0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.376+0000 7f8ebaffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ebc157410 0x7f8ebc0af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51376/0 (socket says 172.21.15.112:51376) 2023-10-06T04:39:27.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.376+0000 7f8ebaffd700 1 -- 172.21.15.112:0/1275365149 learned_addr learned my addr 172.21.15.112:0/1275365149 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.376+0000 7f8ebaffd700 1 -- 172.21.15.112:0/1275365149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ebc1577e0 msgr2=0x7f8ebc147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.376+0000 7f8ebaffd700 1 --2- 172.21.15.112:0/1275365149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ebc1577e0 0x7f8ebc147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.376+0000 7f8ebaffd700 1 -- 172.21.15.112:0/1275365149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ebc0b2ef0 msgr2=0x7f8ebc14c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.376+0000 7f8ebaffd700 1 --2- 172.21.15.112:0/1275365149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ebc0b2ef0 0x7f8ebc14c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.376+0000 7f8ebaffd700 1 -- 172.21.15.112:0/1275365149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb4009a20 con 0x7f8ebc157410 2023-10-06T04:39:27.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.377+0000 7f8ebaffd700 1 --2- 172.21.15.112:0/1275365149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ebc157410 0x7f8ebc0af720 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00c560 tx=0x7f8eac001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.377+0000 7f8ea37fe700 1 -- 172.21.15.112:0/1275365149 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac005b30 con 0x7f8ebc157410 2023-10-06T04:39:27.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.377+0000 7f8ea37fe700 1 -- 172.21.15.112:0/1275365149 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eac005c90 con 0x7f8ebc157410 2023-10-06T04:39:27.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.377+0000 7f8ec1cc8700 1 -- 172.21.15.112:0/1275365149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ebc14d2d0 con 0x7f8ebc157410 2023-10-06T04:39:27.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.377+0000 7f8ea37fe700 1 -- 172.21.15.112:0/1275365149 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac0072e0 con 0x7f8ebc157410 2023-10-06T04:39:27.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.377+0000 7f8ec1cc8700 1 -- 172.21.15.112:0/1275365149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ebc14c900 con 0x7f8ebc157410 2023-10-06T04:39:27.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.378+0000 7fa73e620700 1 -- 172.21.15.112:0/3413611917 --> [v2:172.21.15.179:6824/90879,v1:172.21.15.179:6825/90879] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa73806d070 con 0x7fa71c06f860 2023-10-06T04:39:27.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.378+0000 7fa72d7fa700 1 -- 172.21.15.112:0/3413611917 <== osd.6 v2:172.21.15.179:6824/90879 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa73806d070 con 0x7fa71c06f860 2023-10-06T04:39:27.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.379+0000 7fe637fff700 1 -- 172.21.15.112:0/1751426181 <== osd.0 v2:172.21.15.112:6816/90651 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe630002d30 con 0x7fe63c06f8b0 2023-10-06T04:39:27.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.379+0000 7f8ea37fe700 1 -- 172.21.15.112:0/1275365149 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8eac012400 con 0x7f8ebc157410 2023-10-06T04:39:27.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.379+0000 7f8ea37fe700 1 --2- 172.21.15.112:0/1275365149 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8ea8066f30 0x7f8ea80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.379+0000 7fe656899700 1 -- 172.21.15.112:0/1751426181 >> [v2:172.21.15.112:6816/90651,v1:172.21.15.112:6817/90651] conn(0x7fe63c06f8b0 msgr2=0x7fe63c071cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.379+0000 7fe656899700 1 --2- 172.21.15.112:0/1751426181 >> [v2:172.21.15.112:6816/90651,v1:172.21.15.112:6817/90651] conn(0x7fe63c06f8b0 0x7fe63c071cc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.379+0000 7fa73e620700 1 -- 172.21.15.112:0/3413611917 >> [v2:172.21.15.179:6824/90879,v1:172.21.15.179:6825/90879] conn(0x7fa71c06f860 msgr2=0x7fa71c071c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.379+0000 7fa73e620700 1 --2- 172.21.15.112:0/3413611917 >> [v2:172.21.15.179:6824/90879,v1:172.21.15.179:6825/90879] conn(0x7fa71c06f860 0x7fa71c071c70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.379+0000 7fe656899700 1 -- 172.21.15.112:0/1751426181 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe63c067000 msgr2=0x7fe63c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.379+0000 7fe656899700 1 --2- 172.21.15.112:0/1751426181 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe63c067000 0x7fe63c0694b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe640007130 tx=0x7fe640007eb0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.379+0000 7fe656899700 1 -- 172.21.15.112:0/1751426181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe650161340 msgr2=0x7fe6500a6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.379+0000 7fe656899700 1 --2- 172.21.15.112:0/1751426181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe650161340 0x7fe6500a6de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe64400c5b0 tx=0x7fe644007f60 comp rx=0 tx=0).stop 2023-10-06T04:39:27.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.379+0000 7fe654e36700 1 -- 172.21.15.112:0/1751426181 reap_dead start 2023-10-06T04:39:27.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.379+0000 7f8ea37fe700 1 -- 172.21.15.112:0/1275365149 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8eac083af0 con 0x7f8ebc157410 2023-10-06T04:39:27.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.379+0000 7f8ebb7fe700 1 --2- 172.21.15.112:0/1275365149 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8ea8066f30 0x7f8ea80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.380+0000 7fa73e620700 1 -- 172.21.15.112:0/3413611917 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa71c066fb0 msgr2=0x7fa71c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.380+0000 7fa73e620700 1 --2- 172.21.15.112:0/3413611917 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa71c066fb0 0x7fa71c069460 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa734009fd0 tx=0x7fa734015000 comp rx=0 tx=0).stop 2023-10-06T04:39:27.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.380+0000 7fa73e620700 1 -- 172.21.15.112:0/3413611917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa73806e360 msgr2=0x7fa7381602e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.380+0000 7fa73e620700 1 --2- 172.21.15.112:0/3413611917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa73806e360 0x7fa7381602e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa72800b5b0 tx=0x7fa7280090f0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.380+0000 7fe656899700 1 -- 172.21.15.112:0/1751426181 shutdown_connections 2023-10-06T04:39:27.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.380+0000 7fe656899700 1 -- 172.21.15.112:0/1751426181 >> 172.21.15.112:0/1751426181 conn(0x7fe65006d2a0 msgr2=0x7fe65015eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.380+0000 7fa73de1f700 1 -- 172.21.15.112:0/3413611917 reap_dead start 2023-10-06T04:39:27.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.380+0000 7fa73e620700 1 -- 172.21.15.112:0/3413611917 shutdown_connections 2023-10-06T04:39:27.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.380+0000 7fa73e620700 1 -- 172.21.15.112:0/3413611917 >> 172.21.15.112:0/3413611917 conn(0x7fa73806d8e0 msgr2=0x7fa73815cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.380+0000 7f8ebb7fe700 1 --2- 172.21.15.112:0/1275365149 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8ea8066f30 0x7f8ea80693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0006fd0 tx=0x7f8eb0006db0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.380+0000 7fbafc804700 1 -- 172.21.15.112:0/2299349816 >> [v2:172.21.15.179:6816/90872,v1:172.21.15.179:6817/90872] conn(0x7fbae006f8b0 msgr2=0x7fbae0071cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.380+0000 7fbafc804700 1 --2- 172.21.15.112:0/2299349816 >> [v2:172.21.15.179:6816/90872,v1:172.21.15.179:6817/90872] conn(0x7fbae006f8b0 0x7fbae0071cc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.380+0000 7fa73e620700 1 -- 172.21.15.112:0/3413611917 shutdown_connections 2023-10-06T04:39:27.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.380+0000 7fa73e620700 1 -- 172.21.15.112:0/3413611917 wait complete. 2023-10-06T04:39:27.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.380+0000 7fbafc804700 1 -- 172.21.15.112:0/2299349816 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fbae0067000 msgr2=0x7fbae00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.380+0000 7fbafc804700 1 --2- 172.21.15.112:0/2299349816 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fbae0067000 0x7fbae00694b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8164760 tx=0x7fbae8016000 comp rx=0 tx=0).stop 2023-10-06T04:39:27.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.380+0000 7fbafc804700 1 -- 172.21.15.112:0/2299349816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbaf8159ed0 msgr2=0x7fbaf8135220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.380+0000 7fbafc804700 1 --2- 172.21.15.112:0/2299349816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbaf8159ed0 0x7fbaf8135220 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000bbb0 tx=0x7fbaf0009840 comp rx=0 tx=0).stop 2023-10-06T04:39:27.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.380+0000 7fbaf6d9d700 1 -- 172.21.15.112:0/2299349816 reap_dead start 2023-10-06T04:39:27.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.380+0000 7fbafc804700 1 -- 172.21.15.112:0/2299349816 shutdown_connections 2023-10-06T04:39:27.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.380+0000 7fbafc804700 1 -- 172.21.15.112:0/2299349816 >> 172.21.15.112:0/2299349816 conn(0x7fbaf80cd6e0 msgr2=0x7fbaf806a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.381+0000 7fbafc804700 1 -- 172.21.15.112:0/2299349816 shutdown_connections 2023-10-06T04:39:27.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.381+0000 7fbafc804700 1 -- 172.21.15.112:0/2299349816 wait complete. 2023-10-06T04:39:27.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.381+0000 7f8ec1cc8700 1 --2- 172.21.15.112:0/1275365149 >> [v2:172.21.15.112:6808/90642,v1:172.21.15.112:6809/90642] conn(0x7f8ebc15a1a0 0x7f8ebc0b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.381+0000 7f8ec1cc8700 1 -- 172.21.15.112:0/1275365149 --> [v2:172.21.15.112:6808/90642,v1:172.21.15.112:6809/90642] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8ebc1486b0 con 0x7f8ebc15a1a0 2023-10-06T04:39:27.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.381+0000 7f8ebbfff700 1 --2- 172.21.15.112:0/1275365149 >> [v2:172.21.15.112:6808/90642,v1:172.21.15.112:6809/90642] conn(0x7f8ebc15a1a0 0x7f8ebc0b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.381+0000 7f8ebbfff700 1 --2- 172.21.15.112:0/1275365149 >> [v2:172.21.15.112:6808/90642,v1:172.21.15.112:6809/90642] conn(0x7f8ebc15a1a0 0x7f8ebc0b0c90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.382+0000 7f8ea37fe700 1 -- 172.21.15.112:0/1275365149 <== osd.1 v2:172.21.15.112:6808/90642 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8ebc1486b0 con 0x7f8ebc15a1a0 2023-10-06T04:39:27.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.384+0000 7f7c8d572700 1 -- 172.21.15.112:0/1480839205 --> [v2:172.21.15.179:6800/90848,v1:172.21.15.179:6801/90848] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7c68002d30 con 0x7f7c7406f7e0 2023-10-06T04:39:27.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.384+0000 7fce88c35700 1 -- 172.21.15.112:0/3217143321 --> [v2:172.21.15.112:6800/90641,v1:172.21.15.112:6801/90641] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fce64005c80 con 0x7fce640015f0 2023-10-06T04:39:27.430 INFO:teuthology.orchestra.run.smithi112.stdout:55834574853 2023-10-06T04:39:27.431 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T04:39:27.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.386+0000 7fe656899700 1 -- 172.21.15.112:0/1751426181 shutdown_connections 2023-10-06T04:39:27.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.386+0000 7f7c6effd700 1 -- 172.21.15.112:0/1480839205 <== osd.4 v2:172.21.15.179:6800/90848 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7c68002d30 con 0x7f7c7406f7e0 2023-10-06T04:39:27.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.387+0000 7fce6b7fe700 1 -- 172.21.15.112:0/3217143321 <== osd.2 v2:172.21.15.112:6800/90641 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fce64005c80 con 0x7fce640015f0 2023-10-06T04:39:27.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.387+0000 7f7c8d572700 1 -- 172.21.15.112:0/1480839205 >> [v2:172.21.15.179:6800/90848,v1:172.21.15.179:6801/90848] conn(0x7f7c7406f7e0 msgr2=0x7f7c74071bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.387+0000 7f7c8d572700 1 --2- 172.21.15.112:0/1480839205 >> [v2:172.21.15.179:6800/90848,v1:172.21.15.179:6801/90848] conn(0x7f7c7406f7e0 0x7f7c74071bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.387+0000 7fce88c35700 1 -- 172.21.15.112:0/3217143321 >> [v2:172.21.15.112:6800/90641,v1:172.21.15.112:6801/90641] conn(0x7fce640015f0 msgr2=0x7fce64003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.387+0000 7fce88c35700 1 --2- 172.21.15.112:0/3217143321 >> [v2:172.21.15.112:6800/90641,v1:172.21.15.112:6801/90641] conn(0x7fce640015f0 0x7fce64003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.387+0000 7f7c8d572700 1 -- 172.21.15.112:0/1480839205 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7c74066f30 msgr2=0x7f7c740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.387+0000 7f7c8d572700 1 --2- 172.21.15.112:0/1480839205 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7c74066f30 0x7f7c740693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7c8806e800 tx=0x7f7c78019000 comp rx=0 tx=0).stop 2023-10-06T04:39:27.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.387+0000 7f7c8d572700 1 -- 172.21.15.112:0/1480839205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c8806e400 msgr2=0x7f7c88181b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.387+0000 7f7c8d572700 1 --2- 172.21.15.112:0/1480839205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c8806e400 0x7f7c88181b40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c0015a0 tx=0x7f7c7c001bf0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.387+0000 7f7c877fe700 1 -- 172.21.15.112:0/1480839205 reap_dead start 2023-10-06T04:39:27.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.387+0000 7fce88c35700 1 -- 172.21.15.112:0/3217143321 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fce70066fb0 msgr2=0x7fce70069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.387+0000 7fce88c35700 1 --2- 172.21.15.112:0/3217143321 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fce70066fb0 0x7fce70069460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fce74001690 tx=0x7fce74007b40 comp rx=0 tx=0).stop 2023-10-06T04:39:27.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.387+0000 7fce88c35700 1 -- 172.21.15.112:0/3217143321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce84150ab0 msgr2=0x7fce8415a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.387+0000 7fce88c35700 1 --2- 172.21.15.112:0/3217143321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce84150ab0 0x7fce8415a000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fce7c015000 tx=0x7fce7c018000 comp rx=0 tx=0).stop 2023-10-06T04:39:27.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.387+0000 7fce83fff700 1 -- 172.21.15.112:0/3217143321 reap_dead start 2023-10-06T04:39:27.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.387+0000 7f7c8d572700 1 -- 172.21.15.112:0/1480839205 shutdown_connections 2023-10-06T04:39:27.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.387+0000 7f7c8d572700 1 -- 172.21.15.112:0/1480839205 >> 172.21.15.112:0/1480839205 conn(0x7f7c8806d260 msgr2=0x7f7c88164290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.389+0000 7f7c8d572700 1 -- 172.21.15.112:0/1480839205 shutdown_connections 2023-10-06T04:39:27.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.389+0000 7f7c8d572700 1 -- 172.21.15.112:0/1480839205 wait complete. 2023-10-06T04:39:27.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.391+0000 7fce88c35700 1 -- 172.21.15.112:0/3217143321 shutdown_connections 2023-10-06T04:39:27.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.391+0000 7fce88c35700 1 -- 172.21.15.112:0/3217143321 >> 172.21.15.112:0/3217143321 conn(0x7fce8406e830 msgr2=0x7fce8415fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.392+0000 7f487f734700 1 -- 172.21.15.112:0/4265890118 --> [v2:172.21.15.179:6808/90849,v1:172.21.15.179:6809/90849] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f487806bc30 con 0x7f4878155710 2023-10-06T04:39:27.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.392+0000 7f486d7fa700 1 -- 172.21.15.112:0/4265890118 <== osd.7 v2:172.21.15.179:6808/90849 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f487806bc30 con 0x7f4878155710 2023-10-06T04:39:27.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.393+0000 7fce88c35700 1 -- 172.21.15.112:0/3217143321 shutdown_connections 2023-10-06T04:39:27.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.393+0000 7fce88c35700 1 -- 172.21.15.112:0/3217143321 wait complete. 2023-10-06T04:39:27.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.393+0000 7f487f734700 1 -- 172.21.15.112:0/4265890118 >> [v2:172.21.15.179:6808/90849,v1:172.21.15.179:6809/90849] conn(0x7f4878155710 msgr2=0x7f48781527e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.393+0000 7f487f734700 1 --2- 172.21.15.112:0/4265890118 >> [v2:172.21.15.179:6808/90849,v1:172.21.15.179:6809/90849] conn(0x7f4878155710 0x7f48781527e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.393+0000 7f487f734700 1 -- 172.21.15.112:0/4265890118 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f485c066f30 msgr2=0x7f485c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.393+0000 7f487f734700 1 --2- 172.21.15.112:0/4265890118 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f485c066f30 0x7f485c0693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f48740099b0 tx=0x7f4874017000 comp rx=0 tx=0).stop 2023-10-06T04:39:27.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.393+0000 7f487f734700 1 -- 172.21.15.112:0/4265890118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4878156680 msgr2=0x7f48781551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.393+0000 7f487f734700 1 --2- 172.21.15.112:0/4265890118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4878156680 0x7f48781551d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f487000c790 tx=0x7f48700015f0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.396+0000 7fe656899700 1 -- 172.21.15.112:0/1751426181 wait complete. 2023-10-06T04:39:27.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.396+0000 7f487dcd1700 1 -- 172.21.15.112:0/4265890118 reap_dead start 2023-10-06T04:39:27.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.396+0000 7f487f734700 1 -- 172.21.15.112:0/4265890118 shutdown_connections 2023-10-06T04:39:27.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.396+0000 7f487f734700 1 -- 172.21.15.112:0/4265890118 >> 172.21.15.112:0/4265890118 conn(0x7f487806e350 msgr2=0x7f487806cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.440 INFO:teuthology.orchestra.run.smithi112.stdout:55834574855 2023-10-06T04:39:27.440 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T04:39:27.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.404+0000 7f487f734700 1 -- 172.21.15.112:0/4265890118 shutdown_connections 2023-10-06T04:39:27.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.404+0000 7f487f734700 1 -- 172.21.15.112:0/4265890118 wait complete. 2023-10-06T04:39:27.441 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2023-10-06T04:39:27.441 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T04:39:27.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.407+0000 7f8ec1cc8700 1 -- 172.21.15.112:0/1275365149 --> [v2:172.21.15.112:6808/90642,v1:172.21.15.112:6809/90642] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8ebc0afc60 con 0x7f8ebc15a1a0 2023-10-06T04:39:27.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.408+0000 7f8ea37fe700 1 -- 172.21.15.112:0/1275365149 <== osd.1 v2:172.21.15.112:6808/90642 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8ebc0afc60 con 0x7f8ebc15a1a0 2023-10-06T04:39:27.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.408+0000 7f8ec1cc8700 1 -- 172.21.15.112:0/1275365149 >> [v2:172.21.15.112:6808/90642,v1:172.21.15.112:6809/90642] conn(0x7f8ebc15a1a0 msgr2=0x7f8ebc0b0c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.408+0000 7f8ec1cc8700 1 --2- 172.21.15.112:0/1275365149 >> [v2:172.21.15.112:6808/90642,v1:172.21.15.112:6809/90642] conn(0x7f8ebc15a1a0 0x7f8ebc0b0c90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.408+0000 7f8ec1cc8700 1 -- 172.21.15.112:0/1275365149 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8ea8066f30 msgr2=0x7f8ea80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.408+0000 7f8ec1cc8700 1 --2- 172.21.15.112:0/1275365149 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8ea8066f30 0x7f8ea80693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0006fd0 tx=0x7f8eb0006db0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.408+0000 7f8ec1cc8700 1 -- 172.21.15.112:0/1275365149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ebc157410 msgr2=0x7f8ebc0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.408+0000 7f8ec1cc8700 1 --2- 172.21.15.112:0/1275365149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ebc157410 0x7f8ebc0af720 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00c560 tx=0x7f8eac001020 comp rx=0 tx=0).stop 2023-10-06T04:39:27.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.408+0000 7f8ebbfff700 1 -- 172.21.15.112:0/1275365149 reap_dead start 2023-10-06T04:39:27.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.409+0000 7f8ec1cc8700 1 -- 172.21.15.112:0/1275365149 shutdown_connections 2023-10-06T04:39:27.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.409+0000 7f8ec1cc8700 1 -- 172.21.15.112:0/1275365149 >> 172.21.15.112:0/1275365149 conn(0x7f8ebc06e350 msgr2=0x7f8ebc06c730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.409+0000 7f8ec1cc8700 1 -- 172.21.15.112:0/1275365149 shutdown_connections 2023-10-06T04:39:27.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.409+0000 7f8ec1cc8700 1 -- 172.21.15.112:0/1275365149 wait complete. 2023-10-06T04:39:27.445 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2023-10-06T04:39:27.445 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T04:39:27.446 INFO:teuthology.orchestra.run.smithi112.stdout:55834574855 2023-10-06T04:39:27.446 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T04:39:27.447 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2023-10-06T04:39:27.447 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T04:39:27.448 INFO:teuthology.orchestra.run.smithi112.stdout:55834574853 2023-10-06T04:39:27.448 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T04:39:27.449 INFO:teuthology.orchestra.run.smithi112.stdout:55834574853 2023-10-06T04:39:27.449 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T04:39:27.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.674+0000 7f4311a3a700 1 Processor -- start 2023-10-06T04:39:27.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.674+0000 7f4311a3a700 1 -- start start 2023-10-06T04:39:27.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.674+0000 7f4311a3a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f430c15eb70 0x7f430c15ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.675+0000 7f4311a3a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f430c15f480 con 0x7f430c06b120 2023-10-06T04:39:27.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.675+0000 7f4311a3a700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f430c06a3f0 con 0x7f430c06e660 2023-10-06T04:39:27.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.675+0000 7f4311a3a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430c0c7f60 con 0x7f430c15eb70 2023-10-06T04:39:27.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.675+0000 7f430affd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f430c15eb70 0x7f430c15ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.675+0000 7f430affd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f430c15eb70 0x7f430c15ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51382/0 (socket says 172.21.15.112:51382) 2023-10-06T04:39:27.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.675+0000 7f430affd700 1 -- 172.21.15.112:0/3892673711 learned_addr learned my addr 172.21.15.112:0/3892673711 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.675+0000 7f430affd700 1 -- 172.21.15.112:0/3892673711 >> v1:172.21.15.179:6789/0 conn(0x7f430c06e660 legacy=0x7f430c167b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:27.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.675+0000 7f430affd700 1 -- 172.21.15.112:0/3892673711 >> v1:172.21.15.112:6789/0 conn(0x7f430c06b120 legacy=0x7f430c0c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:27.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.675+0000 7f430affd700 1 -- 172.21.15.112:0/3892673711 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c0c8180 con 0x7f430c15eb70 2023-10-06T04:39:27.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.675+0000 7f430affd700 1 --2- 172.21.15.112:0/3892673711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c15eb70 0x7f430c15ef40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f43000099b0 tx=0x7f4300009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff5932187486745 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.676+0000 7f4309ffb700 1 -- 172.21.15.112:0/3892673711 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430000b7e0 con 0x7f430c15eb70 2023-10-06T04:39:27.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.676+0000 7f4309ffb700 1 -- 172.21.15.112:0/3892673711 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430000b940 con 0x7f430c15eb70 2023-10-06T04:39:27.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.676+0000 7f4309ffb700 1 -- 172.21.15.112:0/3892673711 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430000bce0 con 0x7f430c15eb70 2023-10-06T04:39:27.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.676+0000 7f4311a3a700 1 -- 172.21.15.112:0/3892673711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c15eb70 msgr2=0x7f430c15ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.676+0000 7f4311a3a700 1 --2- 172.21.15.112:0/3892673711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c15eb70 0x7f430c15ef40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f43000099b0 tx=0x7f4300009250 comp rx=0 tx=0).stop 2023-10-06T04:39:27.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.677+0000 7f6f5a708700 1 Processor -- start 2023-10-06T04:39:27.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.677+0000 7f4311a3a700 1 -- 172.21.15.112:0/3892673711 shutdown_connections 2023-10-06T04:39:27.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.677+0000 7f4311a3a700 1 --2- 172.21.15.112:0/3892673711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c15eb70 0x7f430c15ef40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.677+0000 7f4311a3a700 1 -- 172.21.15.112:0/3892673711 >> 172.21.15.112:0/3892673711 conn(0x7f430c068750 msgr2=0x7f430c0ae7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.678+0000 7f6f5a708700 1 -- start start 2023-10-06T04:39:27.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.678+0000 7f6f5a708700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f54069a20 0x7f6f54069e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.678+0000 7f6f5a708700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5406b320 con 0x7f6f540b05d0 2023-10-06T04:39:27.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.678+0000 7f6f5a708700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5406a710 con 0x7f6f540b09a0 2023-10-06T04:39:27.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.678+0000 7f6f5a708700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5406a9f0 con 0x7f6f54069a20 2023-10-06T04:39:27.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.678+0000 7f4311a3a700 1 -- 172.21.15.112:0/3892673711 shutdown_connections 2023-10-06T04:39:27.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.679+0000 7f4311a3a700 1 -- 172.21.15.112:0/3892673711 wait complete. 2023-10-06T04:39:27.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.679+0000 7f6f59f07700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f54069a20 0x7f6f54069e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.679+0000 7f6f59f07700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f54069a20 0x7f6f54069e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.112:47294/0 (socket says 172.21.15.112:47294) 2023-10-06T04:39:27.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.679+0000 7f6f59f07700 1 -- 172.21.15.112:0/3773128943 learned_addr learned my addr 172.21.15.112:0/3773128943 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.679+0000 7fef1aff8700 1 Processor -- start 2023-10-06T04:39:27.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.679+0000 7f6f59f07700 1 -- 172.21.15.112:0/3773128943 >> v1:172.21.15.179:6789/0 conn(0x7f6f540b09a0 legacy=0x7f6f540b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.679+0000 7f6f59f07700 1 -- 172.21.15.112:0/3773128943 >> v1:172.21.15.112:6789/0 conn(0x7f6f540b05d0 legacy=0x7f6f5406b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:27.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.679+0000 7f6f59f07700 1 -- 172.21.15.112:0/3773128943 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5406acd0 con 0x7f6f54069a20 2023-10-06T04:39:27.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.679+0000 7f6f59f07700 1 --2- 172.21.15.112:0/3773128943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f54069a20 0x7f6f54069e60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00c4c0 tx=0x7f6f4c0077f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b86b72924ab2e035 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.680+0000 7f4311a3a700 1 Processor -- start 2023-10-06T04:39:27.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.680+0000 7f4311a3a700 1 -- start start 2023-10-06T04:39:27.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.679+0000 7fef1aff8700 1 -- start start 2023-10-06T04:39:27.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.680+0000 7fef1aff8700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fef140abc00 0x7fef1406dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.680+0000 7fef1aff8700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef140abfd0 0x7fef14156460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.680+0000 7fef1aff8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fef1415a200 0x7fef1415a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.680+0000 7fef1aff8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef14159a90 con 0x7fef1415a200 2023-10-06T04:39:27.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.680+0000 7fef1aff8700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef14159d70 con 0x7fef140abc00 2023-10-06T04:39:27.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.680+0000 7fef1aff8700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef14156ce0 con 0x7fef140abfd0 2023-10-06T04:39:27.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.680+0000 7fef19595700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fef1415a200 0x7fef1415a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.680+0000 7fef19595700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fef1415a200 0x7fef1415a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51392/0 (socket says 172.21.15.112:51392) 2023-10-06T04:39:27.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.680+0000 7fef19595700 1 -- 172.21.15.112:0/557673200 learned_addr learned my addr 172.21.15.112:0/557673200 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.680+0000 7fef13fff700 1 --2- 172.21.15.112:0/557673200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef140abfd0 0x7fef14156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7fef18d94700 1 --2- 172.21.15.112:0/557673200 >> v2:172.21.15.179:3300/0 conn(0x7fef140abc00 0x7fef1406dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7fef19595700 1 -- 172.21.15.112:0/557673200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef140abfd0 msgr2=0x7fef14156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:27.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7fef19595700 1 --2- 172.21.15.112:0/557673200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef140abfd0 0x7fef14156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7fef19595700 1 -- 172.21.15.112:0/557673200 >> v2:172.21.15.179:3300/0 conn(0x7fef140abc00 msgr2=0x7fef1406dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:27.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7fef19595700 1 --2- 172.21.15.112:0/557673200 >> v2:172.21.15.179:3300/0 conn(0x7fef140abc00 0x7fef1406dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7fef19595700 1 -- 172.21.15.112:0/557673200 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef14156fc0 con 0x7fef1415a200 2023-10-06T04:39:27.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7fef19595700 1 --2- 172.21.15.112:0/557673200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef1415a200 0x7fef1415a660 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fef140649e0 tx=0x7fef0c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3421167e0013b331 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7fef137fe700 1 -- 172.21.15.112:0/557673200 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c00e070 con 0x7fef1415a200 2023-10-06T04:39:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7f4311a3a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f430c06b120 0x7f430c0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7f4311a3a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f430c06e660 0x7f430c1468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7f4311a3a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c15eb70 0x7f430c162a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7f4311a3a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c152ed0 con 0x7f430c15eb70 2023-10-06T04:39:27.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7f4311a3a700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c157380 con 0x7f430c06e660 2023-10-06T04:39:27.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7f4311a3a700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430c0c9e40 con 0x7f430c06b120 2023-10-06T04:39:27.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7f430affd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f430c06b120 0x7f430c0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7f430b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c15eb70 0x7f430c162a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7f430affd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f430c06b120 0x7f430c0c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.112:47324/0 (socket says 172.21.15.112:47324) 2023-10-06T04:39:27.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7f430affd700 1 -- 172.21.15.112:0/2863615100 learned_addr learned my addr 172.21.15.112:0/2863615100 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7f430b7fe700 1 --2- 172.21.15.112:0/2863615100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c15eb70 0x7f430c162a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51404/0 (socket says 172.21.15.112:51404) 2023-10-06T04:39:27.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.682+0000 7f430b7fe700 1 -- 172.21.15.112:0/2863615100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f430c06b120 msgr2=0x7f430c0c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.682+0000 7f430b7fe700 1 --2- 172.21.15.112:0/2863615100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f430c06b120 0x7f430c0c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.682+0000 7f430b7fe700 1 -- 172.21.15.112:0/2863615100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f430c06e660 msgr2=0x7f430c1468f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:39:27.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.682+0000 7f430b7fe700 1 --2- 172.21.15.112:0/2863615100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f430c06e660 0x7f430c1468f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.682+0000 7f430b7fe700 1 -- 172.21.15.112:0/2863615100 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43000094f0 con 0x7f430c15eb70 2023-10-06T04:39:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.682+0000 7f430b7fe700 1 --2- 172.21.15.112:0/2863615100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c15eb70 0x7f430c162a40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f430400bb30 tx=0x7f4304009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7fef137fe700 1 -- 172.21.15.112:0/557673200 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0c00ba20 con 0x7fef1415a200 2023-10-06T04:39:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7fef137fe700 1 -- 172.21.15.112:0/557673200 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c0092e0 con 0x7fef1415a200 2023-10-06T04:39:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.682+0000 7fef1aff8700 1 -- 172.21.15.112:0/557673200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef1415a200 msgr2=0x7fef1415a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.682+0000 7fef1aff8700 1 --2- 172.21.15.112:0/557673200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef1415a200 0x7fef1415a660 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fef140649e0 tx=0x7fef0c009840 comp rx=0 tx=0).stop 2023-10-06T04:39:27.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.682+0000 7f42f2ffd700 1 -- 172.21.15.112:0/2863615100 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430400c840 con 0x7f430c15eb70 2023-10-06T04:39:27.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.682+0000 7f42f2ffd700 1 -- 172.21.15.112:0/2863615100 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430400c9a0 con 0x7f430c15eb70 2023-10-06T04:39:27.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.682+0000 7f4311a3a700 1 -- 172.21.15.112:0/2863615100 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f430c156eb0 con 0x7f430c15eb70 2023-10-06T04:39:27.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.682+0000 7f42f2ffd700 1 -- 172.21.15.112:0/2863615100 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430400cd60 con 0x7f430c15eb70 2023-10-06T04:39:27.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.682+0000 7f4311a3a700 1 -- 172.21.15.112:0/2863615100 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430c1578b0 con 0x7f430c15eb70 2023-10-06T04:39:27.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.683+0000 7f6f4bfff700 1 -- 172.21.15.112:0/3773128943 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c00f070 con 0x7f6f54069a20 2023-10-06T04:39:27.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.683+0000 7f6f4bfff700 1 -- 172.21.15.112:0/3773128943 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c00a2e0 con 0x7f6f54069a20 2023-10-06T04:39:27.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.683+0000 7f6f4bfff700 1 -- 172.21.15.112:0/3773128943 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c00a680 con 0x7f6f54069a20 2023-10-06T04:39:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.683+0000 7f0e5a150700 1 Processor -- start 2023-10-06T04:39:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.683+0000 7fef1aff8700 1 -- 172.21.15.112:0/557673200 shutdown_connections 2023-10-06T04:39:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.683+0000 7fef1aff8700 1 --2- 172.21.15.112:0/557673200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef1415a200 0x7fef1415a660 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.683+0000 7fef1aff8700 1 --2- 172.21.15.112:0/557673200 >> v2:172.21.15.179:3300/0 conn(0x7fef140abc00 0x7fef1406dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.683+0000 7fef1aff8700 1 --2- 172.21.15.112:0/557673200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef140abfd0 0x7fef14156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.683+0000 7fef1aff8700 1 -- 172.21.15.112:0/557673200 >> 172.21.15.112:0/557673200 conn(0x7fef140cd6e0 msgr2=0x7fef140ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.683+0000 7f0e5a150700 1 -- start start 2023-10-06T04:39:27.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7f3bca916700 1 Processor -- start 2023-10-06T04:39:27.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.681+0000 7f3bca916700 1 -- start start 2023-10-06T04:39:27.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.682+0000 7f3bca916700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3bc406df40 0x7f3bc40ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.682+0000 7f3bca916700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bc4087b70 0x7f3bc40cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.682+0000 7f3bca916700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc406ac90 con 0x7f3bc40acff0 2023-10-06T04:39:27.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.682+0000 7f3bca916700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc406b910 con 0x7f3bc406df40 2023-10-06T04:39:27.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.682+0000 7f3bca916700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc406af70 con 0x7f3bc4087b70 2023-10-06T04:39:27.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.682+0000 7f3bc3fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3bc406df40 0x7f3bc40ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.682+0000 7f3bc3fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3bc406df40 0x7f3bc40ae7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51420/0 (socket says 172.21.15.112:51420) 2023-10-06T04:39:27.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.682+0000 7f3bc3fff700 1 -- 172.21.15.112:0/4192009213 learned_addr learned my addr 172.21.15.112:0/4192009213 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.683+0000 7f3bc8eb3700 1 --2- 172.21.15.112:0/4192009213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bc4087b70 0x7f3bc40cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.684+0000 7f4311a3a700 1 -- 172.21.15.112:0/2863615100 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430c05f230 con 0x7f430c15eb70 2023-10-06T04:39:27.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.684+0000 7f6f5a708700 1 -- 172.21.15.112:0/3773128943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f54069a20 msgr2=0x7f6f54069e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.684+0000 7f6f5a708700 1 --2- 172.21.15.112:0/3773128943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f54069a20 0x7f6f54069e60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00c4c0 tx=0x7f6f4c0077f0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.684+0000 7f6f5a708700 1 -- 172.21.15.112:0/3773128943 shutdown_connections 2023-10-06T04:39:27.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.684+0000 7f6f5a708700 1 --2- 172.21.15.112:0/3773128943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f54069a20 0x7f6f54069e60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.684+0000 7f6f5a708700 1 -- 172.21.15.112:0/3773128943 >> 172.21.15.112:0/3773128943 conn(0x7f6f5406d270 msgr2=0x7f6f540cc280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.684+0000 7f3bc3fff700 1 -- 172.21.15.112:0/4192009213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bc4087b70 msgr2=0x7f3bc40cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:27.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.684+0000 7f3bc3fff700 1 --2- 172.21.15.112:0/4192009213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bc4087b70 0x7f3bc40cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.684+0000 7f3bc3fff700 1 -- 172.21.15.112:0/4192009213 >> v1:172.21.15.112:6789/0 conn(0x7f3bc40acff0 legacy=0x7f3bc4087460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.684+0000 7f3bc3fff700 1 -- 172.21.15.112:0/4192009213 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc406b250 con 0x7f3bc406df40 2023-10-06T04:39:27.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.684+0000 7fef1aff8700 1 -- 172.21.15.112:0/557673200 shutdown_connections 2023-10-06T04:39:27.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.684+0000 7f3bc3fff700 1 --2- 172.21.15.112:0/4192009213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bc406df40 0x7f3bc40ae7e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80099c0 tx=0x7f3bb8007230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d407029ae2a0fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.684+0000 7fef1aff8700 1 -- 172.21.15.112:0/557673200 wait complete. 2023-10-06T04:39:27.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.685+0000 7f42f2ffd700 1 -- 172.21.15.112:0/2863615100 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4304014620 con 0x7f430c15eb70 2023-10-06T04:39:27.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.685+0000 7f0e5a150700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0e5406ca20 0x7f0e540b0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.685+0000 7f0e5a150700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e5406dff0 0x7f0e540ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.685+0000 7f0e5a150700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e540b35a0 con 0x7f0e540acee0 2023-10-06T04:39:27.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.685+0000 7f0e5a150700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e540b1550 con 0x7f0e5406ca20 2023-10-06T04:39:27.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.685+0000 7f0e5a150700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5406ad00 con 0x7f0e5406dff0 2023-10-06T04:39:27.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.685+0000 7f42f2ffd700 1 --2- 172.21.15.112:0/2863615100 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f42f8066f30 0x7f42f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.685+0000 7f42f2ffd700 1 -- 172.21.15.112:0/2863615100 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f43040845e0 con 0x7f430c15eb70 2023-10-06T04:39:27.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.685+0000 7f6f5a708700 1 -- 172.21.15.112:0/3773128943 shutdown_connections 2023-10-06T04:39:27.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.685+0000 7f0e537fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0e5406ca20 0x7f0e540b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.685+0000 7f0e53fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0e540acee0 0x7f0e5406b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54820/0 (socket says 172.21.15.112:54820) 2023-10-06T04:39:27.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.685+0000 7f0e53fff700 1 -- 172.21.15.112:0/3945311987 learned_addr learned my addr 172.21.15.112:0/3945311987 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:27.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.685+0000 7f0e537fe700 1 --2- 172.21.15.112:0/3945311987 >> v2:172.21.15.112:3300/0 conn(0x7f0e5406ca20 0x7f0e540b0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51432/0 (socket says 172.21.15.112:51432) 2023-10-06T04:39:27.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.685+0000 7f3bc2ffd700 1 -- 172.21.15.112:0/4192009213 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb800e070 con 0x7f3bc406df40 2023-10-06T04:39:27.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.685+0000 7f3bc2ffd700 1 -- 172.21.15.112:0/4192009213 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb800b5c0 con 0x7f3bc406df40 2023-10-06T04:39:27.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.685+0000 7f3bc2ffd700 1 -- 172.21.15.112:0/4192009213 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8009350 con 0x7f3bc406df40 2023-10-06T04:39:27.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.686+0000 7f69a8a90700 1 Processor -- start 2023-10-06T04:39:27.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.686+0000 7f430affd700 1 --2- 172.21.15.112:0/2863615100 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f42f8066f30 0x7f42f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.686+0000 7f0e537fe700 1 -- 172.21.15.112:0/3945311987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e5406dff0 msgr2=0x7f0e540ac9a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:39:27.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.686+0000 7f0e537fe700 1 --2- 172.21.15.112:0/3945311987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e5406dff0 0x7f0e540ac9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.686+0000 7f0e537fe700 1 -- 172.21.15.112:0/3945311987 >> v1:172.21.15.112:6789/0 conn(0x7f0e540acee0 legacy=0x7f0e5406b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.686+0000 7f0e537fe700 1 -- 172.21.15.112:0/3945311987 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e540b0f90 con 0x7f0e5406ca20 2023-10-06T04:39:27.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.686+0000 7fef1aff8700 1 Processor -- start 2023-10-06T04:39:27.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.686+0000 7f430affd700 1 --2- 172.21.15.112:0/2863615100 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f42f8066f30 0x7f42f80693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4300009fd0 tx=0x7f4300016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.686+0000 7f69a8a90700 1 -- start start 2023-10-06T04:39:27.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.686+0000 7fef1aff8700 1 -- start start 2023-10-06T04:39:27.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.686+0000 7f0e537fe700 1 --2- 172.21.15.112:0/3945311987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e5406ca20 0x7f0e540b0890 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0e480098e0 tx=0x7f0e480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38781215c3f73995 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7f69a8a90700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f69a4158440 0x7f69a40a9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7f69a8a90700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f69a40a9680 0x7f69a40b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7f69a8a90700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69a40b0b10 0x7f69a415f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7f69a8a90700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a4158810 con 0x7f69a40a9680 2023-10-06T04:39:27.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7f69a8a90700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a40a9b00 con 0x7f69a4158440 2023-10-06T04:39:27.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7f69a8a90700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a415eed0 con 0x7f69a40b0b10 2023-10-06T04:39:27.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.685+0000 7f6f5a708700 1 -- 172.21.15.112:0/3773128943 wait complete. 2023-10-06T04:39:27.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7f6f5a708700 1 Processor -- start 2023-10-06T04:39:27.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7f69a2ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f69a40a9680 0x7f69a40b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7fef1aff8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef140abc00 0x7fef1414ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7fef1aff8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef140abfd0 0x7fef141498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7f69a2ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f69a40a9680 0x7f69a40b05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51436/0 (socket says 172.21.15.112:51436) 2023-10-06T04:39:27.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7f69a2ffd700 1 -- 172.21.15.112:0/765252810 learned_addr learned my addr 172.21.15.112:0/765252810 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7f69a37fe700 1 --2- 172.21.15.112:0/765252810 >> v2:172.21.15.179:3300/0 conn(0x7f69a4158440 0x7f69a40a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7fef1aff8700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef1415a200 0x7fef140aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7fef1aff8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1406b950 con 0x7fef140abfd0 2023-10-06T04:39:27.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7fef1aff8700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1406aa60 con 0x7fef140abc00 2023-10-06T04:39:27.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7fef1aff8700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1406ad40 con 0x7fef1415a200 2023-10-06T04:39:27.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7f69a3fff700 1 --2- 172.21.15.112:0/765252810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69a40b0b10 0x7f69a415f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7f69a2ffd700 1 -- 172.21.15.112:0/765252810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69a40b0b10 msgr2=0x7f69a415f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:27.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7f69a2ffd700 1 --2- 172.21.15.112:0/765252810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69a40b0b10 0x7f69a415f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7f69a2ffd700 1 -- 172.21.15.112:0/765252810 >> v2:172.21.15.179:3300/0 conn(0x7f69a4158440 msgr2=0x7f69a40a9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:27.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7f69a2ffd700 1 --2- 172.21.15.112:0/765252810 >> v2:172.21.15.179:3300/0 conn(0x7f69a4158440 0x7f69a40a9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7f69a2ffd700 1 -- 172.21.15.112:0/765252810 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a415e5a0 con 0x7f69a40a9680 2023-10-06T04:39:27.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7f69a2ffd700 1 --2- 172.21.15.112:0/765252810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69a40a9680 0x7f69a40b05d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f69a40710d0 tx=0x7f6998009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813bc8d5f30f9e51 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7fef13fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef140abfd0 0x7fef141498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7fef13fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef140abfd0 0x7fef141498a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51452/0 (socket says 172.21.15.112:51452) 2023-10-06T04:39:27.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7fef13fff700 1 -- 172.21.15.112:0/3897965774 learned_addr learned my addr 172.21.15.112:0/3897965774 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7fef18d94700 1 --2- 172.21.15.112:0/3897965774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef140abc00 0x7fef1414ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7fef19595700 1 --2- 172.21.15.112:0/3897965774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef1415a200 0x7fef140aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7fef13fff700 1 -- 172.21.15.112:0/3897965774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef1415a200 msgr2=0x7fef140aa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7fef13fff700 1 --2- 172.21.15.112:0/3897965774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef1415a200 0x7fef140aa9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7fef13fff700 1 -- 172.21.15.112:0/3897965774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef140abc00 msgr2=0x7fef1414ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7fef13fff700 1 --2- 172.21.15.112:0/3897965774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef140abc00 0x7fef1414ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7fef13fff700 1 -- 172.21.15.112:0/3897965774 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0c009ae0 con 0x7fef140abfd0 2023-10-06T04:39:27.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7fef19595700 1 --2- 172.21.15.112:0/3897965774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef1415a200 0x7fef140aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:27.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7fef13fff700 1 --2- 172.21.15.112:0/3897965774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef140abfd0 0x7fef141498a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fef0800bfd0 tx=0x7fef0800b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7f3bca916700 1 -- 172.21.15.112:0/4192009213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bc406df40 msgr2=0x7f3bc40ae7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7f3bca916700 1 --2- 172.21.15.112:0/4192009213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bc406df40 0x7f3bc40ae7e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80099c0 tx=0x7f3bb8007230 comp rx=0 tx=0).stop 2023-10-06T04:39:27.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7f3bca916700 1 -- 172.21.15.112:0/4192009213 shutdown_connections 2023-10-06T04:39:27.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7f3bca916700 1 --2- 172.21.15.112:0/4192009213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bc4087b70 0x7f3bc40cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7f3bca916700 1 --2- 172.21.15.112:0/4192009213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bc406df40 0x7f3bc40ae7e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7f3bca916700 1 -- 172.21.15.112:0/4192009213 >> 172.21.15.112:0/4192009213 conn(0x7f3bc406d260 msgr2=0x7f3bc40cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7f06a43d7700 1 Processor -- start 2023-10-06T04:39:27.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7f3bca916700 1 -- 172.21.15.112:0/4192009213 shutdown_connections 2023-10-06T04:39:27.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.687+0000 7f6f5a708700 1 -- start start 2023-10-06T04:39:27.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7f3bca916700 1 -- 172.21.15.112:0/4192009213 wait complete. 2023-10-06T04:39:27.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7f06a43d7700 1 -- start start 2023-10-06T04:39:27.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7f6f5a708700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f54069a20 0x7f6f5416a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7f6f5a708700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f540b05d0 0x7f6f54098c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7f6f5a708700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f540b09a0 0x7f6f540991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7f6f5a708700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f54157e60 con 0x7f6f540b09a0 2023-10-06T04:39:27.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7f6f5a708700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5416c430 con 0x7f6f54069a20 2023-10-06T04:39:27.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.688+0000 7f6f5a708700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f54176d20 con 0x7f6f540b05d0 2023-10-06T04:39:27.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.689+0000 7f6f59f07700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f540b09a0 0x7f6f540991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.689+0000 7f6f59f07700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f540b09a0 0x7f6f540991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51462/0 (socket says 172.21.15.112:51462) 2023-10-06T04:39:27.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.689+0000 7f6f59f07700 1 -- 172.21.15.112:0/2845072944 learned_addr learned my addr 172.21.15.112:0/2845072944 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.689+0000 7f6f59f07700 1 -- 172.21.15.112:0/2845072944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f540b05d0 msgr2=0x7f6f54098c60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:39:27.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.689+0000 7f6f59f07700 1 --2- 172.21.15.112:0/2845072944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f540b05d0 0x7f6f54098c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.689+0000 7f6f59f07700 1 -- 172.21.15.112:0/2845072944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f54069a20 msgr2=0x7f6f5416a980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:39:27.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.689+0000 7f6f59f07700 1 --2- 172.21.15.112:0/2845072944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f54069a20 0x7f6f5416a980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.689+0000 7f6f59f07700 1 -- 172.21.15.112:0/2845072944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c00c050 con 0x7f6f540b09a0 2023-10-06T04:39:27.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.689+0000 7f6f59f07700 1 --2- 172.21.15.112:0/2845072944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f540b09a0 0x7f6f540991a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00c410 tx=0x7f6f4c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.690+0000 7f06a43d7700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f069c159b20 0x7f069c06b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.690+0000 7f06a43d7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f069c0aa950 0x7f069c06e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.690+0000 7f06a43d7700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069c06b330 con 0x7f069c06dcf0 2023-10-06T04:39:27.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.690+0000 7f06a43d7700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069c0aedf0 con 0x7f069c0aa950 2023-10-06T04:39:27.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.690+0000 7f06a43d7700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069c06e6b0 con 0x7f069c159b20 2023-10-06T04:39:27.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.690+0000 7f06a1972700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f069c06dcf0 0x7f069c0aa240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54836/0 (socket says 172.21.15.112:54836) 2023-10-06T04:39:27.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.690+0000 7f06a1972700 1 -- 172.21.15.112:0/502049185 learned_addr learned my addr 172.21.15.112:0/502049185 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:27.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.690+0000 7f06a2974700 1 --2- 172.21.15.112:0/502049185 >> v2:172.21.15.112:3300/0 conn(0x7f069c0aa950 0x7f069c06e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.690+0000 7f3bca916700 1 Processor -- start 2023-10-06T04:39:27.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.690+0000 7f06a2974700 1 -- 172.21.15.112:0/502049185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f069c159b20 msgr2=0x7f069c06b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:27.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.690+0000 7f06a2974700 1 --2- 172.21.15.112:0/502049185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f069c159b20 0x7f069c06b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.690+0000 7f06a2974700 1 -- 172.21.15.112:0/502049185 >> v1:172.21.15.112:6789/0 conn(0x7f069c06dcf0 legacy=0x7f069c0aa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.690+0000 7f06a2974700 1 -- 172.21.15.112:0/502049185 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c06a720 con 0x7f069c0aa950 2023-10-06T04:39:27.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.690+0000 7f06a2974700 1 --2- 172.21.15.112:0/502049185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f069c0aa950 0x7f069c06e170 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f068c009910 tx=0x7f068c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93604c78e1232ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.691+0000 7f9421804700 1 Processor -- start 2023-10-06T04:39:27.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.690+0000 7f3bca916700 1 -- start start 2023-10-06T04:39:27.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.691+0000 7f3bca916700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bc406df40 0x7f3bc4160660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.691+0000 7f3bca916700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bc4087b70 0x7f3bc40cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.691+0000 7f3bca916700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bc40acff0 0x7f3bc40af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.691+0000 7f3bca916700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc416c610 con 0x7f3bc40acff0 2023-10-06T04:39:27.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.691+0000 7f3bca916700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc40c9b90 con 0x7f3bc406df40 2023-10-06T04:39:27.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.691+0000 7f3bca916700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc4160ba0 con 0x7f3bc4087b70 2023-10-06T04:39:27.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.691+0000 7f9421804700 1 -- start start 2023-10-06T04:39:27.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.691+0000 7f3bc8eb3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bc40acff0 0x7f3bc40af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.691+0000 7f3bc8eb3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bc40acff0 0x7f3bc40af4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51476/0 (socket says 172.21.15.112:51476) 2023-10-06T04:39:27.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.691+0000 7f3bc8eb3700 1 -- 172.21.15.112:0/1042179629 learned_addr learned my addr 172.21.15.112:0/1042179629 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.691+0000 7f3bc8eb3700 1 -- 172.21.15.112:0/1042179629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bc4087b70 msgr2=0x7f3bc40cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.691+0000 7f3bc8eb3700 1 --2- 172.21.15.112:0/1042179629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bc4087b70 0x7f3bc40cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.691+0000 7f3bc8eb3700 1 -- 172.21.15.112:0/1042179629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bc406df40 msgr2=0x7f3bc4160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.691+0000 7f3bc8eb3700 1 --2- 172.21.15.112:0/1042179629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bc406df40 0x7f3bc4160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.691+0000 7f3bc8eb3700 1 -- 172.21.15.112:0/1042179629 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb8009580 con 0x7f3bc40acff0 2023-10-06T04:39:27.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.691+0000 7f3bc8eb3700 1 --2- 172.21.15.112:0/1042179629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bc40acff0 0x7f3bc40af4e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0070b0 tx=0x7f3bbc007200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7f42f2ffd700 1 -- 172.21.15.112:0/2863615100 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43040516f0 con 0x7f430c15eb70 2023-10-06T04:39:27.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7fef10ff9700 1 -- 172.21.15.112:0/3897965774 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0800e970 con 0x7fef140abfd0 2023-10-06T04:39:27.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7f3baffff700 1 -- 172.21.15.112:0/1042179629 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc00de40 con 0x7f3bc40acff0 2023-10-06T04:39:27.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7f3baffff700 1 -- 172.21.15.112:0/1042179629 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bbc010460 con 0x7f3bc40acff0 2023-10-06T04:39:27.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7f0e527fc700 1 -- 172.21.15.112:0/3945311987 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e48009e80 con 0x7f0e5406ca20 2023-10-06T04:39:27.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7f0e527fc700 1 -- 172.21.15.112:0/3945311987 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4800b860 con 0x7f0e5406ca20 2023-10-06T04:39:27.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7f3baffff700 1 -- 172.21.15.112:0/1042179629 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc010820 con 0x7f3bc40acff0 2023-10-06T04:39:27.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7f0e527fc700 1 -- 172.21.15.112:0/3945311987 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4800bc20 con 0x7f0e5406ca20 2023-10-06T04:39:27.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7f3bca916700 1 -- 172.21.15.112:0/1042179629 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc416c7f0 con 0x7f3bc40acff0 2023-10-06T04:39:27.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7f3bca916700 1 -- 172.21.15.112:0/1042179629 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc416cdb0 con 0x7f3bc40acff0 2023-10-06T04:39:27.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7fef10ff9700 1 -- 172.21.15.112:0/3897965774 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0800ead0 con 0x7fef140abfd0 2023-10-06T04:39:27.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7fef1aff8700 1 -- 172.21.15.112:0/3897965774 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef1406b020 con 0x7fef140abfd0 2023-10-06T04:39:27.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7fef1aff8700 1 -- 172.21.15.112:0/3897965774 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1406b5e0 con 0x7fef140abfd0 2023-10-06T04:39:27.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7fef10ff9700 1 -- 172.21.15.112:0/3897965774 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0800ee50 con 0x7fef140abfd0 2023-10-06T04:39:27.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7f9421804700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f941c0c9470 0x7f941c0c9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7f9421804700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f941c0ca770 0x7f941c0cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7f9421804700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941c0c9e50 con 0x7f941c13f4f0 2023-10-06T04:39:27.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7f9421804700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941c0c7db0 con 0x7f941c0c9470 2023-10-06T04:39:27.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7f9421804700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c15a540 con 0x7f941c0ca770 2023-10-06T04:39:27.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7f941b7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f941c0ca770 0x7f941c0cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7f941b7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f941c0ca770 0x7f941c0cabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.112:47402/0 (socket says 172.21.15.112:47402) 2023-10-06T04:39:27.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.692+0000 7f941b7fe700 1 -- 172.21.15.112:0/2634826118 learned_addr learned my addr 172.21.15.112:0/2634826118 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.693+0000 7f0e5a150700 1 -- 172.21.15.112:0/3945311987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e5406ca20 msgr2=0x7f0e540b0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.693+0000 7f0e5a150700 1 --2- 172.21.15.112:0/3945311987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e5406ca20 0x7f0e540b0890 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0e480098e0 tx=0x7f0e480091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.693+0000 7f941b7fe700 1 -- 172.21.15.112:0/2634826118 >> v2:172.21.15.112:3300/0 conn(0x7f941c0c9470 msgr2=0x7f941c0c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:27.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.693+0000 7f941b7fe700 1 --2- 172.21.15.112:0/2634826118 >> v2:172.21.15.112:3300/0 conn(0x7f941c0c9470 0x7f941c0c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.693+0000 7f941b7fe700 1 -- 172.21.15.112:0/2634826118 >> v1:172.21.15.112:6789/0 conn(0x7f941c13f4f0 legacy=0x7f941c0c3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:27.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.693+0000 7f0e5a150700 1 -- 172.21.15.112:0/3945311987 shutdown_connections 2023-10-06T04:39:27.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.693+0000 7f0e5a150700 1 --2- 172.21.15.112:0/3945311987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e5406ca20 0x7f0e540b0890 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.693+0000 7f0e5a150700 1 --2- 172.21.15.112:0/3945311987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e5406dff0 0x7f0e540ac9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.693+0000 7f0e5a150700 1 -- 172.21.15.112:0/3945311987 >> 172.21.15.112:0/3945311987 conn(0x7f0e54068650 msgr2=0x7f0e5406d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.693+0000 7f941b7fe700 1 -- 172.21.15.112:0/2634826118 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c0c6ed0 con 0x7f941c0ca770 2023-10-06T04:39:27.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.693+0000 7f0e5a150700 1 -- 172.21.15.112:0/3945311987 shutdown_connections 2023-10-06T04:39:27.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.693+0000 7f0e5a150700 1 -- 172.21.15.112:0/3945311987 wait complete. 2023-10-06T04:39:27.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.693+0000 7f941b7fe700 1 --2- 172.21.15.112:0/2634826118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f941c0ca770 0x7f941c0cabb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9414009f20 tx=0x7f9414009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39cd348537323dae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.693+0000 7fef1aff8700 1 -- 172.21.15.112:0/3897965774 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef1406c600 con 0x7fef140abfd0 2023-10-06T04:39:27.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.693+0000 7f3bca916700 1 -- 172.21.15.112:0/1042179629 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc405f230 con 0x7f3bc40acff0 2023-10-06T04:39:27.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.693+0000 7f9419ffb700 1 -- 172.21.15.112:0/2634826118 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941400e070 con 0x7f941c0ca770 2023-10-06T04:39:27.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.693+0000 7f9419ffb700 1 -- 172.21.15.112:0/2634826118 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941400ba40 con 0x7f941c0ca770 2023-10-06T04:39:27.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.693+0000 7f9419ffb700 1 -- 172.21.15.112:0/2634826118 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94140092e0 con 0x7f941c0ca770 2023-10-06T04:39:27.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.694+0000 7f69a27fc700 1 -- 172.21.15.112:0/765252810 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6998009ea0 con 0x7f69a40a9680 2023-10-06T04:39:27.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.694+0000 7f69a27fc700 1 -- 172.21.15.112:0/765252810 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699800b820 con 0x7f69a40a9680 2023-10-06T04:39:27.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.694+0000 7f69a27fc700 1 -- 172.21.15.112:0/765252810 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699800bbe0 con 0x7f69a40a9680 2023-10-06T04:39:27.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.694+0000 7f6f497fa700 1 -- 172.21.15.112:0/2845072944 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c01f640 con 0x7f6f540b09a0 2023-10-06T04:39:27.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.694+0000 7f6f497fa700 1 -- 172.21.15.112:0/2845072944 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c01f7a0 con 0x7f6f540b09a0 2023-10-06T04:39:27.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.694+0000 7f6f5a708700 1 -- 172.21.15.112:0/2845072944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f54176fc0 con 0x7f6f540b09a0 2023-10-06T04:39:27.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.694+0000 7f9421804700 1 -- 172.21.15.112:0/2634826118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f941c0ca770 msgr2=0x7f941c0cabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.694+0000 7f9421804700 1 --2- 172.21.15.112:0/2634826118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f941c0ca770 0x7f941c0cabb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9414009f20 tx=0x7f9414009840 comp rx=0 tx=0).stop 2023-10-06T04:39:27.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.694+0000 7f9421804700 1 -- 172.21.15.112:0/2634826118 shutdown_connections 2023-10-06T04:39:27.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.694+0000 7f9421804700 1 --2- 172.21.15.112:0/2634826118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f941c0ca770 0x7f941c0cabb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.694+0000 7f9421804700 1 --2- 172.21.15.112:0/2634826118 >> v2:172.21.15.112:3300/0 conn(0x7f941c0c9470 0x7f941c0c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.694+0000 7f9421804700 1 -- 172.21.15.112:0/2634826118 >> 172.21.15.112:0/2634826118 conn(0x7f941c06e830 msgr2=0x7f941c06ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.694+0000 7f9421804700 1 -- 172.21.15.112:0/2634826118 shutdown_connections 2023-10-06T04:39:27.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.694+0000 7f9421804700 1 -- 172.21.15.112:0/2634826118 wait complete. 2023-10-06T04:39:27.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.694+0000 7f6f497fa700 1 -- 172.21.15.112:0/2845072944 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c01fb60 con 0x7f6f540b09a0 2023-10-06T04:39:27.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.694+0000 7f6f5a708700 1 -- 172.21.15.112:0/2845072944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f541578a0 con 0x7f6f540b09a0 2023-10-06T04:39:27.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.695+0000 7f69a8a90700 1 -- 172.21.15.112:0/765252810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69a40a9680 msgr2=0x7f69a40b05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.695+0000 7f69a8a90700 1 --2- 172.21.15.112:0/765252810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69a40a9680 0x7f69a40b05d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f69a40710d0 tx=0x7f6998009250 comp rx=0 tx=0).stop 2023-10-06T04:39:27.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.696+0000 7f06a1171700 1 -- 172.21.15.112:0/502049185 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c00b820 con 0x7f069c0aa950 2023-10-06T04:39:27.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.696+0000 7f06a1171700 1 -- 172.21.15.112:0/502049185 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c00b980 con 0x7f069c0aa950 2023-10-06T04:39:27.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.696+0000 7f06a1171700 1 -- 172.21.15.112:0/502049185 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c00bd20 con 0x7f069c0aa950 2023-10-06T04:39:27.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.696+0000 7f6f5a708700 1 -- 172.21.15.112:0/2845072944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5406a4b0 con 0x7f6f540b09a0 2023-10-06T04:39:27.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.696+0000 7f9421804700 1 Processor -- start 2023-10-06T04:39:27.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.696+0000 7f9421804700 1 -- start start 2023-10-06T04:39:27.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.696+0000 7f3baffff700 1 -- 172.21.15.112:0/1042179629 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bbc010bd0 con 0x7f3bc40acff0 2023-10-06T04:39:27.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.696+0000 7f3baffff700 1 --2- 172.21.15.112:0/1042179629 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3ba8066fb0 0x7f3ba8069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.696+0000 7f3baffff700 1 -- 172.21.15.112:0/1042179629 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3bbc085d60 con 0x7f3bc40acff0 2023-10-06T04:39:27.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.696+0000 7f3bc3fff700 1 --2- 172.21.15.112:0/1042179629 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3ba8066fb0 0x7f3ba8069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f69a8a90700 1 -- 172.21.15.112:0/765252810 shutdown_connections 2023-10-06T04:39:27.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f69a8a90700 1 --2- 172.21.15.112:0/765252810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69a40b0b10 0x7f69a415f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f69a8a90700 1 --2- 172.21.15.112:0/765252810 >> v2:172.21.15.179:3300/0 conn(0x7f69a4158440 0x7f69a40a9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f69a8a90700 1 --2- 172.21.15.112:0/765252810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69a40a9680 0x7f69a40b05d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f69a8a90700 1 -- 172.21.15.112:0/765252810 >> 172.21.15.112:0/765252810 conn(0x7f69a406d220 msgr2=0x7f69a40cc280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f69a8a90700 1 -- 172.21.15.112:0/765252810 shutdown_connections 2023-10-06T04:39:27.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f3bc3fff700 1 --2- 172.21.15.112:0/1042179629 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3ba8066fb0 0x7f3ba8069460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80099c0 tx=0x7f3bb8018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f69a8a90700 1 -- 172.21.15.112:0/765252810 wait complete. 2023-10-06T04:39:27.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f9421804700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f941c0c9470 0x7f941c15e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f9421804700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f941c0ca770 0x7f941c0c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f9421804700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f941c13f4f0 0x7f941c0c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f9421804700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c15b300 con 0x7f941c13f4f0 2023-10-06T04:39:27.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f9421804700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c15b5e0 con 0x7f941c0ca770 2023-10-06T04:39:27.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f9421804700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c15b8c0 con 0x7f941c0c9470 2023-10-06T04:39:27.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f941affd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f941c0c9470 0x7f941c15e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f06a43d7700 1 -- 172.21.15.112:0/502049185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f069c0aa950 msgr2=0x7f069c06e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f06a43d7700 1 --2- 172.21.15.112:0/502049185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f069c0aa950 0x7f069c06e170 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f068c009910 tx=0x7f068c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f941a7fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f941c0ca770 0x7f941c0c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f941affd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f941c0c9470 0x7f941c15e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.112:47410/0 (socket says 172.21.15.112:47410) 2023-10-06T04:39:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f941affd700 1 -- 172.21.15.112:0/3285738848 learned_addr learned my addr 172.21.15.112:0/3285738848 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f941b7fe700 1 --2- 172.21.15.112:0/3285738848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f941c13f4f0 0x7f941c0c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f941a7fc700 1 -- 172.21.15.112:0/3285738848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f941c0c9470 msgr2=0x7f941c15e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f941a7fc700 1 --2- 172.21.15.112:0/3285738848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f941c0c9470 0x7f941c15e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f941a7fc700 1 -- 172.21.15.112:0/3285738848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f941c13f4f0 msgr2=0x7f941c0c2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f941a7fc700 1 --2- 172.21.15.112:0/3285738848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f941c13f4f0 0x7f941c0c2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f941a7fc700 1 -- 172.21.15.112:0/3285738848 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9414009ae0 con 0x7f941c0ca770 2023-10-06T04:39:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f06a43d7700 1 -- 172.21.15.112:0/502049185 shutdown_connections 2023-10-06T04:39:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f06a43d7700 1 --2- 172.21.15.112:0/502049185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f069c0aa950 0x7f069c06e170 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f06a43d7700 1 --2- 172.21.15.112:0/502049185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f069c159b20 0x7f069c06b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f06a43d7700 1 -- 172.21.15.112:0/502049185 >> 172.21.15.112:0/502049185 conn(0x7f069c06d2a0 msgr2=0x7f069c0cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f06a43d7700 1 -- 172.21.15.112:0/502049185 shutdown_connections 2023-10-06T04:39:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f06a43d7700 1 -- 172.21.15.112:0/502049185 wait complete. 2023-10-06T04:39:27.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f941a7fc700 1 --2- 172.21.15.112:0/3285738848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f941c0ca770 0x7f941c0c5db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f941000b5e0 tx=0x7f94100090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f9402ffd700 1 -- 172.21.15.112:0/3285738848 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941000f510 con 0x7f941c0ca770 2023-10-06T04:39:27.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f9402ffd700 1 -- 172.21.15.112:0/3285738848 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941000f690 con 0x7f941c0ca770 2023-10-06T04:39:27.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f9402ffd700 1 -- 172.21.15.112:0/3285738848 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941000fa50 con 0x7f941c0ca770 2023-10-06T04:39:27.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f9421804700 1 -- 172.21.15.112:0/3285738848 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941c15bba0 con 0x7f941c0ca770 2023-10-06T04:39:27.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f9421804700 1 -- 172.21.15.112:0/3285738848 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941c15c3a0 con 0x7f941c0ca770 2023-10-06T04:39:27.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.699+0000 7f69a8a90700 1 Processor -- start 2023-10-06T04:39:27.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.699+0000 7f69a8a90700 1 -- start start 2023-10-06T04:39:27.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.699+0000 7f9421804700 1 -- 172.21.15.112:0/3285738848 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941c15c5c0 con 0x7f941c0ca770 2023-10-06T04:39:27.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.699+0000 7f06a43d7700 1 Processor -- start 2023-10-06T04:39:27.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f06a43d7700 1 -- start start 2023-10-06T04:39:27.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f69a8a90700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69a40a9680 0x7f69a41563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f69a8a90700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69a40b0b10 0x7f69a416ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f69a8a90700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69a4158440 0x7f69a40c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f69a8a90700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a40c9ca0 con 0x7f69a4158440 2023-10-06T04:39:27.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f69a8a90700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a4161740 con 0x7f69a40a9680 2023-10-06T04:39:27.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f69a8a90700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a4161ce0 con 0x7f69a40b0b10 2023-10-06T04:39:27.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f69a3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69a4158440 0x7f69a40c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f69a3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69a4158440 0x7f69a40c8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51502/0 (socket says 172.21.15.112:51502) 2023-10-06T04:39:27.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f69a3fff700 1 -- 172.21.15.112:0/1560414701 learned_addr learned my addr 172.21.15.112:0/1560414701 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f69a37fe700 1 --2- 172.21.15.112:0/1560414701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69a40a9680 0x7f69a41563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f9402ffd700 1 -- 172.21.15.112:0/3285738848 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f941001a400 con 0x7f941c0ca770 2023-10-06T04:39:27.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f69a37fe700 1 -- 172.21.15.112:0/1560414701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69a40b0b10 msgr2=0x7f69a416ed60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:39:27.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f69a37fe700 1 --2- 172.21.15.112:0/1560414701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69a40b0b10 0x7f69a416ed60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f69a37fe700 1 -- 172.21.15.112:0/1560414701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69a4158440 msgr2=0x7f69a40c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f69a37fe700 1 --2- 172.21.15.112:0/1560414701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69a4158440 0x7f69a40c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f69a37fe700 1 -- 172.21.15.112:0/1560414701 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69980094f0 con 0x7f69a40a9680 2023-10-06T04:39:27.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f69a37fe700 1 --2- 172.21.15.112:0/1560414701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69a40a9680 0x7f69a41563b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f699400ea50 tx=0x7f6994009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f06a43d7700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f069c06dcf0 0x7f069c157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f06a43d7700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f069c0aa950 0x7f069c15a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f06a43d7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f069c159b20 0x7f069c0c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f06a43d7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c15b9d0 con 0x7f069c159b20 2023-10-06T04:39:27.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f06a43d7700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c16a060 con 0x7f069c06dcf0 2023-10-06T04:39:27.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f06a43d7700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069c1582f0 con 0x7f069c0aa950 2023-10-06T04:39:27.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f06a2173700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f069c06dcf0 0x7f069c157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f06a2173700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f069c06dcf0 0x7f069c157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.112:35252/0 (socket says 172.21.15.112:35252) 2023-10-06T04:39:27.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f06a2974700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f069c159b20 0x7f069c0c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f06a2173700 1 -- 172.21.15.112:0/787717737 learned_addr learned my addr 172.21.15.112:0/787717737 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f06a2974700 1 -- 172.21.15.112:0/787717737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f069c0aa950 msgr2=0x7f069c15a8b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:39:27.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f06a2974700 1 --2- 172.21.15.112:0/787717737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f069c0aa950 0x7f069c15a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f06a2974700 1 -- 172.21.15.112:0/787717737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f069c06dcf0 msgr2=0x7f069c157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f06a2974700 1 --2- 172.21.15.112:0/787717737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f069c06dcf0 0x7f069c157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f06a2974700 1 -- 172.21.15.112:0/787717737 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068c009420 con 0x7f069c159b20 2023-10-06T04:39:27.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f06a2173700 1 --2- 172.21.15.112:0/787717737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f069c06dcf0 0x7f069c157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:27.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f9402ffd700 1 --2- 172.21.15.112:0/3285738848 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9408066f30 0x7f94080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f9402ffd700 1 -- 172.21.15.112:0/3285738848 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f94100844d0 con 0x7f941c0ca770 2023-10-06T04:39:27.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f941affd700 1 --2- 172.21.15.112:0/3285738848 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9408066f30 0x7f94080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f06a2974700 1 --2- 172.21.15.112:0/787717737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f069c159b20 0x7f069c0c2ed0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f069c065a80 tx=0x7f068c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7fef10ff9700 1 -- 172.21.15.112:0/3897965774 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef08010430 con 0x7fef140abfd0 2023-10-06T04:39:27.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7fef10ff9700 1 --2- 172.21.15.112:0/3897965774 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7feef8066f80 0x7feef8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7fef10ff9700 1 -- 172.21.15.112:0/3897965774 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fef08084ce0 con 0x7fef140abfd0 2023-10-06T04:39:27.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.702+0000 7fef18d94700 1 --2- 172.21.15.112:0/3897965774 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7feef8066f80 0x7feef8069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.695+0000 7f0e5a150700 1 Processor -- start 2023-10-06T04:39:27.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.696+0000 7f0e5a150700 1 -- start start 2023-10-06T04:39:27.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f0e5a150700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e5406ca20 0x7f0e54159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f0e5a150700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e5406dff0 0x7f0e541599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f0e5a150700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e540acee0 0x7f0e54176e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f0e5a150700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e540a8ea0 con 0x7f0e5406ca20 2023-10-06T04:39:27.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f0e5a150700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e540ab4c0 con 0x7f0e540acee0 2023-10-06T04:39:27.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f0e5a150700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e540ab7a0 con 0x7f0e5406dff0 2023-10-06T04:39:27.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f0e52ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e5406dff0 0x7f0e541599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f0e53fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e540acee0 0x7f0e54176e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.702+0000 7f941affd700 1 --2- 172.21.15.112:0/3285738848 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9408066f30 0x7f94080693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f940c009b80 tx=0x7f940c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f0e52ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e5406dff0 0x7f0e541599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.112:47406/0 (socket says 172.21.15.112:47406) 2023-10-06T04:39:27.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f0e53fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e540acee0 0x7f0e54176e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.112:35230/0 (socket says 172.21.15.112:35230) 2023-10-06T04:39:27.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.697+0000 7f0e52ffd700 1 -- 172.21.15.112:0/3930422887 learned_addr learned my addr 172.21.15.112:0/3930422887 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:27.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f0e52ffd700 1 -- 172.21.15.112:0/3930422887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e540acee0 msgr2=0x7f0e54176e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f0e52ffd700 1 --2- 172.21.15.112:0/3930422887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e540acee0 0x7f0e54176e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f0e52ffd700 1 -- 172.21.15.112:0/3930422887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e5406ca20 msgr2=0x7f0e54159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:27.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f0e52ffd700 1 --2- 172.21.15.112:0/3930422887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e5406ca20 0x7f0e54159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:27.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.698+0000 7f0e52ffd700 1 -- 172.21.15.112:0/3930422887 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e48009420 con 0x7f0e5406dff0 2023-10-06T04:39:27.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f0e52ffd700 1 --2- 172.21.15.112:0/3930422887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e5406dff0 0x7f0e541599a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0e4400b5e0 tx=0x7f0e440090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f0e3b7fe700 1 -- 172.21.15.112:0/3930422887 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4400f510 con 0x7f0e5406dff0 2023-10-06T04:39:27.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f0e3b7fe700 1 -- 172.21.15.112:0/3930422887 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4400f690 con 0x7f0e5406dff0 2023-10-06T04:39:27.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f0e5a150700 1 -- 172.21.15.112:0/3930422887 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e540aba80 con 0x7f0e5406dff0 2023-10-06T04:39:27.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f0e5a150700 1 -- 172.21.15.112:0/3930422887 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e540ac040 con 0x7f0e5406dff0 2023-10-06T04:39:27.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.700+0000 7f0e3b7fe700 1 -- 172.21.15.112:0/3930422887 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4400fa50 con 0x7f0e5406dff0 2023-10-06T04:39:27.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.701+0000 7f0e5a150700 1 -- 172.21.15.112:0/3930422887 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e340052b0 con 0x7f0e5406dff0 2023-10-06T04:39:27.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.702+0000 7fef18d94700 1 --2- 172.21.15.112:0/3897965774 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7feef8066f80 0x7feef8069430 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fef00006fd0 tx=0x7fef00008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.703+0000 7fef10ff9700 1 -- 172.21.15.112:0/3897965774 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef08051dd0 con 0x7fef140abfd0 2023-10-06T04:39:27.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.705+0000 7f698b7fe700 1 -- 172.21.15.112:0/1560414701 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699400eee0 con 0x7f69a40a9680 2023-10-06T04:39:27.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.705+0000 7f698b7fe700 1 -- 172.21.15.112:0/1560414701 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699400c850 con 0x7f69a40a9680 2023-10-06T04:39:27.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.705+0000 7f69a8a90700 1 -- 172.21.15.112:0/1560414701 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a416f2a0 con 0x7f69a40a9680 2023-10-06T04:39:27.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.705+0000 7f9402ffd700 1 -- 172.21.15.112:0/3285738848 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9410051740 con 0x7f941c0ca770 2023-10-06T04:39:27.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.705+0000 7f698b7fe700 1 -- 172.21.15.112:0/1560414701 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699400cbf0 con 0x7f69a40a9680 2023-10-06T04:39:27.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.705+0000 7f69a8a90700 1 -- 172.21.15.112:0/1560414701 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a40c99c0 con 0x7f69a40a9680 2023-10-06T04:39:27.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.706+0000 7f0e3b7fe700 1 -- 172.21.15.112:0/3930422887 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e4401a400 con 0x7f0e5406dff0 2023-10-06T04:39:27.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.706+0000 7f69a8a90700 1 -- 172.21.15.112:0/1560414701 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a405f230 con 0x7f69a40a9680 2023-10-06T04:39:27.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.706+0000 7f0e3b7fe700 1 --2- 172.21.15.112:0/3930422887 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0e40067000 0x7f0e400694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.706+0000 7f0e3b7fe700 1 -- 172.21.15.112:0/3930422887 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e44084010 con 0x7f0e5406dff0 2023-10-06T04:39:27.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.706+0000 7f0e537fe700 1 --2- 172.21.15.112:0/3930422887 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0e40067000 0x7f0e400694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.706+0000 7f698b7fe700 1 -- 172.21.15.112:0/1560414701 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6994013470 con 0x7f69a40a9680 2023-10-06T04:39:27.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.707+0000 7f698b7fe700 1 --2- 172.21.15.112:0/1560414701 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6990066fb0 0x7f6990069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.707+0000 7f0e537fe700 1 --2- 172.21.15.112:0/3930422887 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0e40067000 0x7f0e400694b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e480098e0 tx=0x7f0e48017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.707+0000 7f698b7fe700 1 -- 172.21.15.112:0/1560414701 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6994084d30 con 0x7f69a40a9680 2023-10-06T04:39:27.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.707+0000 7f69a2ffd700 1 --2- 172.21.15.112:0/1560414701 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6990066fb0 0x7f6990069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.707+0000 7f69a2ffd700 1 --2- 172.21.15.112:0/1560414701 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6990066fb0 0x7f6990069460 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f69a40710d0 tx=0x7f6998017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.711+0000 7f0e3b7fe700 1 -- 172.21.15.112:0/3930422887 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e44054d10 con 0x7f0e5406dff0 2023-10-06T04:39:27.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.712+0000 7f698b7fe700 1 -- 172.21.15.112:0/1560414701 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6994055830 con 0x7f69a40a9680 2023-10-06T04:39:27.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.713+0000 7f3baffff700 1 -- 172.21.15.112:0/1042179629 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bbc052e50 con 0x7f3bc40acff0 2023-10-06T04:39:27.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.718+0000 7f6f497fa700 1 -- 172.21.15.112:0/2845072944 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f4c029460 con 0x7f6f540b09a0 2023-10-06T04:39:27.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.719+0000 7f6f497fa700 1 --2- 172.21.15.112:0/2845072944 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6f38067080 0x7f6f38069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.719+0000 7f6f497fa700 1 -- 172.21.15.112:0/2845072944 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6f4c087550 con 0x7f6f540b09a0 2023-10-06T04:39:27.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.719+0000 7f6f59706700 1 --2- 172.21.15.112:0/2845072944 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6f38067080 0x7f6f38069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.720+0000 7f6f59706700 1 --2- 172.21.15.112:0/2845072944 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6f38067080 0x7f6f38069530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009740 tx=0x7f6f50006c60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.726+0000 7f6f497fa700 1 -- 172.21.15.112:0/2845072944 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f4c054770 con 0x7f6f540b09a0 2023-10-06T04:39:27.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.717+0000 7f06927fc700 1 -- 172.21.15.112:0/787717737 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c00b820 con 0x7f069c159b20 2023-10-06T04:39:27.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.717+0000 7f06927fc700 1 -- 172.21.15.112:0/787717737 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c011e90 con 0x7f069c159b20 2023-10-06T04:39:27.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.717+0000 7f06927fc700 1 -- 172.21.15.112:0/787717737 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c01a840 con 0x7f069c159b20 2023-10-06T04:39:27.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.727+0000 7f06a43d7700 1 -- 172.21.15.112:0/787717737 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069c15b130 con 0x7f069c159b20 2023-10-06T04:39:27.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.733+0000 7f06a43d7700 1 -- 172.21.15.112:0/787717737 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069c15b6f0 con 0x7f069c159b20 2023-10-06T04:39:27.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.734+0000 7f06927fc700 1 -- 172.21.15.112:0/787717737 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f068c01ac30 con 0x7f069c159b20 2023-10-06T04:39:27.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.734+0000 7f06927fc700 1 --2- 172.21.15.112:0/787717737 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0680066f60 0x7f0680069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:27.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.735+0000 7f06927fc700 1 -- 172.21.15.112:0/787717737 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f068c056780 con 0x7f069c159b20 2023-10-06T04:39:27.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.736+0000 7f06a2173700 1 --2- 172.21.15.112:0/787717737 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0680066f60 0x7f0680069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:27.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.737+0000 7f06a2173700 1 --2- 172.21.15.112:0/787717737 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0680066f60 0x7f0680069410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f06940076a0 tx=0x7f0694009840 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:27.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.750+0000 7f06a43d7700 1 -- 172.21.15.112:0/787717737 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069c05f230 con 0x7f069c159b20 2023-10-06T04:39:27.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:27.764+0000 7f06927fc700 1 -- 172.21.15.112:0/787717737 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f068c015080 con 0x7f069c159b20 2023-10-06T04:39:28.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.063+0000 7f4311a3a700 1 -- 172.21.15.112:0/2863615100 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f430c0aece0 con 0x7f430c15eb70 2023-10-06T04:39:28.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.067+0000 7f42f2ffd700 1 -- 172.21.15.112:0/2863615100 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4304054d10 con 0x7f430c15eb70 2023-10-06T04:39:28.079 INFO:teuthology.orchestra.run.smithi112.stdout:55834574853 2023-10-06T04:39:28.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.085+0000 7f4311a3a700 1 -- 172.21.15.112:0/2863615100 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f42f8066f30 msgr2=0x7f42f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.085+0000 7f4311a3a700 1 --2- 172.21.15.112:0/2863615100 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f42f8066f30 0x7f42f80693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4300009fd0 tx=0x7f4300016000 comp rx=0 tx=0).stop 2023-10-06T04:39:28.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.085+0000 7f4311a3a700 1 -- 172.21.15.112:0/2863615100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c15eb70 msgr2=0x7f430c162a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.085+0000 7f4311a3a700 1 --2- 172.21.15.112:0/2863615100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c15eb70 0x7f430c162a40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f430400bb30 tx=0x7f4304009780 comp rx=0 tx=0).stop 2023-10-06T04:39:28.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.085+0000 7f4311a3a700 1 -- 172.21.15.112:0/2863615100 shutdown_connections 2023-10-06T04:39:28.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.085+0000 7f4311a3a700 1 --2- 172.21.15.112:0/2863615100 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f42f8066f30 0x7f42f80693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.085+0000 7f4311a3a700 1 --2- 172.21.15.112:0/2863615100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c15eb70 0x7f430c162a40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.085+0000 7f4311a3a700 1 --2- 172.21.15.112:0/2863615100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f430c06b120 0x7f430c0c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.085+0000 7f4311a3a700 1 --2- 172.21.15.112:0/2863615100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f430c06e660 0x7f430c1468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.085+0000 7f4311a3a700 1 -- 172.21.15.112:0/2863615100 >> 172.21.15.112:0/2863615100 conn(0x7f430c068750 msgr2=0x7f430c154880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:28.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.086+0000 7f4311a3a700 1 -- 172.21.15.112:0/2863615100 shutdown_connections 2023-10-06T04:39:28.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.086+0000 7f4311a3a700 1 -- 172.21.15.112:0/2863615100 wait complete. 2023-10-06T04:39:28.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.087+0000 7fef1aff8700 1 -- 172.21.15.112:0/3897965774 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fef1416d220 con 0x7fef140abfd0 2023-10-06T04:39:28.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.088+0000 7fef10ff9700 1 -- 172.21.15.112:0/3897965774 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef1416d220 con 0x7fef140abfd0 2023-10-06T04:39:28.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.089+0000 7f9421804700 1 -- 172.21.15.112:0/3285738848 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f941c05f230 con 0x7f941c0ca770 2023-10-06T04:39:28.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.090+0000 7f9402ffd700 1 -- 172.21.15.112:0/3285738848 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9410054d60 con 0x7f941c0ca770 2023-10-06T04:39:28.093 INFO:teuthology.orchestra.run.smithi112.stdout:55834574852 2023-10-06T04:39:28.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.093+0000 7f0e5a150700 1 -- 172.21.15.112:0/3930422887 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0e34005830 con 0x7f0e5406dff0 2023-10-06T04:39:28.094 INFO:teuthology.orchestra.run.smithi112.stdout:55834574853 2023-10-06T04:39:28.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.094+0000 7f69a8a90700 1 -- 172.21.15.112:0/1560414701 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f69a40b13c0 con 0x7f69a40a9680 2023-10-06T04:39:28.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.095+0000 7fef1aff8700 1 -- 172.21.15.112:0/3897965774 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7feef8066f80 msgr2=0x7feef8069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.095+0000 7fef1aff8700 1 --2- 172.21.15.112:0/3897965774 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7feef8066f80 0x7feef8069430 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fef00006fd0 tx=0x7fef00008040 comp rx=0 tx=0).stop 2023-10-06T04:39:28.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.095+0000 7fef1aff8700 1 -- 172.21.15.112:0/3897965774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef140abfd0 msgr2=0x7fef141498a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.095+0000 7fef1aff8700 1 --2- 172.21.15.112:0/3897965774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef140abfd0 0x7fef141498a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fef0800bfd0 tx=0x7fef0800b420 comp rx=0 tx=0).stop 2023-10-06T04:39:28.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.095+0000 7fef1aff8700 1 -- 172.21.15.112:0/3897965774 shutdown_connections 2023-10-06T04:39:28.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.095+0000 7fef1aff8700 1 --2- 172.21.15.112:0/3897965774 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7feef8066f80 0x7feef8069430 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.095+0000 7fef1aff8700 1 --2- 172.21.15.112:0/3897965774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef1415a200 0x7fef140aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.095+0000 7fef1aff8700 1 --2- 172.21.15.112:0/3897965774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef140abc00 0x7fef1414ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.095+0000 7fef1aff8700 1 --2- 172.21.15.112:0/3897965774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef140abfd0 0x7fef141498a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.095+0000 7fef1aff8700 1 -- 172.21.15.112:0/3897965774 >> 172.21.15.112:0/3897965774 conn(0x7fef140cd6e0 msgr2=0x7fef1406ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:28.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.095+0000 7fef1aff8700 1 -- 172.21.15.112:0/3897965774 shutdown_connections 2023-10-06T04:39:28.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.095+0000 7fef1aff8700 1 -- 172.21.15.112:0/3897965774 wait complete. 2023-10-06T04:39:28.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.096+0000 7f0e3b7fe700 1 -- 172.21.15.112:0/3930422887 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0e440548a0 con 0x7f0e5406dff0 2023-10-06T04:39:28.098 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2023-10-06T04:39:28.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.096+0000 7f9421804700 1 -- 172.21.15.112:0/3285738848 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9408066f30 msgr2=0x7f94080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.096+0000 7f9421804700 1 --2- 172.21.15.112:0/3285738848 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9408066f30 0x7f94080693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f940c009b80 tx=0x7f940c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.096+0000 7f9421804700 1 -- 172.21.15.112:0/3285738848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f941c0ca770 msgr2=0x7f941c0c5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.096+0000 7f9421804700 1 --2- 172.21.15.112:0/3285738848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f941c0ca770 0x7f941c0c5db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f941000b5e0 tx=0x7f94100090f0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.096+0000 7f9421804700 1 -- 172.21.15.112:0/3285738848 shutdown_connections 2023-10-06T04:39:28.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.096+0000 7f9421804700 1 --2- 172.21.15.112:0/3285738848 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9408066f30 0x7f94080693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.096+0000 7f9421804700 1 --2- 172.21.15.112:0/3285738848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f941c13f4f0 0x7f941c0c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.096+0000 7f9421804700 1 --2- 172.21.15.112:0/3285738848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f941c0c9470 0x7f941c15e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.096+0000 7f9421804700 1 --2- 172.21.15.112:0/3285738848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f941c0ca770 0x7f941c0c5db0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.096+0000 7f9421804700 1 -- 172.21.15.112:0/3285738848 >> 172.21.15.112:0/3285738848 conn(0x7f941c06e830 msgr2=0x7f941c0cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:28.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.096+0000 7f698b7fe700 1 -- 172.21.15.112:0/1560414701 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6994017090 con 0x7f69a40a9680 2023-10-06T04:39:28.100 INFO:teuthology.orchestra.run.smithi112.stdout:55834574853 2023-10-06T04:39:28.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.098+0000 7f9421804700 1 -- 172.21.15.112:0/3285738848 shutdown_connections 2023-10-06T04:39:28.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.098+0000 7f9421804700 1 -- 172.21.15.112:0/3285738848 wait complete. 2023-10-06T04:39:28.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.100+0000 7f69a8a90700 1 -- 172.21.15.112:0/1560414701 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6990066fb0 msgr2=0x7f6990069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.100+0000 7f69a8a90700 1 --2- 172.21.15.112:0/1560414701 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6990066fb0 0x7f6990069460 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f69a40710d0 tx=0x7f6998017000 comp rx=0 tx=0).stop 2023-10-06T04:39:28.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.100+0000 7f69a8a90700 1 -- 172.21.15.112:0/1560414701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69a40a9680 msgr2=0x7f69a41563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.100+0000 7f69a8a90700 1 --2- 172.21.15.112:0/1560414701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69a40a9680 0x7f69a41563b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f699400ea50 tx=0x7f6994009120 comp rx=0 tx=0).stop 2023-10-06T04:39:28.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.102+0000 7f3bca916700 1 -- 172.21.15.112:0/1042179629 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3bc406ecd0 con 0x7f3bc40acff0 2023-10-06T04:39:28.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.103+0000 7f69a8a90700 1 -- 172.21.15.112:0/1560414701 shutdown_connections 2023-10-06T04:39:28.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.103+0000 7f69a8a90700 1 --2- 172.21.15.112:0/1560414701 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6990066fb0 0x7f6990069460 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.103+0000 7f69a8a90700 1 --2- 172.21.15.112:0/1560414701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69a4158440 0x7f69a40c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.103+0000 7f69a8a90700 1 --2- 172.21.15.112:0/1560414701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69a40a9680 0x7f69a41563b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.103+0000 7f69a8a90700 1 --2- 172.21.15.112:0/1560414701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69a40b0b10 0x7f69a416ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.103+0000 7f69a8a90700 1 -- 172.21.15.112:0/1560414701 >> 172.21.15.112:0/1560414701 conn(0x7f69a406d220 msgr2=0x7f69a40ac670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:28.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.103+0000 7f0e5a150700 1 -- 172.21.15.112:0/3930422887 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0e40067000 msgr2=0x7f0e400694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.103+0000 7f0e5a150700 1 --2- 172.21.15.112:0/3930422887 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0e40067000 0x7f0e400694b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e480098e0 tx=0x7f0e48017000 comp rx=0 tx=0).stop 2023-10-06T04:39:28.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.103+0000 7f0e5a150700 1 -- 172.21.15.112:0/3930422887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e5406dff0 msgr2=0x7f0e541599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.103+0000 7f0e5a150700 1 --2- 172.21.15.112:0/3930422887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e5406dff0 0x7f0e541599a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0e4400b5e0 tx=0x7f0e440090f0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.103+0000 7f0e5a150700 1 -- 172.21.15.112:0/3930422887 shutdown_connections 2023-10-06T04:39:28.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.103+0000 7f0e5a150700 1 --2- 172.21.15.112:0/3930422887 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0e40067000 0x7f0e400694b0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e480098e0 tx=0x7f0e48017000 comp rx=0 tx=0).stop 2023-10-06T04:39:28.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.103+0000 7f0e5a150700 1 --2- 172.21.15.112:0/3930422887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e540acee0 0x7f0e54176e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.103+0000 7f0e5a150700 1 --2- 172.21.15.112:0/3930422887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e5406ca20 0x7f0e54159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.103+0000 7f0e5a150700 1 --2- 172.21.15.112:0/3930422887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e5406dff0 0x7f0e541599a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.103+0000 7f0e5a150700 1 -- 172.21.15.112:0/3930422887 >> 172.21.15.112:0/3930422887 conn(0x7f0e54068650 msgr2=0x7f0e540aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:28.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.105+0000 7f3baffff700 1 -- 172.21.15.112:0/1042179629 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3bbc016020 con 0x7f3bc40acff0 2023-10-06T04:39:28.109 INFO:teuthology.orchestra.run.smithi112.stdout:55834574852 2023-10-06T04:39:28.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-06T04:39:28.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.107+0000 7f69a8a90700 1 -- 172.21.15.112:0/1560414701 shutdown_connections 2023-10-06T04:39:28.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.107+0000 7f0e5a150700 1 -- 172.21.15.112:0/3930422887 shutdown_connections 2023-10-06T04:39:28.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.107+0000 7f0e5a150700 1 -- 172.21.15.112:0/3930422887 wait complete. 2023-10-06T04:39:28.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.107+0000 7f3bca916700 1 -- 172.21.15.112:0/1042179629 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3ba8066fb0 msgr2=0x7f3ba8069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.107+0000 7f3bca916700 1 --2- 172.21.15.112:0/1042179629 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3ba8066fb0 0x7f3ba8069460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80099c0 tx=0x7f3bb8018000 comp rx=0 tx=0).stop 2023-10-06T04:39:28.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.108+0000 7f3bca916700 1 -- 172.21.15.112:0/1042179629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bc40acff0 msgr2=0x7f3bc40af4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.108+0000 7f3bca916700 1 --2- 172.21.15.112:0/1042179629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bc40acff0 0x7f3bc40af4e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0070b0 tx=0x7f3bbc007200 comp rx=0 tx=0).stop 2023-10-06T04:39:28.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.110+0000 7f3bca916700 1 -- 172.21.15.112:0/1042179629 shutdown_connections 2023-10-06T04:39:28.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.110+0000 7f3bca916700 1 --2- 172.21.15.112:0/1042179629 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3ba8066fb0 0x7f3ba8069460 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.110+0000 7f3bca916700 1 --2- 172.21.15.112:0/1042179629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bc40acff0 0x7f3bc40af4e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.110+0000 7f3bca916700 1 --2- 172.21.15.112:0/1042179629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bc406df40 0x7f3bc4160660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.110+0000 7f3bca916700 1 --2- 172.21.15.112:0/1042179629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bc4087b70 0x7f3bc40cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.110+0000 7f3bca916700 1 -- 172.21.15.112:0/1042179629 >> 172.21.15.112:0/1042179629 conn(0x7f3bc406d260 msgr2=0x7f3bc40ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:28.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.111+0000 7f3bca916700 1 -- 172.21.15.112:0/1042179629 shutdown_connections 2023-10-06T04:39:28.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.111+0000 7f3bca916700 1 -- 172.21.15.112:0/1042179629 wait complete. 2023-10-06T04:39:28.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.114+0000 7f69a8a90700 1 -- 172.21.15.112:0/1560414701 wait complete. 2023-10-06T04:39:28.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-10-06T04:39:28.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.116+0000 7f6f5a708700 1 -- 172.21.15.112:0/2845072944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6f5405f230 con 0x7f6f540b09a0 2023-10-06T04:39:28.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2023-10-06T04:39:28.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.117+0000 7f6f497fa700 1 -- 172.21.15.112:0/2845072944 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f4c057d90 con 0x7f6f540b09a0 2023-10-06T04:39:28.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.117+0000 7f06a43d7700 1 -- 172.21.15.112:0/787717737 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f069c16a1a0 con 0x7f069c159b20 2023-10-06T04:39:28.120 INFO:teuthology.orchestra.run.smithi112.stdout:55834574852 2023-10-06T04:39:28.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.118+0000 7f06927fc700 1 -- 172.21.15.112:0/787717737 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f068c08a060 con 0x7f069c159b20 2023-10-06T04:39:28.120 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2023-10-06T04:39:28.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.120+0000 7f06a43d7700 1 -- 172.21.15.112:0/787717737 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0680066f60 msgr2=0x7f0680069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.120+0000 7f06a43d7700 1 --2- 172.21.15.112:0/787717737 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0680066f60 0x7f0680069410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f06940076a0 tx=0x7f0694009840 comp rx=0 tx=0).stop 2023-10-06T04:39:28.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.120+0000 7f06a43d7700 1 -- 172.21.15.112:0/787717737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f069c159b20 msgr2=0x7f069c0c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.120+0000 7f06a43d7700 1 --2- 172.21.15.112:0/787717737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f069c159b20 0x7f069c0c2ed0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f069c065a80 tx=0x7f068c017000 comp rx=0 tx=0).stop 2023-10-06T04:39:28.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.120+0000 7f06a43d7700 1 -- 172.21.15.112:0/787717737 shutdown_connections 2023-10-06T04:39:28.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.120+0000 7f06a43d7700 1 --2- 172.21.15.112:0/787717737 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0680066f60 0x7f0680069410 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.120+0000 7f06a43d7700 1 --2- 172.21.15.112:0/787717737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f069c159b20 0x7f069c0c2ed0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.120+0000 7f06a43d7700 1 --2- 172.21.15.112:0/787717737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f069c06dcf0 0x7f069c157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.120+0000 7f06a43d7700 1 --2- 172.21.15.112:0/787717737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f069c0aa950 0x7f069c15a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.120+0000 7f06a43d7700 1 -- 172.21.15.112:0/787717737 >> 172.21.15.112:0/787717737 conn(0x7f069c06d2a0 msgr2=0x7f069c0b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:28.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.120+0000 7f06a43d7700 1 -- 172.21.15.112:0/787717737 shutdown_connections 2023-10-06T04:39:28.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.120+0000 7f06a43d7700 1 -- 172.21.15.112:0/787717737 wait complete. 2023-10-06T04:39:28.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.121+0000 7f6f5a708700 1 -- 172.21.15.112:0/2845072944 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6f38067080 msgr2=0x7f6f38069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.121+0000 7f6f5a708700 1 --2- 172.21.15.112:0/2845072944 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6f38067080 0x7f6f38069530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009740 tx=0x7f6f50006c60 comp rx=0 tx=0).stop 2023-10-06T04:39:28.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.121+0000 7f6f5a708700 1 -- 172.21.15.112:0/2845072944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f540b09a0 msgr2=0x7f6f540991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:28.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.121+0000 7f6f5a708700 1 --2- 172.21.15.112:0/2845072944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f540b09a0 0x7f6f540991a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00c410 tx=0x7f6f4c018000 comp rx=0 tx=0).stop 2023-10-06T04:39:28.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.122+0000 7f6f5a708700 1 -- 172.21.15.112:0/2845072944 shutdown_connections 2023-10-06T04:39:28.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.122+0000 7f6f5a708700 1 --2- 172.21.15.112:0/2845072944 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6f38067080 0x7f6f38069530 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.122+0000 7f6f5a708700 1 --2- 172.21.15.112:0/2845072944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f540b09a0 0x7f6f540991a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.122+0000 7f6f5a708700 1 --2- 172.21.15.112:0/2845072944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f54069a20 0x7f6f5416a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.122+0000 7f6f5a708700 1 --2- 172.21.15.112:0/2845072944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f540b05d0 0x7f6f54098c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:28.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.122+0000 7f6f5a708700 1 -- 172.21.15.112:0/2845072944 >> 172.21.15.112:0/2845072944 conn(0x7f6f5406d270 msgr2=0x7f6f5406f310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:28.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.126+0000 7f6f5a708700 1 -- 172.21.15.112:0/2845072944 shutdown_connections 2023-10-06T04:39:28.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:28.126+0000 7f6f5a708700 1 -- 172.21.15.112:0/2845072944 wait complete. 2023-10-06T04:39:28.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-10-06T04:39:28.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2023-10-06T04:39:28.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-10-06T04:39:28.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-10-06T04:39:28.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-10-06T04:39:29.111 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T04:39:29.119 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T04:39:29.119 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T04:39:29.130 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T04:39:29.130 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T04:39:29.136 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T04:39:29.137 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T04:39:29.142 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T04:39:29.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.297+0000 7f1a7330a700 1 Processor -- start 2023-10-06T04:39:29.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.297+0000 7f1a7330a700 1 -- start start 2023-10-06T04:39:29.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.298+0000 7f1a7330a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1a6c15de70 0x7f1a6c0ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.298+0000 7f1a7330a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1a6c06e400 0x7f1a6c15e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.298+0000 7f1a7330a700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a6c06ad20 con 0x7f1a6c0ad120 2023-10-06T04:39:29.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.299+0000 7f1a7330a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a6c06b9a0 con 0x7f1a6c06e400 2023-10-06T04:39:29.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.299+0000 7f1a7330a700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a6c06b000 con 0x7f1a6c15de70 2023-10-06T04:39:29.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.299+0000 7f1a718a7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1a6c06e400 0x7f1a6c15e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.299+0000 7f1a718a7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1a6c06e400 0x7f1a6c15e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58164/0 (socket says 172.21.15.112:58164) 2023-10-06T04:39:29.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.299+0000 7f1a718a7700 1 -- 172.21.15.112:0/3662622363 learned_addr learned my addr 172.21.15.112:0/3662622363 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:29.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.299+0000 7f1a718a7700 1 -- 172.21.15.112:0/3662622363 >> v2:172.21.15.179:3300/0 conn(0x7f1a6c15de70 msgr2=0x7f1a6c0ae7e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T04:39:29.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.299+0000 7f1a718a7700 1 --2- 172.21.15.112:0/3662622363 >> v2:172.21.15.179:3300/0 conn(0x7f1a6c15de70 0x7f1a6c0ae7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.299+0000 7f1a718a7700 1 -- 172.21.15.112:0/3662622363 >> v1:172.21.15.179:6789/0 conn(0x7f1a6c0ad120 legacy=0x7f1a6c06dcf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T04:39:29.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.300+0000 7f1a718a7700 1 -- 172.21.15.112:0/3662622363 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6c06b2e0 con 0x7f1a6c06e400 2023-10-06T04:39:29.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.300+0000 7f1a718a7700 1 --2- 172.21.15.112:0/3662622363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a6c06e400 0x7f1a6c15e870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c06eb90 tx=0x7f1a68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437b57e09fa09436 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.300+0000 7f1a63fff700 1 -- 172.21.15.112:0/3662622363 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6800b820 con 0x7f1a6c06e400 2023-10-06T04:39:29.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.300+0000 7f1a63fff700 1 -- 172.21.15.112:0/3662622363 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6800b980 con 0x7f1a6c06e400 2023-10-06T04:39:29.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.300+0000 7f1a63fff700 1 -- 172.21.15.112:0/3662622363 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6800bd20 con 0x7f1a6c06e400 2023-10-06T04:39:29.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.301+0000 7f1a7330a700 1 -- 172.21.15.112:0/3662622363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a6c06e400 msgr2=0x7f1a6c15e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.301+0000 7f1a7330a700 1 --2- 172.21.15.112:0/3662622363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a6c06e400 0x7f1a6c15e870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c06eb90 tx=0x7f1a68009250 comp rx=0 tx=0).stop 2023-10-06T04:39:29.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.302+0000 7f1a7330a700 1 -- 172.21.15.112:0/3662622363 shutdown_connections 2023-10-06T04:39:29.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.302+0000 7f1a7330a700 1 --2- 172.21.15.112:0/3662622363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a6c06e400 0x7f1a6c15e870 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.302+0000 7f1a7330a700 1 --2- 172.21.15.112:0/3662622363 >> v2:172.21.15.179:3300/0 conn(0x7f1a6c15de70 0x7f1a6c0ae7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.302+0000 7f1a7330a700 1 -- 172.21.15.112:0/3662622363 >> 172.21.15.112:0/3662622363 conn(0x7f1a6c06d260 msgr2=0x7f1a6c0cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:29.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.302+0000 7f1a7330a700 1 -- 172.21.15.112:0/3662622363 shutdown_connections 2023-10-06T04:39:29.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.302+0000 7f1a7330a700 1 -- 172.21.15.112:0/3662622363 wait complete. 2023-10-06T04:39:29.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.304+0000 7f1a7330a700 1 Processor -- start 2023-10-06T04:39:29.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.304+0000 7f1a7330a700 1 -- start start 2023-10-06T04:39:29.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.305+0000 7f1a7330a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a6c06e400 0x7f1a6c13d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.305+0000 7f1a7330a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a6c0ad120 0x7f1a6c0a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.305+0000 7f1a7330a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a6c15de70 0x7f1a6c0b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.305+0000 7f1a7330a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c13d6d0 con 0x7f1a6c15de70 2023-10-06T04:39:29.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.305+0000 7f1a7330a700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c13b210 con 0x7f1a6c06e400 2023-10-06T04:39:29.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.305+0000 7f1a7330a700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c0a5740 con 0x7f1a6c0ad120 2023-10-06T04:39:29.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.306+0000 7f1a718a7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a6c15de70 0x7f1a6c0b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.306+0000 7f1a718a7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a6c15de70 0x7f1a6c0b1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58180/0 (socket says 172.21.15.112:58180) 2023-10-06T04:39:29.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.306+0000 7f1a718a7700 1 -- 172.21.15.112:0/873022930 learned_addr learned my addr 172.21.15.112:0/873022930 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:29.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.306+0000 7f1a718a7700 1 -- 172.21.15.112:0/873022930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a6c0ad120 msgr2=0x7f1a6c0a5ab0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:39:29.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.306+0000 7f1a718a7700 1 --2- 172.21.15.112:0/873022930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a6c0ad120 0x7f1a6c0a5ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.306+0000 7f1a718a7700 1 -- 172.21.15.112:0/873022930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a6c06e400 msgr2=0x7f1a6c13d190 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:39:29.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.306+0000 7f1a718a7700 1 --2- 172.21.15.112:0/873022930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a6c06e400 0x7f1a6c13d190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.306+0000 7f1a718a7700 1 -- 172.21.15.112:0/873022930 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a680094f0 con 0x7f1a6c15de70 2023-10-06T04:39:29.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.307+0000 7f1a718a7700 1 --2- 172.21.15.112:0/873022930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a6c15de70 0x7f1a6c0b1840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c065a60 tx=0x7f1a68016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.307+0000 7f1a617fa700 1 -- 172.21.15.112:0/873022930 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6801b450 con 0x7f1a6c15de70 2023-10-06T04:39:29.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.307+0000 7f1a617fa700 1 -- 172.21.15.112:0/873022930 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a68020070 con 0x7f1a6c15de70 2023-10-06T04:39:29.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.307+0000 7f1a617fa700 1 -- 172.21.15.112:0/873022930 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6801b800 con 0x7f1a6c15de70 2023-10-06T04:39:29.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.307+0000 7f1a7330a700 1 -- 172.21.15.112:0/873022930 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a6c13a600 con 0x7f1a6c15de70 2023-10-06T04:39:29.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.307+0000 7f1a7330a700 1 -- 172.21.15.112:0/873022930 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a6c13abc0 con 0x7f1a6c15de70 2023-10-06T04:39:29.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.311+0000 7f1a617fa700 1 -- 172.21.15.112:0/873022930 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a68022030 con 0x7f1a6c15de70 2023-10-06T04:39:29.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.311+0000 7f1a617fa700 1 --2- 172.21.15.112:0/873022930 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1a58067230 0x7f1a580696e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.312+0000 7f1a617fa700 1 -- 172.21.15.112:0/873022930 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1a68086780 con 0x7f1a6c15de70 2023-10-06T04:39:29.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.312+0000 7f1a710a6700 1 --2- 172.21.15.112:0/873022930 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1a58067230 0x7f1a580696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.313+0000 7f1a710a6700 1 --2- 172.21.15.112:0/873022930 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1a58067230 0x7f1a580696e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0abb80 tx=0x7f1a64009370 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.314+0000 7f1a7330a700 1 -- 172.21.15.112:0/873022930 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a4c0052b0 con 0x7f1a6c15de70 2023-10-06T04:39:29.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.322+0000 7f1a617fa700 1 -- 172.21.15.112:0/873022930 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a68053870 con 0x7f1a6c15de70 2023-10-06T04:39:29.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.358+0000 7f334a0fb700 1 Processor -- start 2023-10-06T04:39:29.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.358+0000 7f334a0fb700 1 -- start start 2023-10-06T04:39:29.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.358+0000 7f40ce65d700 1 Processor -- start 2023-10-06T04:39:29.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.358+0000 7f40ce65d700 1 -- start start 2023-10-06T04:39:29.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.359+0000 7f334a0fb700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f334406cee0 0x7f33440acee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.359+0000 7f334a0fb700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33440b07e0 con 0x7f33441596f0 2023-10-06T04:39:29.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.359+0000 7f334a0fb700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f334406ac20 con 0x7f3344159ac0 2023-10-06T04:39:29.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.359+0000 7f334a0fb700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33440cd320 con 0x7f334406cee0 2023-10-06T04:39:29.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.359+0000 7ff0e1266700 1 Processor -- start 2023-10-06T04:39:29.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.359+0000 7ff0e1266700 1 -- start start 2023-10-06T04:39:29.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.359+0000 7f40ce65d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f40c815cd20 0x7f40c80ad870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.359+0000 7f40ce65d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c80cf2c0 con 0x7f40c80d0350 2023-10-06T04:39:29.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.359+0000 7f40ce65d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c80cbd70 con 0x7f40c80d1410 2023-10-06T04:39:29.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.359+0000 7f40ce65d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c80cecb0 con 0x7f40c815cd20 2023-10-06T04:39:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f40c77fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f40c80d1410 0x7f40c80cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.112:56180/0 (socket says 172.21.15.112:56180) 2023-10-06T04:39:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f40c77fe700 1 -- 172.21.15.112:0/3076848492 learned_addr learned my addr 172.21.15.112:0/3076848492 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f40c6ffd700 1 -- 172.21.15.112:0/3076848492 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849565747 0 0) 0x7f40c80cbd70 con 0x7f40c80d1410 2023-10-06T04:39:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f40c6ffd700 1 -- 172.21.15.112:0/3076848492 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40b0003570 con 0x7f40c80d1410 2023-10-06T04:39:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.359+0000 7f3342ffd700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f3344159ac0 0x7f334406c7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.112:56178/0 (socket says 172.21.15.112:56178) 2023-10-06T04:39:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.359+0000 7f3342ffd700 1 -- 172.21.15.112:0/2153166878 learned_addr learned my addr 172.21.15.112:0/2153166878 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f3343fff700 1 --2- 172.21.15.112:0/2153166878 >> v2:172.21.15.179:3300/0 conn(0x7f334406cee0 0x7f33440acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7f3343fff700 1 -- 172.21.15.112:0/2153166878 >> v1:172.21.15.179:6789/0 conn(0x7f3344159ac0 legacy=0x7f334406c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7f3343fff700 1 -- 172.21.15.112:0/2153166878 >> v1:172.21.15.112:6789/0 conn(0x7f33441596f0 legacy=0x7f3344068290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7f3343fff700 1 -- 172.21.15.112:0/2153166878 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33440b0a10 con 0x7f334406cee0 2023-10-06T04:39:29.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f35d7d67700 1 Processor -- start 2023-10-06T04:39:29.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f35d7d67700 1 -- start start 2023-10-06T04:39:29.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7ff0e1266700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0dc06e400 0x7ff0dc0ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7ff0e1266700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff0dc0ad120 0x7ff0dc15e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7ff0e1266700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0dc06ad20 con 0x7ff0dc15de70 2023-10-06T04:39:29.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7ff0e1266700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0dc06b9a0 con 0x7ff0dc0ad120 2023-10-06T04:39:29.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7ff0e1266700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc06b000 con 0x7ff0dc06e400 2023-10-06T04:39:29.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f40c6ffd700 1 -- 172.21.15.112:0/3076848492 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3559108513 0 0) 0x7f40b0003570 con 0x7f40c80d1410 2023-10-06T04:39:29.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f40c6ffd700 1 -- 172.21.15.112:0/3076848492 >> v2:172.21.15.112:3300/0 conn(0x7f40c815cd20 msgr2=0x7f40c80ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:29.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f40c6ffd700 1 --2- 172.21.15.112:0/3076848492 >> v2:172.21.15.112:3300/0 conn(0x7f40c815cd20 0x7f40c80ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f40c6ffd700 1 -- 172.21.15.112:0/3076848492 >> v1:172.21.15.112:6789/0 conn(0x7f40c80d0350 legacy=0x7f40c815d0f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:39:29.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f40c6ffd700 1 -- 172.21.15.112:0/3076848492 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c80cbfc0 con 0x7f40c80d1410 2023-10-06T04:39:29.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f40c6ffd700 1 -- 172.21.15.112:0/3076848492 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f40bc001470 con 0x7f40c80d1410 2023-10-06T04:39:29.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f40c6ffd700 1 -- 172.21.15.112:0/3076848492 >> v1:172.21.15.179:6789/0 conn(0x7f40c80d1410 legacy=0x7f40c80cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f40c6ffd700 1 --2- 172.21.15.112:0/3076848492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40b0003ae0 0x7f40b0003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f40c6ffd700 1 --2- 172.21.15.112:0/3076848492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40b0004810 0x7f40b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f40c6ffd700 1 --2- 172.21.15.112:0/3076848492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40b0009a50 0x7f40b000be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f40c6ffd700 1 -- 172.21.15.112:0/3076848492 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c80cecb0 con 0x7f40b0009a50 2023-10-06T04:39:29.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f40c6ffd700 1 -- 172.21.15.112:0/3076848492 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b000c3f0 con 0x7f40b0003ae0 2023-10-06T04:39:29.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f40c6ffd700 1 -- 172.21.15.112:0/3076848492 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b000c5b0 con 0x7f40b0004810 2023-10-06T04:39:29.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7f40ccbfa700 1 --2- 172.21.15.112:0/3076848492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40b0009a50 0x7f40b000be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7f40c7fff700 1 --2- 172.21.15.112:0/3076848492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40b0003ae0 0x7f40b0003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7ff0daffd700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7ff0dc15de70 0x7ff0dc06dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.112:56198/0 (socket says 172.21.15.112:56198) 2023-10-06T04:39:29.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7ff0daffd700 1 -- 172.21.15.112:0/1235254647 learned_addr learned my addr 172.21.15.112:0/1235254647 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:29.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7ff0db7fe700 1 --2- 172.21.15.112:0/1235254647 >> v2:172.21.15.112:3300/0 conn(0x7ff0dc0ad120 0x7ff0dc15e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7f40ccbfa700 1 -- 172.21.15.112:0/3076848492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40b0004810 msgr2=0x7f40b0004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T04:39:29.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7f40ccbfa700 1 --2- 172.21.15.112:0/3076848492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40b0004810 0x7f40b0004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7f40ccbfa700 1 -- 172.21.15.112:0/3076848492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40b0003ae0 msgr2=0x7f40b0003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:29.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7f40ccbfa700 1 --2- 172.21.15.112:0/3076848492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40b0003ae0 0x7f40b0003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7f40ccbfa700 1 -- 172.21.15.112:0/3076848492 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c80cbfc0 con 0x7f40b0009a50 2023-10-06T04:39:29.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7f40ccbfa700 1 -- 172.21.15.112:0/3076848492 reap_dead start 2023-10-06T04:39:29.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7f3343fff700 1 --2- 172.21.15.112:0/2153166878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f334406cee0 0x7f33440acee0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f333c009e60 tx=0x7f333c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b7c918d507ef041 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7f40ccbfa700 1 --2- 172.21.15.112:0/3076848492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40b0009a50 0x7f40b000be30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009f90 tx=0x7f40c00095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f644da626bb69f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7ff0db7fe700 1 -- 172.21.15.112:0/1235254647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0dc06e400 msgr2=0x7ff0dc0ae7e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T04:39:29.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7ff0db7fe700 1 --2- 172.21.15.112:0/1235254647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0dc06e400 0x7ff0dc0ae7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7ff0db7fe700 1 -- 172.21.15.112:0/1235254647 >> v1:172.21.15.179:6789/0 conn(0x7ff0dc15de70 legacy=0x7ff0dc06dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7ff0db7fe700 1 -- 172.21.15.112:0/1235254647 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc06b2e0 con 0x7ff0dc0ad120 2023-10-06T04:39:29.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7f35d7d67700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f35d0155950 0x7f35d0069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7f35d7d67700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f35d006a4e0 0x7f35d006c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7f35d7d67700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d00cc860 con 0x7f35d00c96b0 2023-10-06T04:39:29.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7f35d7d67700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d00cc530 con 0x7f35d0155950 2023-10-06T04:39:29.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7f35d7d67700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d00c6f80 con 0x7f35d006a4e0 2023-10-06T04:39:29.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7f40c6ffd700 1 -- 172.21.15.112:0/3076848492 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c000bc80 con 0x7f40b0009a50 2023-10-06T04:39:29.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7f40c6ffd700 1 -- 172.21.15.112:0/3076848492 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c000bde0 con 0x7f40b0009a50 2023-10-06T04:39:29.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7f40c6ffd700 1 -- 172.21.15.112:0/3076848492 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c000c680 con 0x7f40b0009a50 2023-10-06T04:39:29.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7f35d6304700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f35d006a4e0 0x7f35d006c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7f35d5b03700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f35d0155950 0x7f35d0069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7f35d6304700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f35d006a4e0 0x7f35d006c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.112:59778/0 (socket says 172.21.15.112:59778) 2023-10-06T04:39:29.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7f35d5b03700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f35d0155950 0x7f35d0069fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58226/0 (socket says 172.21.15.112:58226) 2023-10-06T04:39:29.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7ff0db7fe700 1 --2- 172.21.15.112:0/1235254647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0dc0ad120 0x7ff0dc15e870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009e60 tx=0x7ff0d4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e19c73da47f646 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7f35d6304700 1 -- 172.21.15.112:0/2633278087 learned_addr learned my addr 172.21.15.112:0/2633278087 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:29.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7ff0d9ffb700 1 -- 172.21.15.112:0/1235254647 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d400e070 con 0x7ff0dc0ad120 2023-10-06T04:39:29.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.359+0000 7f955577b700 1 Processor -- start 2023-10-06T04:39:29.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.359+0000 7f955577b700 1 -- start start 2023-10-06T04:39:29.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f955577b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f955006e8b0 0x7f955006c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f955577b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9550156570 0x7f95500cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f955577b700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9550156aa0 con 0x7f955006ec80 2023-10-06T04:39:29.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f955577b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9550156d80 con 0x7f9550156570 2023-10-06T04:39:29.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.360+0000 7f955577b700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9550157060 con 0x7f955006e8b0 2023-10-06T04:39:29.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7f954e7fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9550156570 0x7f95500cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7f954e7fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9550156570 0x7f95500cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58190/0 (socket says 172.21.15.112:58190) 2023-10-06T04:39:29.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7f954e7fc700 1 -- 172.21.15.112:0/3527650380 learned_addr learned my addr 172.21.15.112:0/3527650380 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:29.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7f954e7fc700 1 -- 172.21.15.112:0/3527650380 >> v2:172.21.15.179:3300/0 conn(0x7f955006e8b0 msgr2=0x7f955006c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T04:39:29.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7f954e7fc700 1 --2- 172.21.15.112:0/3527650380 >> v2:172.21.15.179:3300/0 conn(0x7f955006e8b0 0x7f955006c7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7f954e7fc700 1 -- 172.21.15.112:0/3527650380 >> v1:172.21.15.179:6789/0 conn(0x7f955006ec80 legacy=0x7f955013f390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T04:39:29.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7f954e7fc700 1 -- 172.21.15.112:0/3527650380 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9550157340 con 0x7f9550156570 2023-10-06T04:39:29.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.361+0000 7f954e7fc700 1 --2- 172.21.15.112:0/3527650380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9550156570 0x7f95500cc360 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f95500af480 tx=0x7f9544009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16cea10f5425d607 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7f35d5b03700 1 -- 172.21.15.112:0/2633278087 >> v2:172.21.15.179:3300/0 conn(0x7f35d006a4e0 msgr2=0x7f35d006c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:29.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7f35d5b03700 1 --2- 172.21.15.112:0/2633278087 >> v2:172.21.15.179:3300/0 conn(0x7f35d006a4e0 0x7f35d006c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7f35d5b03700 1 -- 172.21.15.112:0/2633278087 >> v1:172.21.15.179:6789/0 conn(0x7f35d00c96b0 legacy=0x7f35d00cccf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T04:39:29.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7f35d5b03700 1 -- 172.21.15.112:0/2633278087 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d00c7260 con 0x7f35d0155950 2023-10-06T04:39:29.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7ff0d9ffb700 1 -- 172.21.15.112:0/1235254647 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d400bc30 con 0x7ff0dc0ad120 2023-10-06T04:39:29.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7ff0d9ffb700 1 -- 172.21.15.112:0/1235254647 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4012430 con 0x7ff0dc0ad120 2023-10-06T04:39:29.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.362+0000 7f35d5b03700 1 --2- 172.21.15.112:0/2633278087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35d0155950 0x7f35d0069fa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00ec00 tx=0x7f35cc005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40bb78eca51342dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.363+0000 7f35d4b01700 1 -- 172.21.15.112:0/2633278087 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc013070 con 0x7f35d0155950 2023-10-06T04:39:29.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.363+0000 7f35d4b01700 1 -- 172.21.15.112:0/2633278087 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc007cb0 con 0x7f35d0155950 2023-10-06T04:39:29.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.363+0000 7f35d4b01700 1 -- 172.21.15.112:0/2633278087 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc00e300 con 0x7f35d0155950 2023-10-06T04:39:29.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.363+0000 7f40ce65d700 1 -- 172.21.15.112:0/3076848492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40b0009a50 msgr2=0x7f40b000be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.363+0000 7f40ce65d700 1 --2- 172.21.15.112:0/3076848492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40b0009a50 0x7f40b000be30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009f90 tx=0x7f40c00095f0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.363+0000 7f40ce65d700 1 -- 172.21.15.112:0/3076848492 shutdown_connections 2023-10-06T04:39:29.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.363+0000 7f40ce65d700 1 --2- 172.21.15.112:0/3076848492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40b0009a50 0x7f40b000be30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.363+0000 7f40ce65d700 1 -- 172.21.15.112:0/3076848492 >> 172.21.15.112:0/3076848492 conn(0x7f40c806cfb0 msgr2=0x7f40c80d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:29.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.363+0000 7f40ce65d700 1 -- 172.21.15.112:0/3076848492 shutdown_connections 2023-10-06T04:39:29.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.363+0000 7f40ce65d700 1 -- 172.21.15.112:0/3076848492 wait complete. 2023-10-06T04:39:29.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.363+0000 7ff0e1266700 1 -- 172.21.15.112:0/1235254647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0dc0ad120 msgr2=0x7ff0dc15e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.363+0000 7ff0e1266700 1 --2- 172.21.15.112:0/1235254647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0dc0ad120 0x7ff0dc15e870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009e60 tx=0x7ff0d4009780 comp rx=0 tx=0).stop 2023-10-06T04:39:29.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.363+0000 7ff0e1266700 1 -- 172.21.15.112:0/1235254647 shutdown_connections 2023-10-06T04:39:29.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.363+0000 7ff0e1266700 1 --2- 172.21.15.112:0/1235254647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0dc0ad120 0x7ff0dc15e870 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.363+0000 7ff0e1266700 1 --2- 172.21.15.112:0/1235254647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0dc06e400 0x7ff0dc0ae7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.363+0000 7ff0e1266700 1 -- 172.21.15.112:0/1235254647 >> 172.21.15.112:0/1235254647 conn(0x7ff0dc06d260 msgr2=0x7ff0dc0cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:29.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.363+0000 7f35d7d67700 1 -- 172.21.15.112:0/2633278087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35d0155950 msgr2=0x7f35d0069fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.363+0000 7f35d7d67700 1 --2- 172.21.15.112:0/2633278087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35d0155950 0x7f35d0069fa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00ec00 tx=0x7f35cc005f40 comp rx=0 tx=0).stop 2023-10-06T04:39:29.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.364+0000 7f35d7d67700 1 -- 172.21.15.112:0/2633278087 shutdown_connections 2023-10-06T04:39:29.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.364+0000 7f35d7d67700 1 --2- 172.21.15.112:0/2633278087 >> v2:172.21.15.179:3300/0 conn(0x7f35d006a4e0 0x7f35d006c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.364+0000 7f35d7d67700 1 --2- 172.21.15.112:0/2633278087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35d0155950 0x7f35d0069fa0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.364+0000 7f35d7d67700 1 -- 172.21.15.112:0/2633278087 >> 172.21.15.112:0/2633278087 conn(0x7f35d00631f0 msgr2=0x7f35d00635f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:29.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.365+0000 7f40ce65d700 1 Processor -- start 2023-10-06T04:39:29.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.365+0000 7f40ce65d700 1 -- start start 2023-10-06T04:39:29.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.365+0000 7f954dffb700 1 -- 172.21.15.112:0/3527650380 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954400b820 con 0x7f9550156570 2023-10-06T04:39:29.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.365+0000 7f33427fc700 1 -- 172.21.15.112:0/2153166878 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c014bb0 con 0x7f334406cee0 2023-10-06T04:39:29.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.365+0000 7f33427fc700 1 -- 172.21.15.112:0/2153166878 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333c014d30 con 0x7f334406cee0 2023-10-06T04:39:29.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.365+0000 7f33427fc700 1 -- 172.21.15.112:0/2153166878 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c014ea0 con 0x7f334406cee0 2023-10-06T04:39:29.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.365+0000 7f954dffb700 1 -- 172.21.15.112:0/3527650380 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954400b980 con 0x7f9550156570 2023-10-06T04:39:29.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.365+0000 7f954dffb700 1 -- 172.21.15.112:0/3527650380 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954400bd20 con 0x7f9550156570 2023-10-06T04:39:29.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.366+0000 7f334a0fb700 1 -- 172.21.15.112:0/2153166878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f334406cee0 msgr2=0x7f33440acee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.366+0000 7f334a0fb700 1 --2- 172.21.15.112:0/2153166878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f334406cee0 0x7f33440acee0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f333c009e60 tx=0x7f333c009780 comp rx=0 tx=0).stop 2023-10-06T04:39:29.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.366+0000 7f334a0fb700 1 -- 172.21.15.112:0/2153166878 shutdown_connections 2023-10-06T04:39:29.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.366+0000 7f334a0fb700 1 --2- 172.21.15.112:0/2153166878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f334406cee0 0x7f33440acee0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.366+0000 7f334a0fb700 1 -- 172.21.15.112:0/2153166878 >> 172.21.15.112:0/2153166878 conn(0x7f334406e350 msgr2=0x7f3344067b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:29.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.366+0000 7f40ce65d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40b0009a50 0x7f40c80ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.366+0000 7f40ce65d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40c80b30e0 0x7f40c81573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.366+0000 7f40ce65d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40c80b24c0 0x7f40c80b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.366+0000 7f40ce65d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c80b2e70 con 0x7f40c80b30e0 2023-10-06T04:39:29.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.366+0000 7f40ce65d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c80b4e40 con 0x7f40b0009a50 2023-10-06T04:39:29.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.366+0000 7f40ce65d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c80b4b10 con 0x7f40c80b24c0 2023-10-06T04:39:29.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.366+0000 7f955577b700 1 -- 172.21.15.112:0/3527650380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9550156570 msgr2=0x7f95500cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.366+0000 7f955577b700 1 --2- 172.21.15.112:0/3527650380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9550156570 0x7f95500cc360 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f95500af480 tx=0x7f9544009250 comp rx=0 tx=0).stop 2023-10-06T04:39:29.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.366+0000 7f40c77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40c80b30e0 0x7f40c81573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.366+0000 7f40c77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40c80b30e0 0x7f40c81573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58236/0 (socket says 172.21.15.112:58236) 2023-10-06T04:39:29.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.366+0000 7f40c7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40b0009a50 0x7f40c80ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.366+0000 7f40c77fe700 1 -- 172.21.15.112:0/2015992385 learned_addr learned my addr 172.21.15.112:0/2015992385 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:29.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.366+0000 7f334a0fb700 1 -- 172.21.15.112:0/2153166878 shutdown_connections 2023-10-06T04:39:29.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.366+0000 7f334a0fb700 1 -- 172.21.15.112:0/2153166878 wait complete. 2023-10-06T04:39:29.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.366+0000 7f40ccbfa700 1 --2- 172.21.15.112:0/2015992385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40c80b24c0 0x7f40c80b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.367+0000 7f40c77fe700 1 -- 172.21.15.112:0/2015992385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40c80b24c0 msgr2=0x7f40c80b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.367+0000 7f40c77fe700 1 --2- 172.21.15.112:0/2015992385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40c80b24c0 0x7f40c80b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.367+0000 7f40c77fe700 1 -- 172.21.15.112:0/2015992385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40b0009a50 msgr2=0x7f40c80ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.367+0000 7f40c77fe700 1 --2- 172.21.15.112:0/2015992385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40b0009a50 0x7f40c80ae1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.367+0000 7f955577b700 1 -- 172.21.15.112:0/3527650380 shutdown_connections 2023-10-06T04:39:29.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.367+0000 7f955577b700 1 --2- 172.21.15.112:0/3527650380 >> v2:172.21.15.179:3300/0 conn(0x7f955006e8b0 0x7f955006c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.367+0000 7f955577b700 1 --2- 172.21.15.112:0/3527650380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9550156570 0x7f95500cc360 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.367+0000 7f955577b700 1 -- 172.21.15.112:0/3527650380 >> 172.21.15.112:0/3527650380 conn(0x7f9550068750 msgr2=0x7f95500ae7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:29.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.367+0000 7f40c77fe700 1 -- 172.21.15.112:0/2015992385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c80ae9e0 con 0x7f40c80b30e0 2023-10-06T04:39:29.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.367+0000 7f40ccbfa700 1 --2- 172.21.15.112:0/2015992385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40c80b24c0 0x7f40c80b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:29.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.367+0000 7f35d7d67700 1 -- 172.21.15.112:0/2633278087 shutdown_connections 2023-10-06T04:39:29.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.367+0000 7f40c77fe700 1 --2- 172.21.15.112:0/2015992385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40c80b30e0 0x7f40c81573c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00cb40 tx=0x7f40bc001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.367+0000 7f35d7d67700 1 -- 172.21.15.112:0/2633278087 wait complete. 2023-10-06T04:39:29.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.367+0000 7ff0e1266700 1 -- 172.21.15.112:0/1235254647 shutdown_connections 2023-10-06T04:39:29.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.367+0000 7f40affff700 1 -- 172.21.15.112:0/2015992385 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc007e90 con 0x7f40c80b30e0 2023-10-06T04:39:29.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.367+0000 7f40affff700 1 -- 172.21.15.112:0/2015992385 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc007360 con 0x7f40c80b30e0 2023-10-06T04:39:29.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.367+0000 7f40affff700 1 -- 172.21.15.112:0/2015992385 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc004830 con 0x7f40c80b30e0 2023-10-06T04:39:29.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.367+0000 7f40ce65d700 1 -- 172.21.15.112:0/2015992385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c80aecc0 con 0x7f40c80b30e0 2023-10-06T04:39:29.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.367+0000 7f40ce65d700 1 -- 172.21.15.112:0/2015992385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c80ae6e0 con 0x7f40c80b30e0 2023-10-06T04:39:29.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.368+0000 7f35d7d67700 1 Processor -- start 2023-10-06T04:39:29.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.368+0000 7f334a0fb700 1 Processor -- start 2023-10-06T04:39:29.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.369+0000 7f40ce65d700 1 -- 172.21.15.112:0/2015992385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c80af1e0 con 0x7f40c80b30e0 2023-10-06T04:39:29.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.367+0000 7ff0e1266700 1 -- 172.21.15.112:0/1235254647 wait complete. 2023-10-06T04:39:29.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.369+0000 7ff0e1266700 1 Processor -- start 2023-10-06T04:39:29.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.369+0000 7ff0e1266700 1 -- start start 2023-10-06T04:39:29.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7ff0e1266700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0dc0ad120 0x7ff0dc0ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7ff0e1266700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0dc15de70 0x7ff0dc0a5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7ff0e1266700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0dc0ab870 0x7ff0dc0a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7ff0e1266700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc15a190 con 0x7ff0dc0ad120 2023-10-06T04:39:29.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7ff0e1266700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0a9660 con 0x7ff0dc0ab870 2023-10-06T04:39:29.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7ff0e1266700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0cac80 con 0x7ff0dc15de70 2023-10-06T04:39:29.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7ff0db7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0dc0ab870 0x7ff0dc0a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.368+0000 7f334a0fb700 1 -- start start 2023-10-06T04:39:29.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7f334a0fb700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f334406cee0 0x7f3344150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7f334a0fb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33441596f0 0x7f334415d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7f334a0fb700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3344159ac0 0x7f334415d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7f334a0fb700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334415bab0 con 0x7f33441596f0 2023-10-06T04:39:29.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7f334a0fb700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334415bd50 con 0x7f334406cee0 2023-10-06T04:39:29.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7f334a0fb700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334415c030 con 0x7f3344159ac0 2023-10-06T04:39:29.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7f33437fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f334406cee0 0x7f3344150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7f33437fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f334406cee0 0x7f3344150ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.112:59794/0 (socket says 172.21.15.112:59794) 2023-10-06T04:39:29.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7f33437fe700 1 -- 172.21.15.112:0/26605800 learned_addr learned my addr 172.21.15.112:0/26605800 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:29.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7f3342ffd700 1 --2- 172.21.15.112:0/26605800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33441596f0 0x7f334415d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7f3343fff700 1 --2- 172.21.15.112:0/26605800 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3344159ac0 0x7f334415d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.368+0000 7f35d7d67700 1 -- start start 2023-10-06T04:39:29.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.369+0000 7f35d7d67700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35d006a4e0 0x7f35d0159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.369+0000 7f35d7d67700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35d0155950 0x7f35d0157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.369+0000 7f35d7d67700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35d014c530 0x7f35d014c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.369+0000 7f35d7d67700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d014cee0 con 0x7f35d014c530 2023-10-06T04:39:29.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.369+0000 7f35d7d67700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0156cf0 con 0x7f35d006a4e0 2023-10-06T04:39:29.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.369+0000 7f35d7d67700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0156f40 con 0x7f35d0155950 2023-10-06T04:39:29.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7f35d6304700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35d014c530 0x7f35d014c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7f35d6304700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35d014c530 0x7f35d014c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58244/0 (socket says 172.21.15.112:58244) 2023-10-06T04:39:29.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7f35d6304700 1 -- 172.21.15.112:0/96845495 learned_addr learned my addr 172.21.15.112:0/96845495 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:29.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7f35d5b03700 1 --2- 172.21.15.112:0/96845495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35d006a4e0 0x7f35d0159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7ff0db7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0dc0ab870 0x7ff0dc0a59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.112:59806/0 (socket says 172.21.15.112:59806) 2023-10-06T04:39:29.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7ff0db7fe700 1 -- 172.21.15.112:0/440807964 learned_addr learned my addr 172.21.15.112:0/440807964 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:29.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7ff0daffd700 1 --2- 172.21.15.112:0/440807964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0dc0ad120 0x7ff0dc0ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7f33437fe700 1 -- 172.21.15.112:0/26605800 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3344159ac0 msgr2=0x7f334415d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7f33437fe700 1 --2- 172.21.15.112:0/26605800 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3344159ac0 0x7f334415d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7f33437fe700 1 -- 172.21.15.112:0/26605800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33441596f0 msgr2=0x7f334415d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7f33437fe700 1 --2- 172.21.15.112:0/26605800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33441596f0 0x7f334415d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7f33437fe700 1 -- 172.21.15.112:0/26605800 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333c009a20 con 0x7f334406cee0 2023-10-06T04:39:29.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7f35d5b03700 1 -- 172.21.15.112:0/96845495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35d0155950 msgr2=0x7f35d0157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7f35d5b03700 1 --2- 172.21.15.112:0/96845495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35d0155950 0x7f35d0157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7f35d5b03700 1 -- 172.21.15.112:0/96845495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35d014c530 msgr2=0x7f35d014c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7f35d5b03700 1 --2- 172.21.15.112:0/96845495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35d014c530 0x7f35d014c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7f35d5b03700 1 -- 172.21.15.112:0/96845495 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc00e7c0 con 0x7f35d006a4e0 2023-10-06T04:39:29.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7f35d5b03700 1 --2- 172.21.15.112:0/96845495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35d006a4e0 0x7f35d0159a70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f35cc018000 tx=0x7f35cc019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.370+0000 7f40affff700 1 -- 172.21.15.112:0/2015992385 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40bc004be0 con 0x7f40c80b30e0 2023-10-06T04:39:29.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7f40affff700 1 --2- 172.21.15.112:0/2015992385 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f40b4066f30 0x7f40b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7f40affff700 1 -- 172.21.15.112:0/2015992385 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f40bc0840e0 con 0x7f40c80b30e0 2023-10-06T04:39:29.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7f35c5ffb700 1 -- 172.21.15.112:0/96845495 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc019a00 con 0x7f35d006a4e0 2023-10-06T04:39:29.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7f40c7fff700 1 --2- 172.21.15.112:0/2015992385 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f40b4066f30 0x7f40b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7ff0da7fc700 1 --2- 172.21.15.112:0/440807964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0dc15de70 0x7ff0dc0a5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7ff0daffd700 1 -- 172.21.15.112:0/440807964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0dc15de70 msgr2=0x7ff0dc0a5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7ff0daffd700 1 --2- 172.21.15.112:0/440807964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0dc15de70 0x7ff0dc0a5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7ff0daffd700 1 -- 172.21.15.112:0/440807964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0dc0ab870 msgr2=0x7ff0dc0a59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7ff0daffd700 1 --2- 172.21.15.112:0/440807964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0dc0ab870 0x7ff0dc0a59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7ff0daffd700 1 -- 172.21.15.112:0/440807964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d4009a20 con 0x7ff0dc0ad120 2023-10-06T04:39:29.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7f35c5ffb700 1 -- 172.21.15.112:0/96845495 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc019b60 con 0x7f35d006a4e0 2023-10-06T04:39:29.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7f35c5ffb700 1 -- 172.21.15.112:0/96845495 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc009400 con 0x7f35d006a4e0 2023-10-06T04:39:29.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7f35d7d67700 1 -- 172.21.15.112:0/96845495 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d0157220 con 0x7f35d006a4e0 2023-10-06T04:39:29.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7f35d7d67700 1 -- 172.21.15.112:0/96845495 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d01577e0 con 0x7f35d006a4e0 2023-10-06T04:39:29.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7f33437fe700 1 --2- 172.21.15.112:0/26605800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f334406cee0 0x7f3344150ed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f333800c810 tx=0x7f3338007ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.371+0000 7ff0daffd700 1 --2- 172.21.15.112:0/440807964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0dc0ad120 0x7ff0dc0ca740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000c7f0 tx=0x7ff0d0007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.372+0000 7f955577b700 1 -- 172.21.15.112:0/3527650380 shutdown_connections 2023-10-06T04:39:29.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.373+0000 7f69aeefd700 1 Processor -- start 2023-10-06T04:39:29.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.373+0000 7f0230997700 1 Processor -- start 2023-10-06T04:39:29.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.372+0000 7f955577b700 1 -- 172.21.15.112:0/3527650380 wait complete. 2023-10-06T04:39:29.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.373+0000 7f955577b700 1 Processor -- start 2023-10-06T04:39:29.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.372+0000 7f332b7fe700 1 -- 172.21.15.112:0/26605800 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338011590 con 0x7f334406cee0 2023-10-06T04:39:29.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.372+0000 7f332b7fe700 1 -- 172.21.15.112:0/26605800 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33380116f0 con 0x7f334406cee0 2023-10-06T04:39:29.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.372+0000 7f334a0fb700 1 -- 172.21.15.112:0/26605800 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f334415c310 con 0x7f334406cee0 2023-10-06T04:39:29.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.372+0000 7f332b7fe700 1 -- 172.21.15.112:0/26605800 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338011ab0 con 0x7f334406cee0 2023-10-06T04:39:29.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.372+0000 7f334a0fb700 1 -- 172.21.15.112:0/26605800 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3344156040 con 0x7f334406cee0 2023-10-06T04:39:29.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.373+0000 7f334a0fb700 1 -- 172.21.15.112:0/26605800 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f334405f230 con 0x7f334406cee0 2023-10-06T04:39:29.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.374+0000 7f40c7fff700 1 --2- 172.21.15.112:0/2015992385 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f40b4066f30 0x7f40b40693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f40c80700a0 tx=0x7f40b8009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.373+0000 7f35d7d67700 1 -- 172.21.15.112:0/96845495 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d00712d0 con 0x7f35d006a4e0 2023-10-06T04:39:29.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.373+0000 7f0230997700 1 -- start start 2023-10-06T04:39:29.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.374+0000 7f955577b700 1 -- start start 2023-10-06T04:39:29.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.373+0000 7f69aeefd700 1 -- start start 2023-10-06T04:39:29.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f69aeefd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f69a8158440 0x7f69a80a9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f69aeefd700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a815eed0 con 0x7f69a80b0ce0 2023-10-06T04:39:29.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f69aeefd700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a815e5a0 con 0x7f69a80a9680 2023-10-06T04:39:29.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f69aeefd700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a80b1100 con 0x7f69a8158440 2023-10-06T04:39:29.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f0230997700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f022c155a70 0x7f022c0aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f0230997700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022c06c900 con 0x7f022c155e40 2023-10-06T04:39:29.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f0230997700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022c15a600 con 0x7f022c06dda0 2023-10-06T04:39:29.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f0230997700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f022c0acfc0 con 0x7f022c155a70 2023-10-06T04:39:29.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f35c5ffb700 1 -- 172.21.15.112:0/96845495 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f35cc0097b0 con 0x7f35d006a4e0 2023-10-06T04:39:29.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f69ae6fc700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f69a80b0ce0 0x7f69a8167910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60222/0 (socket says 172.21.15.112:60222) 2023-10-06T04:39:29.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f69ae6fc700 1 -- 172.21.15.112:0/1668405416 learned_addr learned my addr 172.21.15.112:0/1668405416 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:29.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f69adefb700 1 --2- 172.21.15.112:0/1668405416 >> v2:172.21.15.112:3300/0 conn(0x7f69a8158440 0x7f69a80a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f955577b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f955006e8b0 0x7f955013c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f955577b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f955006ec80 0x7f95500c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f955577b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9550156570 0x7f95500c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f955577b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955015baa0 con 0x7f955006e8b0 2023-10-06T04:39:29.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f955577b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955015b610 con 0x7f955006ec80 2023-10-06T04:39:29.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f955577b700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955015aa00 con 0x7f9550156570 2023-10-06T04:39:29.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f954effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f955006e8b0 0x7f955013c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f954effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f955006e8b0 0x7f955013c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58290/0 (socket says 172.21.15.112:58290) 2023-10-06T04:39:29.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f954effd700 1 -- 172.21.15.112:0/4088953894 learned_addr learned my addr 172.21.15.112:0/4088953894 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:29.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f954f7fe700 1 --2- 172.21.15.112:0/4088953894 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9550156570 0x7f95500c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.374+0000 7f332b7fe700 1 -- 172.21.15.112:0/26605800 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f333801b3b0 con 0x7f334406cee0 2023-10-06T04:39:29.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.374+0000 7f332b7fe700 1 --2- 172.21.15.112:0/26605800 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f332c0671b0 0x7f332c069660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f332b7fe700 1 -- 172.21.15.112:0/26605800 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3338083b90 con 0x7f334406cee0 2023-10-06T04:39:29.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f35c5ffb700 1 --2- 172.21.15.112:0/96845495 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f35b4066f30 0x7f35b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f35c5ffb700 1 -- 172.21.15.112:0/96845495 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f35cc085780 con 0x7f35d006a4e0 2023-10-06T04:39:29.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f954effd700 1 -- 172.21.15.112:0/4088953894 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9550156570 msgr2=0x7f95500c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f954effd700 1 --2- 172.21.15.112:0/4088953894 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9550156570 0x7f95500c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f954effd700 1 -- 172.21.15.112:0/4088953894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f955006ec80 msgr2=0x7f95500c7850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:39:29.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f954effd700 1 --2- 172.21.15.112:0/4088953894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f955006ec80 0x7f95500c7850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f954effd700 1 -- 172.21.15.112:0/4088953894 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95440094f0 con 0x7f955006e8b0 2023-10-06T04:39:29.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f954f7fe700 1 --2- 172.21.15.112:0/4088953894 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9550156570 0x7f95500c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:29.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.376+0000 7f022affd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f022c155e40 0x7f022c1597e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60234/0 (socket says 172.21.15.112:60234) 2023-10-06T04:39:29.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.376+0000 7f022affd700 1 -- 172.21.15.112:0/8323625 learned_addr learned my addr 172.21.15.112:0/8323625 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:29.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.376+0000 7f3342ffd700 1 --2- 172.21.15.112:0/26605800 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f332c0671b0 0x7f332c069660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.376+0000 7f35d5302700 1 --2- 172.21.15.112:0/96845495 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f35b4066f30 0x7f35b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f69adefb700 1 -- 172.21.15.112:0/1668405416 >> v1:172.21.15.179:6789/0 conn(0x7f69a80a9680 legacy=0x7f69a80b05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f69adefb700 1 -- 172.21.15.112:0/1668405416 >> v1:172.21.15.112:6789/0 conn(0x7f69a80b0ce0 legacy=0x7f69a8167910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.375+0000 7f69adefb700 1 -- 172.21.15.112:0/1668405416 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a815e880 con 0x7f69a8158440 2023-10-06T04:39:29.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.376+0000 7f69adefb700 1 --2- 172.21.15.112:0/1668405416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69a8158440 0x7f69a80a9140 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009eb0 tx=0x7f69a0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd78d0b797bd4cbb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.376+0000 7f954effd700 1 --2- 172.21.15.112:0/4088953894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f955006e8b0 0x7f955013c0f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f954000b600 tx=0x7f95400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.376+0000 7f35d5302700 1 --2- 172.21.15.112:0/96845495 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f35b4066f30 0x7f35b40693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f35d0155180 tx=0x7f35c0006cc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.376+0000 7f3342ffd700 1 --2- 172.21.15.112:0/26605800 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f332c0671b0 0x7f332c069660 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f33440ce4e0 tx=0x7f3334000bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.376+0000 7f022b7fe700 1 --2- 172.21.15.112:0/8323625 >> v2:172.21.15.112:3300/0 conn(0x7f022c155a70 0x7f022c0aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.376+0000 7f69acef9700 1 -- 172.21.15.112:0/1668405416 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a000e070 con 0x7f69a8158440 2023-10-06T04:39:29.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.376+0000 7f022b7fe700 1 -- 172.21.15.112:0/8323625 >> v1:172.21.15.179:6789/0 conn(0x7f022c06dda0 legacy=0x7f022c159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.376+0000 7f022b7fe700 1 -- 172.21.15.112:0/8323625 >> v1:172.21.15.112:6789/0 conn(0x7f022c155e40 legacy=0x7f022c1597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.376+0000 7f022b7fe700 1 -- 172.21.15.112:0/8323625 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c06b320 con 0x7f022c155a70 2023-10-06T04:39:29.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.376+0000 7ff0c2ffd700 1 -- 172.21.15.112:0/440807964 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0005b30 con 0x7ff0dc0ad120 2023-10-06T04:39:29.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.377+0000 7ff0e1266700 1 -- 172.21.15.112:0/440807964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0dc0caf20 con 0x7ff0dc0ad120 2023-10-06T04:39:29.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.376+0000 7f40affff700 1 -- 172.21.15.112:0/2015992385 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40bc051350 con 0x7f40c80b30e0 2023-10-06T04:39:29.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.377+0000 7f9536ffd700 1 -- 172.21.15.112:0/4088953894 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954000f510 con 0x7f955006e8b0 2023-10-06T04:39:29.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.377+0000 7ff0e1266700 1 -- 172.21.15.112:0/440807964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0dc0cb4e0 con 0x7ff0dc0ad120 2023-10-06T04:39:29.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.377+0000 7f9536ffd700 1 -- 172.21.15.112:0/4088953894 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954000f690 con 0x7f955006e8b0 2023-10-06T04:39:29.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.377+0000 7f9536ffd700 1 -- 172.21.15.112:0/4088953894 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954000fa50 con 0x7f955006e8b0 2023-10-06T04:39:29.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.377+0000 7f69acef9700 1 -- 172.21.15.112:0/1668405416 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a000bc30 con 0x7f69a8158440 2023-10-06T04:39:29.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.377+0000 7f69acef9700 1 -- 172.21.15.112:0/1668405416 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a0012430 con 0x7f69a8158440 2023-10-06T04:39:29.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.377+0000 7ff0c2ffd700 1 -- 172.21.15.112:0/440807964 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d0004830 con 0x7ff0dc0ad120 2023-10-06T04:39:29.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.377+0000 7ff0c2ffd700 1 -- 172.21.15.112:0/440807964 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0005ea0 con 0x7ff0dc0ad120 2023-10-06T04:39:29.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.377+0000 7f955577b700 1 -- 172.21.15.112:0/4088953894 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f955015ace0 con 0x7f955006e8b0 2023-10-06T04:39:29.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.377+0000 7f955577b700 1 -- 172.21.15.112:0/4088953894 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f955015b2a0 con 0x7f955006e8b0 2023-10-06T04:39:29.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.378+0000 7f69aeefd700 1 -- 172.21.15.112:0/1668405416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69a8158440 msgr2=0x7f69a80a9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.378+0000 7f69aeefd700 1 --2- 172.21.15.112:0/1668405416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69a8158440 0x7f69a80a9140 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009eb0 tx=0x7f69a0009780 comp rx=0 tx=0).stop 2023-10-06T04:39:29.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.378+0000 7f69aeefd700 1 -- 172.21.15.112:0/1668405416 shutdown_connections 2023-10-06T04:39:29.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.378+0000 7f69aeefd700 1 --2- 172.21.15.112:0/1668405416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69a8158440 0x7f69a80a9140 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.378+0000 7f69aeefd700 1 -- 172.21.15.112:0/1668405416 >> 172.21.15.112:0/1668405416 conn(0x7f69a806d220 msgr2=0x7f69a80cc280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:29.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.378+0000 7f022b7fe700 1 --2- 172.21.15.112:0/8323625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f022c155a70 0x7f022c0aeb30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f022400d0d0 tx=0x7f022400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637c390ed31c97fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.378+0000 7f69aeefd700 1 -- 172.21.15.112:0/1668405416 shutdown_connections 2023-10-06T04:39:29.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.378+0000 7f69aeefd700 1 -- 172.21.15.112:0/1668405416 wait complete. 2023-10-06T04:39:29.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.379+0000 7ff0c2ffd700 1 -- 172.21.15.112:0/440807964 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0d00049a0 con 0x7ff0dc0ad120 2023-10-06T04:39:29.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.379+0000 7f022a7fc700 1 -- 172.21.15.112:0/8323625 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224010070 con 0x7f022c155a70 2023-10-06T04:39:29.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.379+0000 7f35c5ffb700 1 -- 172.21.15.112:0/96845495 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35cc052810 con 0x7f35d006a4e0 2023-10-06T04:39:29.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.379+0000 7ff0c2ffd700 1 --2- 172.21.15.112:0/440807964 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff0c8066f30 0x7ff0c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.379+0000 7ff0c2ffd700 1 -- 172.21.15.112:0/440807964 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff0d0083820 con 0x7ff0dc0ad120 2023-10-06T04:39:29.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.380+0000 7ff0e1266700 1 -- 172.21.15.112:0/440807964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0bc0052b0 con 0x7ff0dc0ad120 2023-10-06T04:39:29.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.380+0000 7ff0da7fc700 1 --2- 172.21.15.112:0/440807964 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff0c8066f30 0x7ff0c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.380+0000 7f69aeefd700 1 Processor -- start 2023-10-06T04:39:29.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.380+0000 7ff0da7fc700 1 --2- 172.21.15.112:0/440807964 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff0c8066f30 0x7ff0c80693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc006fd0 tx=0x7ff0cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.378+0000 7f955577b700 1 -- 172.21.15.112:0/4088953894 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f955005f230 con 0x7f955006e8b0 2023-10-06T04:39:29.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.380+0000 7f9536ffd700 1 -- 172.21.15.112:0/4088953894 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9540024430 con 0x7f955006e8b0 2023-10-06T04:39:29.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.380+0000 7f9536ffd700 1 --2- 172.21.15.112:0/4088953894 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f953c066f30 0x7f953c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.380+0000 7f9536ffd700 1 -- 172.21.15.112:0/4088953894 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9540084a50 con 0x7f955006e8b0 2023-10-06T04:39:29.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.380+0000 7f954e7fc700 1 --2- 172.21.15.112:0/4088953894 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f953c066f30 0x7f953c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.381+0000 7f954e7fc700 1 --2- 172.21.15.112:0/4088953894 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f953c066f30 0x7f953c0693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f95500af480 tx=0x7f9544016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.380+0000 7f69aeefd700 1 -- start start 2023-10-06T04:39:29.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.381+0000 7f69aeefd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69a80a9680 0x7f69a816eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.381+0000 7f69aeefd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69a80b0ce0 0x7f69a80ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.381+0000 7f69aeefd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69a8158440 0x7f69a815a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.381+0000 7f69aeefd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a8158950 con 0x7f69a80a9680 2023-10-06T04:39:29.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.381+0000 7f69aeefd700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a81597b0 con 0x7f69a8158440 2023-10-06T04:39:29.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.381+0000 7f69aeefd700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a816efe0 con 0x7f69a80b0ce0 2023-10-06T04:39:29.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.381+0000 7f69adefb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69a80a9680 0x7f69a816eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.381+0000 7f69adefb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69a80a9680 0x7f69a816eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58302/0 (socket says 172.21.15.112:58302) 2023-10-06T04:39:29.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.381+0000 7f69adefb700 1 -- 172.21.15.112:0/2229407104 learned_addr learned my addr 172.21.15.112:0/2229407104 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:29.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.381+0000 7f69ae6fc700 1 --2- 172.21.15.112:0/2229407104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69a8158440 0x7f69a815a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.381+0000 7f69ad6fa700 1 --2- 172.21.15.112:0/2229407104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69a80b0ce0 0x7f69a80ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.382+0000 7f69adefb700 1 -- 172.21.15.112:0/2229407104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69a80b0ce0 msgr2=0x7f69a80ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.382+0000 7f69adefb700 1 --2- 172.21.15.112:0/2229407104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69a80b0ce0 0x7f69a80ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.382+0000 7f69adefb700 1 -- 172.21.15.112:0/2229407104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69a8158440 msgr2=0x7f69a815a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.382+0000 7f69adefb700 1 --2- 172.21.15.112:0/2229407104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69a8158440 0x7f69a815a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.382+0000 7f69adefb700 1 -- 172.21.15.112:0/2229407104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a0009a20 con 0x7f69a80a9680 2023-10-06T04:39:29.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.382+0000 7f69ae6fc700 1 --2- 172.21.15.112:0/2229407104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69a8158440 0x7f69a815a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:29.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.382+0000 7f69adefb700 1 --2- 172.21.15.112:0/2229407104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69a80a9680 0x7f69a816eaa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f69a80b25c0 tx=0x7f69a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.383+0000 7f332b7fe700 1 -- 172.21.15.112:0/26605800 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3338050ca0 con 0x7f334406cee0 2023-10-06T04:39:29.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.384+0000 7f022a7fc700 1 -- 172.21.15.112:0/8323625 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022400dbe0 con 0x7f022c155a70 2023-10-06T04:39:29.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.384+0000 7f699dffb700 1 -- 172.21.15.112:0/2229407104 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a0012d30 con 0x7f69a80a9680 2023-10-06T04:39:29.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.384+0000 7f022a7fc700 1 -- 172.21.15.112:0/8323625 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224016400 con 0x7f022c155a70 2023-10-06T04:39:29.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.388+0000 7f9536ffd700 1 -- 172.21.15.112:0/4088953894 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9540051cc0 con 0x7f955006e8b0 2023-10-06T04:39:29.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.389+0000 7f69aeefd700 1 -- 172.21.15.112:0/2229407104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a8158ba0 con 0x7f69a80a9680 2023-10-06T04:39:29.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.389+0000 7ff0c2ffd700 1 -- 172.21.15.112:0/440807964 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0d004b5a0 con 0x7ff0dc0ad120 2023-10-06T04:39:29.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.389+0000 7f699dffb700 1 -- 172.21.15.112:0/2229407104 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a0027470 con 0x7f69a80a9680 2023-10-06T04:39:29.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.389+0000 7f699dffb700 1 -- 172.21.15.112:0/2229407104 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a0027830 con 0x7f69a80a9680 2023-10-06T04:39:29.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.389+0000 7f69aeefd700 1 -- 172.21.15.112:0/2229407104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a8159160 con 0x7f69a80a9680 2023-10-06T04:39:29.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.391+0000 7f0230997700 1 -- 172.21.15.112:0/8323625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f022c155a70 msgr2=0x7f022c0aeb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.391+0000 7f0230997700 1 --2- 172.21.15.112:0/8323625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f022c155a70 0x7f022c0aeb30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f022400d0d0 tx=0x7f022400b990 comp rx=0 tx=0).stop 2023-10-06T04:39:29.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.392+0000 7f0230997700 1 -- 172.21.15.112:0/8323625 shutdown_connections 2023-10-06T04:39:29.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.392+0000 7f0230997700 1 --2- 172.21.15.112:0/8323625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f022c155a70 0x7f022c0aeb30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.392+0000 7f0230997700 1 -- 172.21.15.112:0/8323625 >> 172.21.15.112:0/8323625 conn(0x7f022c06f300 msgr2=0x7f022c0ccb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:29.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.392+0000 7f0230997700 1 -- 172.21.15.112:0/8323625 shutdown_connections 2023-10-06T04:39:29.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.393+0000 7f699dffb700 1 -- 172.21.15.112:0/2229407104 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69a0024070 con 0x7f69a80a9680 2023-10-06T04:39:29.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.394+0000 7f699dffb700 1 --2- 172.21.15.112:0/2229407104 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f698c066fb0 0x7f698c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.394+0000 7f699dffb700 1 -- 172.21.15.112:0/2229407104 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f69a0086d90 con 0x7f69a80a9680 2023-10-06T04:39:29.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.392+0000 7f0230997700 1 -- 172.21.15.112:0/8323625 wait complete. 2023-10-06T04:39:29.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.394+0000 7f0230997700 1 Processor -- start 2023-10-06T04:39:29.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.395+0000 7f0230997700 1 -- start start 2023-10-06T04:39:29.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.396+0000 7f0230997700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f022c06dda0 0x7f022c16d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.396+0000 7f0230997700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f022c155a70 0x7f022c1504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.396+0000 7f0230997700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f022c155e40 0x7f022c158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.396+0000 7f0230997700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c150ce0 con 0x7f022c155e40 2023-10-06T04:39:29.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.396+0000 7f0230997700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c14fa30 con 0x7f022c06dda0 2023-10-06T04:39:29.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.396+0000 7f0230997700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022c16d910 con 0x7f022c155a70 2023-10-06T04:39:29.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.396+0000 7f022bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f022c155e40 0x7f022c158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.396+0000 7f022bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f022c155e40 0x7f022c158280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58310/0 (socket says 172.21.15.112:58310) 2023-10-06T04:39:29.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.396+0000 7f022bfff700 1 -- 172.21.15.112:0/1753041807 learned_addr learned my addr 172.21.15.112:0/1753041807 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:29.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.396+0000 7f022affd700 1 --2- 172.21.15.112:0/1753041807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f022c155a70 0x7f022c1504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.397+0000 7f022bfff700 1 -- 172.21.15.112:0/1753041807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f022c155a70 msgr2=0x7f022c1504d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.397+0000 7f022bfff700 1 --2- 172.21.15.112:0/1753041807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f022c155a70 0x7f022c1504d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.397+0000 7f022bfff700 1 -- 172.21.15.112:0/1753041807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f022c06dda0 msgr2=0x7f022c16d3d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:39:29.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.397+0000 7f022bfff700 1 --2- 172.21.15.112:0/1753041807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f022c06dda0 0x7f022c16d3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.397+0000 7f022bfff700 1 -- 172.21.15.112:0/1753041807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022400bc30 con 0x7f022c155e40 2023-10-06T04:39:29.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.397+0000 7f022bfff700 1 --2- 172.21.15.112:0/1753041807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f022c155e40 0x7f022c158280 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f021c00c560 tx=0x7f021c007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.397+0000 7f02137fe700 1 -- 172.21.15.112:0/1753041807 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c011590 con 0x7f022c155e40 2023-10-06T04:39:29.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.397+0000 7f02137fe700 1 -- 172.21.15.112:0/1753041807 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021c0116f0 con 0x7f022c155e40 2023-10-06T04:39:29.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.397+0000 7f02137fe700 1 -- 172.21.15.112:0/1753041807 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c011ab0 con 0x7f022c155e40 2023-10-06T04:39:29.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.397+0000 7f0230997700 1 -- 172.21.15.112:0/1753041807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022c150f30 con 0x7f022c155e40 2023-10-06T04:39:29.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.397+0000 7f0230997700 1 -- 172.21.15.112:0/1753041807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022c14fcd0 con 0x7f022c155e40 2023-10-06T04:39:29.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.399+0000 7f0230997700 1 -- 172.21.15.112:0/1753041807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022c05f230 con 0x7f022c155e40 2023-10-06T04:39:29.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.401+0000 7f02137fe700 1 -- 172.21.15.112:0/1753041807 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f021c01b3b0 con 0x7f022c155e40 2023-10-06T04:39:29.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.401+0000 7f02137fe700 1 --2- 172.21.15.112:0/1753041807 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0214067080 0x7f0214069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.401+0000 7f02137fe700 1 -- 172.21.15.112:0/1753041807 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f021c083f80 con 0x7f022c155e40 2023-10-06T04:39:29.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.406+0000 7f69ad6fa700 1 --2- 172.21.15.112:0/2229407104 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f698c066fb0 0x7f698c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.406+0000 7f69aeefd700 1 -- 172.21.15.112:0/2229407104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a805f230 con 0x7f69a80a9680 2023-10-06T04:39:29.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.406+0000 7f69ad6fa700 1 --2- 172.21.15.112:0/2229407104 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f698c066fb0 0x7f698c069460 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f69a80c8ae0 tx=0x7f6998009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.407+0000 7f022b7fe700 1 --2- 172.21.15.112:0/1753041807 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0214067080 0x7f0214069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.408+0000 7f022b7fe700 1 --2- 172.21.15.112:0/1753041807 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0214067080 0x7f0214069530 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f022c0cc2b0 tx=0x7f022401c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.408+0000 7f02137fe700 1 -- 172.21.15.112:0/1753041807 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f021c051070 con 0x7f022c155e40 2023-10-06T04:39:29.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.416+0000 7f699dffb700 1 -- 172.21.15.112:0/2229407104 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69a002c080 con 0x7f69a80a9680 2023-10-06T04:39:29.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.706+0000 7f1a7330a700 1 -- 172.21.15.112:0/873022930 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1a4c005560 con 0x7f1a6c15de70 2023-10-06T04:39:29.716 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2023-10-06T04:39:29.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.712+0000 7f1a617fa700 1 -- 172.21.15.112:0/873022930 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a68056e90 con 0x7f1a6c15de70 2023-10-06T04:39:29.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.721+0000 7f1a7330a700 1 -- 172.21.15.112:0/873022930 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1a58067230 msgr2=0x7f1a580696e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.721+0000 7f1a7330a700 1 --2- 172.21.15.112:0/873022930 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1a58067230 0x7f1a580696e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0abb80 tx=0x7f1a64009370 comp rx=0 tx=0).stop 2023-10-06T04:39:29.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.721+0000 7f1a7330a700 1 -- 172.21.15.112:0/873022930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a6c15de70 msgr2=0x7f1a6c0b1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.721+0000 7f1a7330a700 1 --2- 172.21.15.112:0/873022930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a6c15de70 0x7f1a6c0b1840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c065a60 tx=0x7f1a68016000 comp rx=0 tx=0).stop 2023-10-06T04:39:29.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.721+0000 7f1a7330a700 1 -- 172.21.15.112:0/873022930 shutdown_connections 2023-10-06T04:39:29.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.721+0000 7f1a7330a700 1 --2- 172.21.15.112:0/873022930 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1a58067230 0x7f1a580696e0 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0abb80 tx=0x7f1a64009370 comp rx=0 tx=0).stop 2023-10-06T04:39:29.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.721+0000 7f1a7330a700 1 --2- 172.21.15.112:0/873022930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a6c15de70 0x7f1a6c0b1840 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.721+0000 7f1a7330a700 1 --2- 172.21.15.112:0/873022930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a6c06e400 0x7f1a6c13d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.721+0000 7f1a7330a700 1 --2- 172.21.15.112:0/873022930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a6c0ad120 0x7f1a6c0a5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.721+0000 7f1a7330a700 1 -- 172.21.15.112:0/873022930 >> 172.21.15.112:0/873022930 conn(0x7f1a6c06d260 msgr2=0x7f1a6c15f910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:29.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.721+0000 7f1a7330a700 1 -- 172.21.15.112:0/873022930 shutdown_connections 2023-10-06T04:39:29.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.721+0000 7f1a7330a700 1 -- 172.21.15.112:0/873022930 wait complete. 2023-10-06T04:39:29.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-06T04:39:29.740 DEBUG:teuthology.parallel:result is None 2023-10-06T04:39:29.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.755+0000 7f955577b700 1 -- 172.21.15.112:0/4088953894 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f955006f4e0 con 0x7f955006e8b0 2023-10-06T04:39:29.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.755+0000 7f9536ffd700 1 -- 172.21.15.112:0/4088953894 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f95400552e0 con 0x7f955006e8b0 2023-10-06T04:39:29.757 INFO:teuthology.orchestra.run.smithi112.stdout:55834574853 2023-10-06T04:39:29.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.767+0000 7f955577b700 1 -- 172.21.15.112:0/4088953894 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f953c066f30 msgr2=0x7f953c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.767+0000 7f955577b700 1 --2- 172.21.15.112:0/4088953894 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f953c066f30 0x7f953c0693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f95500af480 tx=0x7f9544016000 comp rx=0 tx=0).stop 2023-10-06T04:39:29.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.767+0000 7f955577b700 1 -- 172.21.15.112:0/4088953894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f955006e8b0 msgr2=0x7f955013c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.767+0000 7f955577b700 1 --2- 172.21.15.112:0/4088953894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f955006e8b0 0x7f955013c0f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f954000b600 tx=0x7f95400091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.768+0000 7f955577b700 1 -- 172.21.15.112:0/4088953894 shutdown_connections 2023-10-06T04:39:29.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.768+0000 7f955577b700 1 --2- 172.21.15.112:0/4088953894 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f953c066f30 0x7f953c0693e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.768+0000 7f955577b700 1 --2- 172.21.15.112:0/4088953894 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9550156570 0x7f95500c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.768+0000 7f955577b700 1 --2- 172.21.15.112:0/4088953894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f955006e8b0 0x7f955013c0f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.768+0000 7f955577b700 1 --2- 172.21.15.112:0/4088953894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f955006ec80 0x7f95500c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.768+0000 7f955577b700 1 -- 172.21.15.112:0/4088953894 >> 172.21.15.112:0/4088953894 conn(0x7f9550068750 msgr2=0x7f95500cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:29.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.768+0000 7f40ce65d700 1 -- 172.21.15.112:0/2015992385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f40c80af1e0 con 0x7f40c80b30e0 2023-10-06T04:39:29.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.768+0000 7f334a0fb700 1 -- 172.21.15.112:0/26605800 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f334415be90 con 0x7f334406cee0 2023-10-06T04:39:29.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.768+0000 7f40affff700 1 -- 172.21.15.112:0/2015992385 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f40c80af1e0 con 0x7f40c80b30e0 2023-10-06T04:39:29.771 INFO:teuthology.orchestra.run.smithi112.stdout:55834574855 2023-10-06T04:39:29.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.768+0000 7f332b7fe700 1 -- 172.21.15.112:0/26605800 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f334415be90 con 0x7f334406cee0 2023-10-06T04:39:29.771 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2023-10-06T04:39:29.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.769+0000 7f35d7d67700 1 -- 172.21.15.112:0/96845495 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f35d005f230 con 0x7f35d006a4e0 2023-10-06T04:39:29.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.769+0000 7f35c5ffb700 1 -- 172.21.15.112:0/96845495 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f35cc027090 con 0x7f35d006a4e0 2023-10-06T04:39:29.772 INFO:teuthology.orchestra.run.smithi112.stdout:55834574855 2023-10-06T04:39:29.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.769+0000 7ff0e1266700 1 -- 172.21.15.112:0/440807964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff0bc005830 con 0x7ff0dc0ad120 2023-10-06T04:39:29.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.769+0000 7f955577b700 1 -- 172.21.15.112:0/4088953894 shutdown_connections 2023-10-06T04:39:29.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.771+0000 7f955577b700 1 -- 172.21.15.112:0/4088953894 wait complete. 2023-10-06T04:39:29.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.771+0000 7f334a0fb700 1 -- 172.21.15.112:0/26605800 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f332c0671b0 msgr2=0x7f332c069660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.771+0000 7f334a0fb700 1 --2- 172.21.15.112:0/26605800 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f332c0671b0 0x7f332c069660 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f33440ce4e0 tx=0x7f3334000bc0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.771+0000 7f334a0fb700 1 -- 172.21.15.112:0/26605800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f334406cee0 msgr2=0x7f3344150ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.771+0000 7f334a0fb700 1 --2- 172.21.15.112:0/26605800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f334406cee0 0x7f3344150ed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f333800c810 tx=0x7f3338007ee0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.771+0000 7ff0c2ffd700 1 -- 172.21.15.112:0/440807964 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff0d0050930 con 0x7ff0dc0ad120 2023-10-06T04:39:29.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.771+0000 7f334a0fb700 1 -- 172.21.15.112:0/26605800 shutdown_connections 2023-10-06T04:39:29.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.771+0000 7f334a0fb700 1 --2- 172.21.15.112:0/26605800 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f332c0671b0 0x7f332c069660 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.771+0000 7f334a0fb700 1 --2- 172.21.15.112:0/26605800 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3344159ac0 0x7f334415d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.771+0000 7f334a0fb700 1 --2- 172.21.15.112:0/26605800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f334406cee0 0x7f3344150ed0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.771+0000 7f334a0fb700 1 --2- 172.21.15.112:0/26605800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33441596f0 0x7f334415d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.771+0000 7f334a0fb700 1 -- 172.21.15.112:0/26605800 >> 172.21.15.112:0/26605800 conn(0x7f334406e350 msgr2=0x7f33440b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:29.777 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2023-10-06T04:39:29.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.771+0000 7f334a0fb700 1 -- 172.21.15.112:0/26605800 shutdown_connections 2023-10-06T04:39:29.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.771+0000 7f334a0fb700 1 -- 172.21.15.112:0/26605800 wait complete. 2023-10-06T04:39:29.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.771+0000 7f40ce65d700 1 -- 172.21.15.112:0/2015992385 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f40b4066f30 msgr2=0x7f40b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.771+0000 7f40ce65d700 1 --2- 172.21.15.112:0/2015992385 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f40b4066f30 0x7f40b40693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f40c80700a0 tx=0x7f40b8009060 comp rx=0 tx=0).stop 2023-10-06T04:39:29.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.771+0000 7f40ce65d700 1 -- 172.21.15.112:0/2015992385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40c80b30e0 msgr2=0x7f40c81573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.771+0000 7f40ce65d700 1 --2- 172.21.15.112:0/2015992385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40c80b30e0 0x7f40c81573c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00cb40 tx=0x7f40bc001b50 comp rx=0 tx=0).stop 2023-10-06T04:39:29.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.772+0000 7f40ce65d700 1 -- 172.21.15.112:0/2015992385 shutdown_connections 2023-10-06T04:39:29.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.772+0000 7f40ce65d700 1 --2- 172.21.15.112:0/2015992385 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f40b4066f30 0x7f40b40693e0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f40c80700a0 tx=0x7f40b8009060 comp rx=0 tx=0).stop 2023-10-06T04:39:29.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.772+0000 7f40ce65d700 1 --2- 172.21.15.112:0/2015992385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40c80b24c0 0x7f40c80b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.772+0000 7f40ce65d700 1 --2- 172.21.15.112:0/2015992385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40b0009a50 0x7f40c80ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.772+0000 7f40ce65d700 1 --2- 172.21.15.112:0/2015992385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40c80b30e0 0x7f40c81573c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.772+0000 7f40ce65d700 1 -- 172.21.15.112:0/2015992385 >> 172.21.15.112:0/2015992385 conn(0x7f40c806cfb0 msgr2=0x7f40c806db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:29.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.772+0000 7f35d7d67700 1 -- 172.21.15.112:0/96845495 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f35b4066f30 msgr2=0x7f35b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.772+0000 7f35d7d67700 1 --2- 172.21.15.112:0/96845495 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f35b4066f30 0x7f35b40693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f35d0155180 tx=0x7f35c0006cc0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.772+0000 7f35d7d67700 1 -- 172.21.15.112:0/96845495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35d006a4e0 msgr2=0x7f35d0159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.772+0000 7f35d7d67700 1 --2- 172.21.15.112:0/96845495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35d006a4e0 0x7f35d0159a70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f35cc018000 tx=0x7f35cc019000 comp rx=0 tx=0).stop 2023-10-06T04:39:29.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.772+0000 7f35d7d67700 1 -- 172.21.15.112:0/96845495 shutdown_connections 2023-10-06T04:39:29.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.772+0000 7f35d7d67700 1 --2- 172.21.15.112:0/96845495 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f35b4066f30 0x7f35b40693e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.772+0000 7f35d7d67700 1 --2- 172.21.15.112:0/96845495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35d014c530 0x7f35d014c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.772+0000 7f35d7d67700 1 --2- 172.21.15.112:0/96845495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35d006a4e0 0x7f35d0159a70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.772+0000 7f35d7d67700 1 --2- 172.21.15.112:0/96845495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35d0155950 0x7f35d0157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.772+0000 7f35d7d67700 1 -- 172.21.15.112:0/96845495 >> 172.21.15.112:0/96845495 conn(0x7f35d00631f0 msgr2=0x7f35d00ca7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:29.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.772+0000 7f35d7d67700 1 -- 172.21.15.112:0/96845495 shutdown_connections 2023-10-06T04:39:29.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.772+0000 7f35d7d67700 1 -- 172.21.15.112:0/96845495 wait complete. 2023-10-06T04:39:29.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.774+0000 7ff0e1266700 1 -- 172.21.15.112:0/440807964 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff0c8066f30 msgr2=0x7ff0c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.774+0000 7ff0e1266700 1 --2- 172.21.15.112:0/440807964 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff0c8066f30 0x7ff0c80693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc006fd0 tx=0x7ff0cc008040 comp rx=0 tx=0).stop 2023-10-06T04:39:29.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.774+0000 7ff0e1266700 1 -- 172.21.15.112:0/440807964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0dc0ad120 msgr2=0x7ff0dc0ca740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.774+0000 7ff0e1266700 1 --2- 172.21.15.112:0/440807964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0dc0ad120 0x7ff0dc0ca740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000c7f0 tx=0x7ff0d0007eb0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.776+0000 7ff0e1266700 1 -- 172.21.15.112:0/440807964 shutdown_connections 2023-10-06T04:39:29.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.776+0000 7ff0e1266700 1 --2- 172.21.15.112:0/440807964 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff0c8066f30 0x7ff0c80693e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.776+0000 7ff0e1266700 1 --2- 172.21.15.112:0/440807964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0dc0ab870 0x7ff0dc0a59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.776+0000 7ff0e1266700 1 --2- 172.21.15.112:0/440807964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0dc0ad120 0x7ff0dc0ca740 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.776+0000 7ff0e1266700 1 --2- 172.21.15.112:0/440807964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0dc15de70 0x7ff0dc0a5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.776+0000 7ff0e1266700 1 -- 172.21.15.112:0/440807964 >> 172.21.15.112:0/440807964 conn(0x7ff0dc06d260 msgr2=0x7ff0dc06dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:29.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.776+0000 7ff0e1266700 1 -- 172.21.15.112:0/440807964 shutdown_connections 2023-10-06T04:39:29.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.776+0000 7ff0e1266700 1 -- 172.21.15.112:0/440807964 wait complete. 2023-10-06T04:39:29.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.776+0000 7f40ce65d700 1 -- 172.21.15.112:0/2015992385 shutdown_connections 2023-10-06T04:39:29.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.778+0000 7f40ce65d700 1 -- 172.21.15.112:0/2015992385 wait complete. 2023-10-06T04:39:29.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.787+0000 7f0230997700 1 -- 172.21.15.112:0/1753041807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f022c0ad540 con 0x7f022c155e40 2023-10-06T04:39:29.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.787+0000 7f02137fe700 1 -- 172.21.15.112:0/1753041807 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f021c017090 con 0x7f022c155e40 2023-10-06T04:39:29.791 INFO:teuthology.orchestra.run.smithi112.stdout:55834574853 2023-10-06T04:39:29.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-10-06T04:39:29.792 DEBUG:teuthology.parallel:result is None 2023-10-06T04:39:29.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.790+0000 7f0230997700 1 -- 172.21.15.112:0/1753041807 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0214067080 msgr2=0x7f0214069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.790+0000 7f0230997700 1 --2- 172.21.15.112:0/1753041807 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0214067080 0x7f0214069530 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f022c0cc2b0 tx=0x7f022401c000 comp rx=0 tx=0).stop 2023-10-06T04:39:29.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.790+0000 7f0230997700 1 -- 172.21.15.112:0/1753041807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f022c155e40 msgr2=0x7f022c158280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.790+0000 7f0230997700 1 --2- 172.21.15.112:0/1753041807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f022c155e40 0x7f022c158280 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f021c00c560 tx=0x7f021c007eb0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.791+0000 7f0230997700 1 -- 172.21.15.112:0/1753041807 shutdown_connections 2023-10-06T04:39:29.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.791+0000 7f0230997700 1 --2- 172.21.15.112:0/1753041807 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0214067080 0x7f0214069530 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.791+0000 7f0230997700 1 --2- 172.21.15.112:0/1753041807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f022c155e40 0x7f022c158280 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.791+0000 7f0230997700 1 --2- 172.21.15.112:0/1753041807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f022c06dda0 0x7f022c16d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.791+0000 7f0230997700 1 --2- 172.21.15.112:0/1753041807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f022c155a70 0x7f022c1504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.791+0000 7f0230997700 1 -- 172.21.15.112:0/1753041807 >> 172.21.15.112:0/1753041807 conn(0x7f022c06f300 msgr2=0x7f022c0c9500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:29.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.791+0000 7f0230997700 1 -- 172.21.15.112:0/1753041807 shutdown_connections 2023-10-06T04:39:29.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.791+0000 7f0230997700 1 -- 172.21.15.112:0/1753041807 wait complete. 2023-10-06T04:39:29.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2023-10-06T04:39:29.797 DEBUG:teuthology.parallel:result is None 2023-10-06T04:39:29.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-10-06T04:39:29.798 DEBUG:teuthology.parallel:result is None 2023-10-06T04:39:29.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.799+0000 7f69aeefd700 1 -- 172.21.15.112:0/2229407104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f69a815e150 con 0x7f69a80a9680 2023-10-06T04:39:29.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.800+0000 7f699dffb700 1 -- 172.21.15.112:0/2229407104 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f69a0053e00 con 0x7f69a80a9680 2023-10-06T04:39:29.802 INFO:teuthology.orchestra.run.smithi112.stdout:55834574853 2023-10-06T04:39:29.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-10-06T04:39:29.804 DEBUG:teuthology.parallel:result is None 2023-10-06T04:39:29.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.802+0000 7f69aeefd700 1 -- 172.21.15.112:0/2229407104 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f698c066fb0 msgr2=0x7f698c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.802+0000 7f69aeefd700 1 --2- 172.21.15.112:0/2229407104 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f698c066fb0 0x7f698c069460 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f69a80c8ae0 tx=0x7f6998009040 comp rx=0 tx=0).stop 2023-10-06T04:39:29.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.802+0000 7f69aeefd700 1 -- 172.21.15.112:0/2229407104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69a80a9680 msgr2=0x7f69a816eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.802+0000 7f69aeefd700 1 --2- 172.21.15.112:0/2229407104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69a80a9680 0x7f69a816eaa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f69a80b25c0 tx=0x7f69a0017000 comp rx=0 tx=0).stop 2023-10-06T04:39:29.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.802+0000 7f69aeefd700 1 -- 172.21.15.112:0/2229407104 shutdown_connections 2023-10-06T04:39:29.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.802+0000 7f69aeefd700 1 --2- 172.21.15.112:0/2229407104 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f698c066fb0 0x7f698c069460 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.802+0000 7f69aeefd700 1 --2- 172.21.15.112:0/2229407104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69a8158440 0x7f69a815a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.802+0000 7f69aeefd700 1 --2- 172.21.15.112:0/2229407104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69a80a9680 0x7f69a816eaa0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.802+0000 7f69aeefd700 1 --2- 172.21.15.112:0/2229407104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69a80b0ce0 0x7f69a80ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.802+0000 7f69aeefd700 1 -- 172.21.15.112:0/2229407104 >> 172.21.15.112:0/2229407104 conn(0x7f69a806d220 msgr2=0x7f69a815d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:29.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.802+0000 7f69aeefd700 1 -- 172.21.15.112:0/2229407104 shutdown_connections 2023-10-06T04:39:29.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.802+0000 7f69aeefd700 1 -- 172.21.15.112:0/2229407104 wait complete. 2023-10-06T04:39:29.806 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-10-06T04:39:29.806 DEBUG:teuthology.parallel:result is None 2023-10-06T04:39:29.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2023-10-06T04:39:29.809 DEBUG:teuthology.parallel:result is None 2023-10-06T04:39:29.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-10-06T04:39:29.816 DEBUG:teuthology.parallel:result is None 2023-10-06T04:39:29.816 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T04:39:29.816 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:39:29.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.968+0000 7f7d1894b700 1 Processor -- start 2023-10-06T04:39:29.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.968+0000 7f7d1894b700 1 -- start start 2023-10-06T04:39:29.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1894b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140b3040 0x7f7d140cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1894b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7d140b0e70 0x7f7d140b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1894b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d140cd740 con 0x7f7d14159d50 2023-10-06T04:39:29.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1894b700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d140b3490 con 0x7f7d140b0e70 2023-10-06T04:39:29.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1894b700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d140b1830 con 0x7f7d140b3040 2023-10-06T04:39:29.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1259c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7d14159d50 0x7f7d1415a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60238/0 (socket says 172.21.15.112:60238) 2023-10-06T04:39:29.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1259c700 1 -- 172.21.15.112:0/860335538 learned_addr learned my addr 172.21.15.112:0/860335538 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:29.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1159a700 1 -- 172.21.15.112:0/860335538 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114192580 0 0) 0x7f7d140cd740 con 0x7f7d14159d50 2023-10-06T04:39:29.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d11d9b700 1 --2- 172.21.15.112:0/860335538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140b3040 0x7f7d140cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d12d9d700 1 --2- 172.21.15.112:0/860335538 >> v2:172.21.15.179:3300/0 conn(0x7f7d140b0e70 0x7f7d140b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1159a700 1 -- 172.21.15.112:0/860335538 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cfc003570 con 0x7f7d14159d50 2023-10-06T04:39:29.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1159a700 1 -- 172.21.15.112:0/860335538 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3629689020 0 0) 0x7f7cfc003570 con 0x7f7d14159d50 2023-10-06T04:39:29.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1159a700 1 -- 172.21.15.112:0/860335538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140b3040 msgr2=0x7f7d140cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:29.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1159a700 1 --2- 172.21.15.112:0/860335538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140b3040 0x7f7d140cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1159a700 1 -- 172.21.15.112:0/860335538 >> v2:172.21.15.179:3300/0 conn(0x7f7d140b0e70 msgr2=0x7f7d140b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:29.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1159a700 1 --2- 172.21.15.112:0/860335538 >> v2:172.21.15.179:3300/0 conn(0x7f7d140b0e70 0x7f7d140b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1159a700 1 -- 172.21.15.112:0/860335538 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d140ccb30 con 0x7f7d14159d50 2023-10-06T04:39:29.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1159a700 1 -- 172.21.15.112:0/860335538 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f7d04001470 con 0x7f7d14159d50 2023-10-06T04:39:29.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1159a700 1 -- 172.21.15.112:0/860335538 >> v1:172.21.15.112:6789/0 conn(0x7f7d14159d50 legacy=0x7f7d1415a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1159a700 1 --2- 172.21.15.112:0/860335538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cfc003a60 0x7f7cfc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1159a700 1 --2- 172.21.15.112:0/860335538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140b3040 0x7f7cfc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1159a700 1 --2- 172.21.15.112:0/860335538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cfc004d50 0x7f7cfc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1159a700 1 -- 172.21.15.112:0/860335538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d140b3490 con 0x7f7cfc003a60 2023-10-06T04:39:29.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1159a700 1 -- 172.21.15.112:0/860335538 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d140b1830 con 0x7f7cfc004d50 2023-10-06T04:39:29.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1159a700 1 -- 172.21.15.112:0/860335538 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc00ba60 con 0x7f7d140b3040 2023-10-06T04:39:29.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d1259c700 1 --2- 172.21.15.112:0/860335538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cfc003a60 0x7f7cfc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.969+0000 7f7d11d9b700 1 --2- 172.21.15.112:0/860335538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140b3040 0x7f7cfc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.970+0000 7f7d12d9d700 1 --2- 172.21.15.112:0/860335538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cfc004d50 0x7f7cfc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.970+0000 7f7d1259c700 1 -- 172.21.15.112:0/860335538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140b3040 msgr2=0x7f7cfc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:29.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.970+0000 7f7d1259c700 1 --2- 172.21.15.112:0/860335538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140b3040 0x7f7cfc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.970+0000 7f7d1259c700 1 -- 172.21.15.112:0/860335538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cfc004d50 msgr2=0x7f7cfc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:29.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.970+0000 7f7d1259c700 1 --2- 172.21.15.112:0/860335538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cfc004d50 0x7f7cfc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.970+0000 7f7d1259c700 1 -- 172.21.15.112:0/860335538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc003570 con 0x7f7cfc003a60 2023-10-06T04:39:29.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.970+0000 7f7d1259c700 1 --2- 172.21.15.112:0/860335538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cfc003a60 0x7f7cfc003e70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400c3c0 tx=0x7f7d04001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4baf043befc34193 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.970+0000 7f7d1159a700 1 -- 172.21.15.112:0/860335538 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0400cc30 con 0x7f7cfc003a60 2023-10-06T04:39:29.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.970+0000 7f7d1159a700 1 -- 172.21.15.112:0/860335538 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0400cdb0 con 0x7f7cfc003a60 2023-10-06T04:39:29.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.970+0000 7f7d1159a700 1 -- 172.21.15.112:0/860335538 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d04005b70 con 0x7f7cfc003a60 2023-10-06T04:39:29.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.970+0000 7f7d1894b700 1 -- 172.21.15.112:0/860335538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cfc003a60 msgr2=0x7f7cfc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.970+0000 7f7d1894b700 1 --2- 172.21.15.112:0/860335538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cfc003a60 0x7f7cfc003e70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400c3c0 tx=0x7f7d04001e90 comp rx=0 tx=0).stop 2023-10-06T04:39:29.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.970+0000 7f7d12d9d700 1 -- 172.21.15.112:0/860335538 reap_dead start 2023-10-06T04:39:29.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.971+0000 7f7d1894b700 1 -- 172.21.15.112:0/860335538 shutdown_connections 2023-10-06T04:39:29.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.971+0000 7f7d1894b700 1 -- 172.21.15.112:0/860335538 >> 172.21.15.112:0/860335538 conn(0x7f7d14099b60 msgr2=0x7f7d1406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:29.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.971+0000 7f7d1894b700 1 -- 172.21.15.112:0/860335538 shutdown_connections 2023-10-06T04:39:29.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.971+0000 7f7d1894b700 1 -- 172.21.15.112:0/860335538 wait complete. 2023-10-06T04:39:29.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.972+0000 7f7d1894b700 1 Processor -- start 2023-10-06T04:39:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.972+0000 7f7d1894b700 1 -- start start 2023-10-06T04:39:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.972+0000 7f7d1894b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cfc003a60 0x7f7d140af340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.972+0000 7f7d1894b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d140b3810 0x7f7d140b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.972+0000 7f7d1894b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140a0eb0 0x7f7d140a1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.972+0000 7f7d1894b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d141555f0 con 0x7f7d140b3810 2023-10-06T04:39:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.972+0000 7f7d1894b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d140b41c0 con 0x7f7cfc003a60 2023-10-06T04:39:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.972+0000 7f7d1894b700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d140a1860 con 0x7f7d140a0eb0 2023-10-06T04:39:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.972+0000 7f7d11d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d140b3810 0x7f7d140b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.973+0000 7f7d11d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d140b3810 0x7f7d140b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58330/0 (socket says 172.21.15.112:58330) 2023-10-06T04:39:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.973+0000 7f7d11d9b700 1 -- 172.21.15.112:0/1831149265 learned_addr learned my addr 172.21.15.112:0/1831149265 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.973+0000 7f7d1259c700 1 --2- 172.21.15.112:0/1831149265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cfc003a60 0x7f7d140af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.973+0000 7f7d12d9d700 1 --2- 172.21.15.112:0/1831149265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140a0eb0 0x7f7d140a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.973+0000 7f7d11d9b700 1 -- 172.21.15.112:0/1831149265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140a0eb0 msgr2=0x7f7d140a1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.973+0000 7f7d11d9b700 1 --2- 172.21.15.112:0/1831149265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140a0eb0 0x7f7d140a1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.973+0000 7f7d11d9b700 1 -- 172.21.15.112:0/1831149265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cfc003a60 msgr2=0x7f7d140af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:29.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.973+0000 7f7d11d9b700 1 --2- 172.21.15.112:0/1831149265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cfc003a60 0x7f7d140af340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:29.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.973+0000 7f7d11d9b700 1 -- 172.21.15.112:0/1831149265 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d140b4400 con 0x7f7d140b3810 2023-10-06T04:39:29.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.973+0000 7f7d11d9b700 1 --2- 172.21.15.112:0/1831149265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d140b3810 0x7f7d140b3c80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7d08011cf0 tx=0x7f7d080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.973+0000 7f7d027fc700 1 -- 172.21.15.112:0/1831149265 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0800f8e0 con 0x7f7d140b3810 2023-10-06T04:39:29.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.973+0000 7f7d027fc700 1 -- 172.21.15.112:0/1831149265 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0800fa40 con 0x7f7d140b3810 2023-10-06T04:39:29.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.973+0000 7f7d1894b700 1 -- 172.21.15.112:0/1831149265 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d140b46e0 con 0x7f7d140b3810 2023-10-06T04:39:29.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.973+0000 7f7d027fc700 1 -- 172.21.15.112:0/1831149265 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0800fdc0 con 0x7f7d140b3810 2023-10-06T04:39:29.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.973+0000 7f7d1894b700 1 -- 172.21.15.112:0/1831149265 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d140b4ca0 con 0x7f7d140b3810 2023-10-06T04:39:29.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.974+0000 7f7d1894b700 1 -- 172.21.15.112:0/1831149265 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d1409e960 con 0x7f7d140b3810 2023-10-06T04:39:29.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.974+0000 7f7d027fc700 1 -- 172.21.15.112:0/1831149265 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d08014650 con 0x7f7d140b3810 2023-10-06T04:39:29.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.975+0000 7f7d027fc700 1 --2- 172.21.15.112:0/1831149265 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7cf4066f30 0x7f7cf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:29.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.975+0000 7f7d1259c700 1 --2- 172.21.15.112:0/1831149265 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7cf4066f30 0x7f7cf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:29.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.975+0000 7f7d027fc700 1 -- 172.21.15.112:0/1831149265 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7d08018030 con 0x7f7d140b3810 2023-10-06T04:39:29.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.975+0000 7f7d1259c700 1 --2- 172.21.15.112:0/1831149265 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7cf4066f30 0x7f7cf40693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7d04001ed0 tx=0x7f7d04015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:29.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:29.979+0000 7f7d027fc700 1 -- 172.21.15.112:0/1831149265 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d1409e960 con 0x7f7d140b3810 2023-10-06T04:39:30.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.157+0000 7f7d1894b700 1 -- 172.21.15.112:0/1831149265 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d1409e960 con 0x7f7cf4066f30 2023-10-06T04:39:30.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.164+0000 7f7d027fc700 1 -- 172.21.15.112:0/1831149265 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286827 (secure 0 0 0) 0x7f7d1409e960 con 0x7f7cf4066f30 2023-10-06T04:39:30.169 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:30.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.168+0000 7f7d1894b700 1 -- 172.21.15.112:0/1831149265 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7cf4066f30 msgr2=0x7f7cf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.168+0000 7f7d1894b700 1 --2- 172.21.15.112:0/1831149265 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7cf4066f30 0x7f7cf40693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7d04001ed0 tx=0x7f7d04015000 comp rx=0 tx=0).stop 2023-10-06T04:39:30.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.168+0000 7f7d1894b700 1 -- 172.21.15.112:0/1831149265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d140b3810 msgr2=0x7f7d140b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.168+0000 7f7d1894b700 1 --2- 172.21.15.112:0/1831149265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d140b3810 0x7f7d140b3c80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7d08011cf0 tx=0x7f7d080091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.168+0000 7f7d1894b700 1 -- 172.21.15.112:0/1831149265 shutdown_connections 2023-10-06T04:39:30.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.168+0000 7f7d1894b700 1 --2- 172.21.15.112:0/1831149265 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7cf4066f30 0x7f7cf40693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.168+0000 7f7d1894b700 1 --2- 172.21.15.112:0/1831149265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d140a0eb0 0x7f7d140a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.168+0000 7f7d1894b700 1 --2- 172.21.15.112:0/1831149265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cfc003a60 0x7f7d140af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.168+0000 7f7d1894b700 1 --2- 172.21.15.112:0/1831149265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d140b3810 0x7f7d140b3c80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.168+0000 7f7d1894b700 1 -- 172.21.15.112:0/1831149265 >> 172.21.15.112:0/1831149265 conn(0x7f7d14099b60 msgr2=0x7f7d140cdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:30.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.168+0000 7f7d1894b700 1 -- 172.21.15.112:0/1831149265 shutdown_connections 2023-10-06T04:39:30.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.168+0000 7f7d1894b700 1 -- 172.21.15.112:0/1831149265 wait complete. 2023-10-06T04:39:30.172 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-10-06T04:39:30.181 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-06T04:39:28.279905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381124,"kb_used_data":2820,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593596,"statfs":{"total":773094113280,"available":770655842304,"internally_reserved":0,"allocated":2887680,"data_stored":1777467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.655131"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650779+0000","last_change":"2023-10-06T04:39:21.643644+0000","last_active":"2023-10-06T04:39:21.650779+0000","last_peered":"2023-10-06T04:39:21.650779+0000","last_clean":"2023-10-06T04:39:21.650779+0000","last_became_active":"2023-10-06T04:39:21.643389+0000","last_became_peered":"2023-10-06T04:39:21.643389+0000","last_unstale":"2023-10-06T04:39:21.650779+0000","last_undegraded":"2023-10-06T04:39:21.650779+0000","last_fullsized":"2023-10-06T04:39:21.650779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:14.965914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650050+0000","last_change":"2023-10-06T04:39:21.643603+0000","last_active":"2023-10-06T04:39:21.650050+0000","last_peered":"2023-10-06T04:39:21.650050+0000","last_clean":"2023-10-06T04:39:21.650050+0000","last_became_active":"2023-10-06T04:39:21.643357+0000","last_became_peered":"2023-10-06T04:39:21.643357+0000","last_unstale":"2023-10-06T04:39:21.650050+0000","last_undegraded":"2023-10-06T04:39:21.650050+0000","last_fullsized":"2023-10-06T04:39:21.650050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:15.667787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.659151+0000","last_change":"2023-10-06T04:39:21.656120+0000","last_active":"2023-10-06T04:39:21.659151+0000","last_peered":"2023-10-06T04:39:21.659151+0000","last_clean":"2023-10-06T04:39:21.659151+0000","last_became_active":"2023-10-06T04:39:21.655868+0000","last_became_peered":"2023-10-06T04:39:21.655868+0000","last_unstale":"2023-10-06T04:39:21.659151+0000","last_undegraded":"2023-10-06T04:39:21.659151+0000","last_fullsized":"2023-10-06T04:39:21.659151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:27.287173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651328+0000","last_change":"2023-10-06T04:39:21.647825+0000","last_active":"2023-10-06T04:39:21.651328+0000","last_peered":"2023-10-06T04:39:21.651328+0000","last_clean":"2023-10-06T04:39:21.651328+0000","last_became_active":"2023-10-06T04:39:21.647566+0000","last_became_peered":"2023-10-06T04:39:21.647566+0000","last_unstale":"2023-10-06T04:39:21.651328+0000","last_undegraded":"2023-10-06T04:39:21.651328+0000","last_fullsized":"2023-10-06T04:39:21.651328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:44.939595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.660715+0000","last_change":"2023-10-06T04:39:21.656951+0000","last_active":"2023-10-06T04:39:21.660715+0000","last_peered":"2023-10-06T04:39:21.660715+0000","last_clean":"2023-10-06T04:39:21.660715+0000","last_became_active":"2023-10-06T04:39:21.656705+0000","last_became_peered":"2023-10-06T04:39:21.656705+0000","last_unstale":"2023-10-06T04:39:21.660715+0000","last_undegraded":"2023-10-06T04:39:21.660715+0000","last_fullsized":"2023-10-06T04:39:21.660715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:30.052905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656740+0000","last_change":"2023-10-06T04:39:21.651985+0000","last_active":"2023-10-06T04:39:21.656740+0000","last_peered":"2023-10-06T04:39:21.656740+0000","last_clean":"2023-10-06T04:39:21.656740+0000","last_became_active":"2023-10-06T04:39:21.649488+0000","last_became_peered":"2023-10-06T04:39:21.649488+0000","last_unstale":"2023-10-06T04:39:21.656740+0000","last_undegraded":"2023-10-06T04:39:21.656740+0000","last_fullsized":"2023-10-06T04:39:21.656740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:48:03.866418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657637+0000","last_change":"2023-10-06T04:39:21.653127+0000","last_active":"2023-10-06T04:39:21.657637+0000","last_peered":"2023-10-06T04:39:21.657637+0000","last_clean":"2023-10-06T04:39:21.657637+0000","last_became_active":"2023-10-06T04:39:21.652573+0000","last_became_peered":"2023-10-06T04:39:21.652573+0000","last_unstale":"2023-10-06T04:39:21.657637+0000","last_undegraded":"2023-10-06T04:39:21.657637+0000","last_fullsized":"2023-10-06T04:39:21.657637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:02.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654141+0000","last_change":"2023-10-06T04:39:21.651949+0000","last_active":"2023-10-06T04:39:21.654141+0000","last_peered":"2023-10-06T04:39:21.654141+0000","last_clean":"2023-10-06T04:39:21.654141+0000","last_became_active":"2023-10-06T04:39:21.651637+0000","last_became_peered":"2023-10-06T04:39:21.651637+0000","last_unstale":"2023-10-06T04:39:21.654141+0000","last_undegraded":"2023-10-06T04:39:21.654141+0000","last_fullsized":"2023-10-06T04:39:21.654141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:02.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.663642+0000","last_change":"2023-10-06T04:39:21.658016+0000","last_active":"2023-10-06T04:39:21.663642+0000","last_peered":"2023-10-06T04:39:21.663642+0000","last_clean":"2023-10-06T04:39:21.663642+0000","last_became_active":"2023-10-06T04:39:21.657149+0000","last_became_peered":"2023-10-06T04:39:21.657149+0000","last_unstale":"2023-10-06T04:39:21.663642+0000","last_undegraded":"2023-10-06T04:39:21.663642+0000","last_fullsized":"2023-10-06T04:39:21.663642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:53.420342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.658796+0000","last_change":"2023-10-06T04:39:21.656885+0000","last_active":"2023-10-06T04:39:21.658796+0000","last_peered":"2023-10-06T04:39:21.658796+0000","last_clean":"2023-10-06T04:39:21.658796+0000","last_became_active":"2023-10-06T04:39:21.656652+0000","last_became_peered":"2023-10-06T04:39:21.656652+0000","last_unstale":"2023-10-06T04:39:21.658796+0000","last_undegraded":"2023-10-06T04:39:21.658796+0000","last_fullsized":"2023-10-06T04:39:21.658796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:37.183346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656795+0000","last_change":"2023-10-06T04:39:21.652303+0000","last_active":"2023-10-06T04:39:21.656795+0000","last_peered":"2023-10-06T04:39:21.656795+0000","last_clean":"2023-10-06T04:39:21.656795+0000","last_became_active":"2023-10-06T04:39:21.652040+0000","last_became_peered":"2023-10-06T04:39:21.652040+0000","last_unstale":"2023-10-06T04:39:21.656795+0000","last_undegraded":"2023-10-06T04:39:21.656795+0000","last_fullsized":"2023-10-06T04:39:21.656795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:50.708331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.658359+0000","last_change":"2023-10-06T04:39:21.655931+0000","last_active":"2023-10-06T04:39:21.658359+0000","last_peered":"2023-10-06T04:39:21.658359+0000","last_clean":"2023-10-06T04:39:21.658359+0000","last_became_active":"2023-10-06T04:39:21.655663+0000","last_became_peered":"2023-10-06T04:39:21.655663+0000","last_unstale":"2023-10-06T04:39:21.658359+0000","last_undegraded":"2023-10-06T04:39:21.658359+0000","last_fullsized":"2023-10-06T04:39:21.658359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:30:34.663775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650823+0000","last_change":"2023-10-06T04:39:21.643679+0000","last_active":"2023-10-06T04:39:21.650823+0000","last_peered":"2023-10-06T04:39:21.650823+0000","last_clean":"2023-10-06T04:39:21.650823+0000","last_became_active":"2023-10-06T04:39:21.643341+0000","last_became_peered":"2023-10-06T04:39:21.643341+0000","last_unstale":"2023-10-06T04:39:21.650823+0000","last_undegraded":"2023-10-06T04:39:21.650823+0000","last_fullsized":"2023-10-06T04:39:21.650823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:27.026173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653958+0000","last_change":"2023-10-06T04:39:21.651998+0000","last_active":"2023-10-06T04:39:21.653958+0000","last_peered":"2023-10-06T04:39:21.653958+0000","last_clean":"2023-10-06T04:39:21.653958+0000","last_became_active":"2023-10-06T04:39:21.651702+0000","last_became_peered":"2023-10-06T04:39:21.651702+0000","last_unstale":"2023-10-06T04:39:21.653958+0000","last_undegraded":"2023-10-06T04:39:21.653958+0000","last_fullsized":"2023-10-06T04:39:21.653958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:23.201656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657656+0000","last_change":"2023-10-06T04:39:21.653318+0000","last_active":"2023-10-06T04:39:21.657656+0000","last_peered":"2023-10-06T04:39:21.657656+0000","last_clean":"2023-10-06T04:39:21.657656+0000","last_became_active":"2023-10-06T04:39:21.652877+0000","last_became_peered":"2023-10-06T04:39:21.652877+0000","last_unstale":"2023-10-06T04:39:21.657656+0000","last_undegraded":"2023-10-06T04:39:21.657656+0000","last_fullsized":"2023-10-06T04:39:21.657656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:23.201656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656760+0000","last_change":"2023-10-06T04:39:21.649928+0000","last_active":"2023-10-06T04:39:21.656760+0000","last_peered":"2023-10-06T04:39:21.656760+0000","last_clean":"2023-10-06T04:39:21.656760+0000","last_became_active":"2023-10-06T04:39:21.649638+0000","last_became_peered":"2023-10-06T04:39:21.649638+0000","last_unstale":"2023-10-06T04:39:21.656760+0000","last_undegraded":"2023-10-06T04:39:21.656760+0000","last_fullsized":"2023-10-06T04:39:21.656760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:54.256525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.660798+0000","last_change":"2023-10-06T04:39:21.657715+0000","last_active":"2023-10-06T04:39:21.660798+0000","last_peered":"2023-10-06T04:39:21.660798+0000","last_clean":"2023-10-06T04:39:21.660798+0000","last_became_active":"2023-10-06T04:39:21.656464+0000","last_became_peered":"2023-10-06T04:39:21.656464+0000","last_unstale":"2023-10-06T04:39:21.660798+0000","last_undegraded":"2023-10-06T04:39:21.660798+0000","last_fullsized":"2023-10-06T04:39:21.660798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:37.183346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.658960+0000","last_change":"2023-10-06T04:39:21.655935+0000","last_active":"2023-10-06T04:39:21.658960+0000","last_peered":"2023-10-06T04:39:21.658960+0000","last_clean":"2023-10-06T04:39:21.658960+0000","last_became_active":"2023-10-06T04:39:21.655700+0000","last_became_peered":"2023-10-06T04:39:21.655700+0000","last_unstale":"2023-10-06T04:39:21.658960+0000","last_undegraded":"2023-10-06T04:39:21.658960+0000","last_fullsized":"2023-10-06T04:39:21.658960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:30.052905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650721+0000","last_change":"2023-10-06T04:39:21.642376+0000","last_active":"2023-10-06T04:39:21.650721+0000","last_peered":"2023-10-06T04:39:21.650721+0000","last_clean":"2023-10-06T04:39:21.650721+0000","last_became_active":"2023-10-06T04:39:21.642132+0000","last_became_peered":"2023-10-06T04:39:21.642132+0000","last_unstale":"2023-10-06T04:39:21.650721+0000","last_undegraded":"2023-10-06T04:39:21.650721+0000","last_fullsized":"2023-10-06T04:39:21.650721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:57:07.955415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657008+0000","last_change":"2023-10-06T04:39:21.651106+0000","last_active":"2023-10-06T04:39:21.657008+0000","last_peered":"2023-10-06T04:39:21.657008+0000","last_clean":"2023-10-06T04:39:21.657008+0000","last_became_active":"2023-10-06T04:39:21.650595+0000","last_became_peered":"2023-10-06T04:39:21.650595+0000","last_unstale":"2023-10-06T04:39:21.657008+0000","last_undegraded":"2023-10-06T04:39:21.657008+0000","last_fullsized":"2023-10-06T04:39:21.657008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:39.953564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657675+0000","last_change":"2023-10-06T04:39:21.654113+0000","last_active":"2023-10-06T04:39:21.657675+0000","last_peered":"2023-10-06T04:39:21.657675+0000","last_clean":"2023-10-06T04:39:21.657675+0000","last_became_active":"2023-10-06T04:39:21.653847+0000","last_became_peered":"2023-10-06T04:39:21.653847+0000","last_unstale":"2023-10-06T04:39:21.657675+0000","last_undegraded":"2023-10-06T04:39:21.657675+0000","last_fullsized":"2023-10-06T04:39:21.657675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:37.183346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.660671+0000","last_change":"2023-10-06T04:39:21.656316+0000","last_active":"2023-10-06T04:39:21.660671+0000","last_peered":"2023-10-06T04:39:21.660671+0000","last_clean":"2023-10-06T04:39:21.660671+0000","last_became_active":"2023-10-06T04:39:21.655902+0000","last_became_peered":"2023-10-06T04:39:21.655902+0000","last_unstale":"2023-10-06T04:39:21.660671+0000","last_undegraded":"2023-10-06T04:39:21.660671+0000","last_fullsized":"2023-10-06T04:39:21.660671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:23.201656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654941+0000","last_change":"2023-10-06T04:39:21.651840+0000","last_active":"2023-10-06T04:39:21.654941+0000","last_peered":"2023-10-06T04:39:21.654941+0000","last_clean":"2023-10-06T04:39:21.654941+0000","last_became_active":"2023-10-06T04:39:21.651580+0000","last_became_peered":"2023-10-06T04:39:21.651580+0000","last_unstale":"2023-10-06T04:39:21.654941+0000","last_undegraded":"2023-10-06T04:39:21.654941+0000","last_fullsized":"2023-10-06T04:39:21.654941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:56.545180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657569+0000","last_change":"2023-10-06T04:39:21.650621+0000","last_active":"2023-10-06T04:39:21.657569+0000","last_peered":"2023-10-06T04:39:21.657569+0000","last_clean":"2023-10-06T04:39:21.657569+0000","last_became_active":"2023-10-06T04:39:21.650370+0000","last_became_peered":"2023-10-06T04:39:21.650370+0000","last_unstale":"2023-10-06T04:39:21.657569+0000","last_undegraded":"2023-10-06T04:39:21.657569+0000","last_fullsized":"2023-10-06T04:39:21.657569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.886362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653273+0000","last_change":"2023-10-06T04:39:21.649124+0000","last_active":"2023-10-06T04:39:21.653273+0000","last_peered":"2023-10-06T04:39:21.653273+0000","last_clean":"2023-10-06T04:39:21.653273+0000","last_became_active":"2023-10-06T04:39:21.648871+0000","last_became_peered":"2023-10-06T04:39:21.648871+0000","last_unstale":"2023-10-06T04:39:21.653273+0000","last_undegraded":"2023-10-06T04:39:21.653273+0000","last_fullsized":"2023-10-06T04:39:21.653273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:15.667787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649304+0000","last_change":"2023-10-06T04:39:21.639325+0000","last_active":"2023-10-06T04:39:21.649304+0000","last_peered":"2023-10-06T04:39:21.649304+0000","last_clean":"2023-10-06T04:39:21.649304+0000","last_became_active":"2023-10-06T04:39:21.639068+0000","last_became_peered":"2023-10-06T04:39:21.639068+0000","last_unstale":"2023-10-06T04:39:21.649304+0000","last_undegraded":"2023-10-06T04:39:21.649304+0000","last_fullsized":"2023-10-06T04:39:21.649304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:52.077624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651949+0000","last_change":"2023-10-06T04:39:21.646735+0000","last_active":"2023-10-06T04:39:21.651949+0000","last_peered":"2023-10-06T04:39:21.651949+0000","last_clean":"2023-10-06T04:39:21.651949+0000","last_became_active":"2023-10-06T04:39:21.646325+0000","last_became_peered":"2023-10-06T04:39:21.646325+0000","last_unstale":"2023-10-06T04:39:21.651949+0000","last_undegraded":"2023-10-06T04:39:21.651949+0000","last_fullsized":"2023-10-06T04:39:21.651949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.886362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.652192+0000","last_change":"2023-10-06T04:39:20.642499+0000","last_active":"2023-10-06T04:39:21.652192+0000","last_peered":"2023-10-06T04:39:21.652192+0000","last_clean":"2023-10-06T04:39:21.652192+0000","last_became_active":"2023-10-06T04:39:20.642246+0000","last_became_peered":"2023-10-06T04:39:20.642246+0000","last_unstale":"2023-10-06T04:39:21.652192+0000","last_undegraded":"2023-10-06T04:39:21.652192+0000","last_fullsized":"2023-10-06T04:39:21.652192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.956516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649570+0000","last_change":"2023-10-06T04:39:21.644626+0000","last_active":"2023-10-06T04:39:21.649570+0000","last_peered":"2023-10-06T04:39:21.649570+0000","last_clean":"2023-10-06T04:39:21.649570+0000","last_became_active":"2023-10-06T04:39:21.644333+0000","last_became_peered":"2023-10-06T04:39:21.644333+0000","last_unstale":"2023-10-06T04:39:21.649570+0000","last_undegraded":"2023-10-06T04:39:21.649570+0000","last_fullsized":"2023-10-06T04:39:21.649570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:54.256525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.628179+0000","last_change":"2023-10-06T04:39:20.639697+0000","last_active":"2023-10-06T04:39:21.628179+0000","last_peered":"2023-10-06T04:39:21.628179+0000","last_clean":"2023-10-06T04:39:21.628179+0000","last_became_active":"2023-10-06T04:39:20.639431+0000","last_became_peered":"2023-10-06T04:39:20.639431+0000","last_unstale":"2023-10-06T04:39:21.628179+0000","last_undegraded":"2023-10-06T04:39:21.628179+0000","last_fullsized":"2023-10-06T04:39:21.628179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:20.086705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.663680+0000","last_change":"2023-10-06T04:39:21.659222+0000","last_active":"2023-10-06T04:39:21.663680+0000","last_peered":"2023-10-06T04:39:21.663680+0000","last_clean":"2023-10-06T04:39:21.663680+0000","last_became_active":"2023-10-06T04:39:21.659030+0000","last_became_peered":"2023-10-06T04:39:21.659030+0000","last_unstale":"2023-10-06T04:39:21.663680+0000","last_undegraded":"2023-10-06T04:39:21.663680+0000","last_fullsized":"2023-10-06T04:39:21.663680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.886362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.636144+0000","last_change":"2023-10-06T04:39:20.642433+0000","last_active":"2023-10-06T04:39:21.636144+0000","last_peered":"2023-10-06T04:39:21.636144+0000","last_clean":"2023-10-06T04:39:21.636144+0000","last_became_active":"2023-10-06T04:39:20.640984+0000","last_became_peered":"2023-10-06T04:39:20.640984+0000","last_unstale":"2023-10-06T04:39:21.636144+0000","last_undegraded":"2023-10-06T04:39:21.636144+0000","last_fullsized":"2023-10-06T04:39:21.636144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:41.984467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651186+0000","last_change":"2023-10-06T04:39:21.643087+0000","last_active":"2023-10-06T04:39:21.651186+0000","last_peered":"2023-10-06T04:39:21.651186+0000","last_clean":"2023-10-06T04:39:21.651186+0000","last_became_active":"2023-10-06T04:39:21.642825+0000","last_became_peered":"2023-10-06T04:39:21.642825+0000","last_unstale":"2023-10-06T04:39:21.651186+0000","last_undegraded":"2023-10-06T04:39:21.651186+0000","last_fullsized":"2023-10-06T04:39:21.651186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:38.337736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.642745+0000","last_change":"2023-10-06T04:39:20.644712+0000","last_active":"2023-10-06T04:39:21.642745+0000","last_peered":"2023-10-06T04:39:21.642745+0000","last_clean":"2023-10-06T04:39:21.642745+0000","last_became_active":"2023-10-06T04:39:20.644415+0000","last_became_peered":"2023-10-06T04:39:20.644415+0000","last_unstale":"2023-10-06T04:39:21.642745+0000","last_undegraded":"2023-10-06T04:39:21.642745+0000","last_fullsized":"2023-10-06T04:39:21.642745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.956516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641262+0000","last_change":"2023-10-06T04:39:21.638794+0000","last_active":"2023-10-06T04:39:21.641262+0000","last_peered":"2023-10-06T04:39:21.641262+0000","last_clean":"2023-10-06T04:39:21.641262+0000","last_became_active":"2023-10-06T04:39:21.638555+0000","last_became_peered":"2023-10-06T04:39:21.638555+0000","last_unstale":"2023-10-06T04:39:21.641262+0000","last_undegraded":"2023-10-06T04:39:21.641262+0000","last_fullsized":"2023-10-06T04:39:21.641262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:48.632302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.639947+0000","last_change":"2023-10-06T04:39:20.643255+0000","last_active":"2023-10-06T04:39:21.639947+0000","last_peered":"2023-10-06T04:39:21.639947+0000","last_clean":"2023-10-06T04:39:21.639947+0000","last_became_active":"2023-10-06T04:39:20.642932+0000","last_became_peered":"2023-10-06T04:39:20.642932+0000","last_unstale":"2023-10-06T04:39:21.639947+0000","last_undegraded":"2023-10-06T04:39:21.639947+0000","last_fullsized":"2023-10-06T04:39:21.639947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:20.086705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649490+0000","last_change":"2023-10-06T04:39:21.643526+0000","last_active":"2023-10-06T04:39:21.649490+0000","last_peered":"2023-10-06T04:39:21.649490+0000","last_clean":"2023-10-06T04:39:21.649490+0000","last_became_active":"2023-10-06T04:39:21.643270+0000","last_became_peered":"2023-10-06T04:39:21.643270+0000","last_unstale":"2023-10-06T04:39:21.649490+0000","last_undegraded":"2023-10-06T04:39:21.649490+0000","last_fullsized":"2023-10-06T04:39:21.649490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:47.582081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654054+0000","last_change":"2023-10-06T04:39:20.647036+0000","last_active":"2023-10-06T04:39:21.654054+0000","last_peered":"2023-10-06T04:39:21.654054+0000","last_clean":"2023-10-06T04:39:21.654054+0000","last_became_active":"2023-10-06T04:39:20.646772+0000","last_became_peered":"2023-10-06T04:39:20.646772+0000","last_unstale":"2023-10-06T04:39:21.654054+0000","last_undegraded":"2023-10-06T04:39:21.654054+0000","last_fullsized":"2023-10-06T04:39:21.654054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:13.508117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653264+0000","last_change":"2023-10-06T04:39:21.648922+0000","last_active":"2023-10-06T04:39:21.653264+0000","last_peered":"2023-10-06T04:39:21.653264+0000","last_clean":"2023-10-06T04:39:21.653264+0000","last_became_active":"2023-10-06T04:39:21.648665+0000","last_became_peered":"2023-10-06T04:39:21.648665+0000","last_unstale":"2023-10-06T04:39:21.653264+0000","last_undegraded":"2023-10-06T04:39:21.653264+0000","last_fullsized":"2023-10-06T04:39:21.653264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:35:46.706541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.659518+0000","last_change":"2023-10-06T04:39:20.644243+0000","last_active":"2023-10-06T04:39:21.659518+0000","last_peered":"2023-10-06T04:39:21.659518+0000","last_clean":"2023-10-06T04:39:21.659518+0000","last_became_active":"2023-10-06T04:39:20.643934+0000","last_became_peered":"2023-10-06T04:39:20.643934+0000","last_unstale":"2023-10-06T04:39:21.659518+0000","last_undegraded":"2023-10-06T04:39:21.659518+0000","last_fullsized":"2023-10-06T04:39:21.659518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:30:33.654378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653554+0000","last_change":"2023-10-06T04:39:21.641258+0000","last_active":"2023-10-06T04:39:21.653554+0000","last_peered":"2023-10-06T04:39:21.653554+0000","last_clean":"2023-10-06T04:39:21.653554+0000","last_became_active":"2023-10-06T04:39:21.640963+0000","last_became_peered":"2023-10-06T04:39:21.640963+0000","last_unstale":"2023-10-06T04:39:21.653554+0000","last_undegraded":"2023-10-06T04:39:21.653554+0000","last_fullsized":"2023-10-06T04:39:21.653554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:30.317889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656880+0000","last_change":"2023-10-06T04:39:20.649614+0000","last_active":"2023-10-06T04:39:21.656880+0000","last_peered":"2023-10-06T04:39:21.656880+0000","last_clean":"2023-10-06T04:39:21.656880+0000","last_became_active":"2023-10-06T04:39:20.649327+0000","last_became_peered":"2023-10-06T04:39:20.649327+0000","last_unstale":"2023-10-06T04:39:21.656880+0000","last_undegraded":"2023-10-06T04:39:21.656880+0000","last_fullsized":"2023-10-06T04:39:21.656880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:34.104262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649589+0000","last_change":"2023-10-06T04:39:21.644535+0000","last_active":"2023-10-06T04:39:21.649589+0000","last_peered":"2023-10-06T04:39:21.649589+0000","last_clean":"2023-10-06T04:39:21.649589+0000","last_became_active":"2023-10-06T04:39:21.644260+0000","last_became_peered":"2023-10-06T04:39:21.644260+0000","last_unstale":"2023-10-06T04:39:21.649589+0000","last_undegraded":"2023-10-06T04:39:21.649589+0000","last_fullsized":"2023-10-06T04:39:21.649589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:30.052905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.643005+0000","last_change":"2023-10-06T04:39:20.641086+0000","last_active":"2023-10-06T04:39:21.643005+0000","last_peered":"2023-10-06T04:39:21.643005+0000","last_clean":"2023-10-06T04:39:21.643005+0000","last_became_active":"2023-10-06T04:39:20.640581+0000","last_became_peered":"2023-10-06T04:39:20.640581+0000","last_unstale":"2023-10-06T04:39:21.643005+0000","last_undegraded":"2023-10-06T04:39:21.643005+0000","last_fullsized":"2023-10-06T04:39:21.643005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:34.035323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651928+0000","last_change":"2023-10-06T04:39:21.646546+0000","last_active":"2023-10-06T04:39:21.651928+0000","last_peered":"2023-10-06T04:39:21.651928+0000","last_clean":"2023-10-06T04:39:21.651928+0000","last_became_active":"2023-10-06T04:39:21.645987+0000","last_became_peered":"2023-10-06T04:39:21.645987+0000","last_unstale":"2023-10-06T04:39:21.651928+0000","last_undegraded":"2023-10-06T04:39:21.651928+0000","last_fullsized":"2023-10-06T04:39:21.651928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:52.077624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641875+0000","last_change":"2023-10-06T04:39:20.648674+0000","last_active":"2023-10-06T04:39:21.641875+0000","last_peered":"2023-10-06T04:39:21.641875+0000","last_clean":"2023-10-06T04:39:21.641875+0000","last_became_active":"2023-10-06T04:39:20.648394+0000","last_became_peered":"2023-10-06T04:39:20.648394+0000","last_unstale":"2023-10-06T04:39:21.641875+0000","last_undegraded":"2023-10-06T04:39:21.641875+0000","last_fullsized":"2023-10-06T04:39:21.641875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:15.387433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.660625+0000","last_change":"2023-10-06T04:39:21.656280+0000","last_active":"2023-10-06T04:39:21.660625+0000","last_peered":"2023-10-06T04:39:21.660625+0000","last_clean":"2023-10-06T04:39:21.660625+0000","last_became_active":"2023-10-06T04:39:21.655973+0000","last_became_peered":"2023-10-06T04:39:21.655973+0000","last_unstale":"2023-10-06T04:39:21.660625+0000","last_undegraded":"2023-10-06T04:39:21.660625+0000","last_fullsized":"2023-10-06T04:39:21.660625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:56.545180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650234+0000","last_change":"2023-10-06T04:39:20.641641+0000","last_active":"2023-10-06T04:39:21.650234+0000","last_peered":"2023-10-06T04:39:21.650234+0000","last_clean":"2023-10-06T04:39:21.650234+0000","last_became_active":"2023-10-06T04:39:20.641335+0000","last_became_peered":"2023-10-06T04:39:20.641335+0000","last_unstale":"2023-10-06T04:39:21.650234+0000","last_undegraded":"2023-10-06T04:39:21.650234+0000","last_fullsized":"2023-10-06T04:39:21.650234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.956516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649486+0000","last_change":"2023-10-06T04:39:21.642393+0000","last_active":"2023-10-06T04:39:21.649486+0000","last_peered":"2023-10-06T04:39:21.649486+0000","last_clean":"2023-10-06T04:39:21.649486+0000","last_became_active":"2023-10-06T04:39:21.641909+0000","last_became_peered":"2023-10-06T04:39:21.641909+0000","last_unstale":"2023-10-06T04:39:21.649486+0000","last_undegraded":"2023-10-06T04:39:21.649486+0000","last_fullsized":"2023-10-06T04:39:21.649486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:02.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656881+0000","last_change":"2023-10-06T04:39:20.648860+0000","last_active":"2023-10-06T04:39:21.656881+0000","last_peered":"2023-10-06T04:39:21.656881+0000","last_clean":"2023-10-06T04:39:21.656881+0000","last_became_active":"2023-10-06T04:39:20.648534+0000","last_became_peered":"2023-10-06T04:39:20.648534+0000","last_unstale":"2023-10-06T04:39:21.656881+0000","last_undegraded":"2023-10-06T04:39:21.656881+0000","last_fullsized":"2023-10-06T04:39:21.656881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:02.150888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651553+0000","last_change":"2023-10-06T04:39:21.644510+0000","last_active":"2023-10-06T04:39:21.651553+0000","last_peered":"2023-10-06T04:39:21.651553+0000","last_clean":"2023-10-06T04:39:21.651553+0000","last_became_active":"2023-10-06T04:39:21.644240+0000","last_became_peered":"2023-10-06T04:39:21.644240+0000","last_unstale":"2023-10-06T04:39:21.651553+0000","last_undegraded":"2023-10-06T04:39:21.651553+0000","last_fullsized":"2023-10-06T04:39:21.651553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:51.885986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654601+0000","last_change":"2023-10-06T04:39:20.649002+0000","last_active":"2023-10-06T04:39:21.654601+0000","last_peered":"2023-10-06T04:39:21.654601+0000","last_clean":"2023-10-06T04:39:21.654601+0000","last_became_active":"2023-10-06T04:39:20.648668+0000","last_became_peered":"2023-10-06T04:39:20.648668+0000","last_unstale":"2023-10-06T04:39:21.654601+0000","last_undegraded":"2023-10-06T04:39:21.654601+0000","last_fullsized":"2023-10-06T04:39:21.654601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:37.328339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650007+0000","last_change":"2023-10-06T04:39:21.636412+0000","last_active":"2023-10-06T04:39:21.650007+0000","last_peered":"2023-10-06T04:39:21.650007+0000","last_clean":"2023-10-06T04:39:21.650007+0000","last_became_active":"2023-10-06T04:39:21.636129+0000","last_became_peered":"2023-10-06T04:39:21.636129+0000","last_unstale":"2023-10-06T04:39:21.650007+0000","last_undegraded":"2023-10-06T04:39:21.650007+0000","last_fullsized":"2023-10-06T04:39:21.650007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:23.201656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.652225+0000","last_change":"2023-10-06T04:39:20.644212+0000","last_active":"2023-10-06T04:39:21.652225+0000","last_peered":"2023-10-06T04:39:21.652225+0000","last_clean":"2023-10-06T04:39:21.652225+0000","last_became_active":"2023-10-06T04:39:20.643961+0000","last_became_peered":"2023-10-06T04:39:20.643961+0000","last_unstale":"2023-10-06T04:39:21.652225+0000","last_undegraded":"2023-10-06T04:39:21.652225+0000","last_fullsized":"2023-10-06T04:39:21.652225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:43.930198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650010+0000","last_change":"2023-10-06T04:39:21.641026+0000","last_active":"2023-10-06T04:39:21.650010+0000","last_peered":"2023-10-06T04:39:21.650010+0000","last_clean":"2023-10-06T04:39:21.650010+0000","last_became_active":"2023-10-06T04:39:21.640757+0000","last_became_peered":"2023-10-06T04:39:21.640757+0000","last_unstale":"2023-10-06T04:39:21.650010+0000","last_undegraded":"2023-10-06T04:39:21.650010+0000","last_fullsized":"2023-10-06T04:39:21.650010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:35.113660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.639626+0000","last_change":"2023-10-06T04:39:20.637507+0000","last_active":"2023-10-06T04:39:21.639626+0000","last_peered":"2023-10-06T04:39:21.639626+0000","last_clean":"2023-10-06T04:39:21.639626+0000","last_became_active":"2023-10-06T04:39:20.637209+0000","last_became_peered":"2023-10-06T04:39:20.637209+0000","last_unstale":"2023-10-06T04:39:21.639626+0000","last_undegraded":"2023-10-06T04:39:21.639626+0000","last_fullsized":"2023-10-06T04:39:21.639626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:30:33.654378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654743+0000","last_change":"2023-10-06T04:39:21.652401+0000","last_active":"2023-10-06T04:39:21.654743+0000","last_peered":"2023-10-06T04:39:21.654743+0000","last_clean":"2023-10-06T04:39:21.654743+0000","last_became_active":"2023-10-06T04:39:21.652150+0000","last_became_peered":"2023-10-06T04:39:21.652150+0000","last_unstale":"2023-10-06T04:39:21.654743+0000","last_undegraded":"2023-10-06T04:39:21.654743+0000","last_fullsized":"2023-10-06T04:39:21.654743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:02.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651501+0000","last_change":"2023-10-06T04:39:20.643661+0000","last_active":"2023-10-06T04:39:21.651501+0000","last_peered":"2023-10-06T04:39:21.651501+0000","last_clean":"2023-10-06T04:39:21.651501+0000","last_became_active":"2023-10-06T04:39:20.643353+0000","last_became_peered":"2023-10-06T04:39:20.643353+0000","last_unstale":"2023-10-06T04:39:21.651501+0000","last_undegraded":"2023-10-06T04:39:21.651501+0000","last_fullsized":"2023-10-06T04:39:21.651501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:37.328339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656988+0000","last_change":"2023-10-06T04:39:21.650918+0000","last_active":"2023-10-06T04:39:21.656988+0000","last_peered":"2023-10-06T04:39:21.656988+0000","last_clean":"2023-10-06T04:39:21.656988+0000","last_became_active":"2023-10-06T04:39:21.650308+0000","last_became_peered":"2023-10-06T04:39:21.650308+0000","last_unstale":"2023-10-06T04:39:21.656988+0000","last_undegraded":"2023-10-06T04:39:21.656988+0000","last_fullsized":"2023-10-06T04:39:21.656988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:54.734766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.631765+0000","last_change":"2023-10-06T04:39:20.643726+0000","last_active":"2023-10-06T04:39:21.631765+0000","last_peered":"2023-10-06T04:39:21.631765+0000","last_clean":"2023-10-06T04:39:21.631765+0000","last_became_active":"2023-10-06T04:39:20.643431+0000","last_became_peered":"2023-10-06T04:39:20.643431+0000","last_unstale":"2023-10-06T04:39:21.631765+0000","last_undegraded":"2023-10-06T04:39:21.631765+0000","last_fullsized":"2023-10-06T04:39:21.631765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:26.016776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.659132+0000","last_change":"2023-10-06T04:39:21.656050+0000","last_active":"2023-10-06T04:39:21.659132+0000","last_peered":"2023-10-06T04:39:21.659132+0000","last_clean":"2023-10-06T04:39:21.659132+0000","last_became_active":"2023-10-06T04:39:21.655770+0000","last_became_peered":"2023-10-06T04:39:21.655770+0000","last_unstale":"2023-10-06T04:39:21.659132+0000","last_undegraded":"2023-10-06T04:39:21.659132+0000","last_fullsized":"2023-10-06T04:39:21.659132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:48.632302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.632742+0000","last_change":"2023-10-06T04:39:20.646573+0000","last_active":"2023-10-06T04:39:21.632742+0000","last_peered":"2023-10-06T04:39:21.632742+0000","last_clean":"2023-10-06T04:39:21.632742+0000","last_became_active":"2023-10-06T04:39:20.646304+0000","last_became_peered":"2023-10-06T04:39:20.646304+0000","last_unstale":"2023-10-06T04:39:21.632742+0000","last_undegraded":"2023-10-06T04:39:21.632742+0000","last_fullsized":"2023-10-06T04:39:21.632742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:34.035323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653927+0000","last_change":"2023-10-06T04:39:21.647116+0000","last_active":"2023-10-06T04:39:21.653927+0000","last_peered":"2023-10-06T04:39:21.653927+0000","last_clean":"2023-10-06T04:39:21.653927+0000","last_became_active":"2023-10-06T04:39:21.646843+0000","last_became_peered":"2023-10-06T04:39:21.646843+0000","last_unstale":"2023-10-06T04:39:21.653927+0000","last_undegraded":"2023-10-06T04:39:21.653927+0000","last_fullsized":"2023-10-06T04:39:21.653927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:44.744728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.636029+0000","last_change":"2023-10-06T04:39:20.643002+0000","last_active":"2023-10-06T04:39:21.636029+0000","last_peered":"2023-10-06T04:39:21.636029+0000","last_clean":"2023-10-06T04:39:21.636029+0000","last_became_active":"2023-10-06T04:39:20.642751+0000","last_became_peered":"2023-10-06T04:39:20.642751+0000","last_unstale":"2023-10-06T04:39:21.636029+0000","last_undegraded":"2023-10-06T04:39:21.636029+0000","last_fullsized":"2023-10-06T04:39:21.636029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:34.035323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651772+0000","last_change":"2023-10-06T04:39:21.644991+0000","last_active":"2023-10-06T04:39:21.651772+0000","last_peered":"2023-10-06T04:39:21.651772+0000","last_clean":"2023-10-06T04:39:21.651772+0000","last_became_active":"2023-10-06T04:39:21.644463+0000","last_became_peered":"2023-10-06T04:39:21.644463+0000","last_unstale":"2023-10-06T04:39:21.651772+0000","last_undegraded":"2023-10-06T04:39:21.651772+0000","last_fullsized":"2023-10-06T04:39:21.651772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.886362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.646559+0000","last_change":"2023-10-06T04:39:20.644886+0000","last_active":"2023-10-06T04:39:21.646559+0000","last_peered":"2023-10-06T04:39:21.646559+0000","last_clean":"2023-10-06T04:39:21.646559+0000","last_became_active":"2023-10-06T04:39:20.644539+0000","last_became_peered":"2023-10-06T04:39:20.644539+0000","last_unstale":"2023-10-06T04:39:21.646559+0000","last_undegraded":"2023-10-06T04:39:21.646559+0000","last_fullsized":"2023-10-06T04:39:21.646559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.956516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.636207+0000","last_change":"2023-10-06T04:39:16.067723+0000","last_active":"2023-10-06T04:39:21.636207+0000","last_peered":"2023-10-06T04:39:21.636207+0000","last_clean":"2023-10-06T04:39:21.636207+0000","last_became_active":"2023-10-06T04:39:16.067325+0000","last_became_peered":"2023-10-06T04:39:16.067325+0000","last_unstale":"2023-10-06T04:39:21.636207+0000","last_undegraded":"2023-10-06T04:39:21.636207+0000","last_fullsized":"2023-10-06T04:39:21.636207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649652+0000","last_change":"2023-10-06T04:39:21.645095+0000","last_active":"2023-10-06T04:39:21.649652+0000","last_peered":"2023-10-06T04:39:21.649652+0000","last_clean":"2023-10-06T04:39:21.649652+0000","last_became_active":"2023-10-06T04:39:21.643941+0000","last_became_peered":"2023-10-06T04:39:21.643941+0000","last_unstale":"2023-10-06T04:39:21.649652+0000","last_undegraded":"2023-10-06T04:39:21.649652+0000","last_fullsized":"2023-10-06T04:39:21.649652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:37.183346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.636787+0000","last_change":"2023-10-06T04:39:15.592391+0000","last_active":"2023-10-06T04:39:21.636787+0000","last_peered":"2023-10-06T04:39:21.636787+0000","last_clean":"2023-10-06T04:39:21.636787+0000","last_became_active":"2023-10-06T04:39:15.592094+0000","last_became_peered":"2023-10-06T04:39:15.592094+0000","last_unstale":"2023-10-06T04:39:21.636787+0000","last_undegraded":"2023-10-06T04:39:21.636787+0000","last_fullsized":"2023-10-06T04:39:21.636787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.280766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:39:23.917747+0000","last_change":"2023-10-06T04:39:20.641845+0000","last_active":"2023-10-06T04:39:23.917747+0000","last_peered":"2023-10-06T04:39:23.917747+0000","last_clean":"2023-10-06T04:39:23.917747+0000","last_became_active":"2023-10-06T04:39:20.641582+0000","last_became_peered":"2023-10-06T04:39:20.641582+0000","last_unstale":"2023-10-06T04:39:23.917747+0000","last_undegraded":"2023-10-06T04:39:23.917747+0000","last_fullsized":"2023-10-06T04:39:23.917747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:25.801442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650028+0000","last_change":"2023-10-06T04:39:21.640130+0000","last_active":"2023-10-06T04:39:21.650028+0000","last_peered":"2023-10-06T04:39:21.650028+0000","last_clean":"2023-10-06T04:39:21.650028+0000","last_became_active":"2023-10-06T04:39:21.639874+0000","last_became_peered":"2023-10-06T04:39:21.639874+0000","last_unstale":"2023-10-06T04:39:21.650028+0000","last_undegraded":"2023-10-06T04:39:21.650028+0000","last_fullsized":"2023-10-06T04:39:21.650028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:33.545272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.628189+0000","last_change":"2023-10-06T04:39:15.585112+0000","last_active":"2023-10-06T04:39:21.628189+0000","last_peered":"2023-10-06T04:39:21.628189+0000","last_clean":"2023-10-06T04:39:21.628189+0000","last_became_active":"2023-10-06T04:39:15.584853+0000","last_became_peered":"2023-10-06T04:39:15.584853+0000","last_unstale":"2023-10-06T04:39:21.628189+0000","last_undegraded":"2023-10-06T04:39:21.628189+0000","last_fullsized":"2023-10-06T04:39:21.628189+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641467+0000","last_change":"2023-10-06T04:39:15.588017+0000","last_active":"2023-10-06T04:39:21.641467+0000","last_peered":"2023-10-06T04:39:21.641467+0000","last_clean":"2023-10-06T04:39:21.641467+0000","last_became_active":"2023-10-06T04:39:15.586771+0000","last_became_peered":"2023-10-06T04:39:15.586771+0000","last_unstale":"2023-10-06T04:39:21.641467+0000","last_undegraded":"2023-10-06T04:39:21.641467+0000","last_fullsized":"2023-10-06T04:39:21.641467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:35.225282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641917+0000","last_change":"2023-10-06T04:39:20.646203+0000","last_active":"2023-10-06T04:39:21.641917+0000","last_peered":"2023-10-06T04:39:21.641917+0000","last_clean":"2023-10-06T04:39:21.641917+0000","last_became_active":"2023-10-06T04:39:20.645902+0000","last_became_peered":"2023-10-06T04:39:20.645902+0000","last_unstale":"2023-10-06T04:39:21.641917+0000","last_undegraded":"2023-10-06T04:39:21.641917+0000","last_fullsized":"2023-10-06T04:39:21.641917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:26.016776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.660606+0000","last_change":"2023-10-06T04:39:21.656264+0000","last_active":"2023-10-06T04:39:21.660606+0000","last_peered":"2023-10-06T04:39:21.660606+0000","last_clean":"2023-10-06T04:39:21.660606+0000","last_became_active":"2023-10-06T04:39:21.655944+0000","last_became_peered":"2023-10-06T04:39:21.655944+0000","last_unstale":"2023-10-06T04:39:21.660606+0000","last_undegraded":"2023-10-06T04:39:21.660606+0000","last_fullsized":"2023-10-06T04:39:21.660606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:47.582081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641321+0000","last_change":"2023-10-06T04:39:16.252521+0000","last_active":"2023-10-06T04:39:21.641321+0000","last_peered":"2023-10-06T04:39:21.641321+0000","last_clean":"2023-10-06T04:39:21.641321+0000","last_became_active":"2023-10-06T04:39:16.252245+0000","last_became_peered":"2023-10-06T04:39:16.252245+0000","last_unstale":"2023-10-06T04:39:21.641321+0000","last_undegraded":"2023-10-06T04:39:21.641321+0000","last_fullsized":"2023-10-06T04:39:21.641321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:17.694713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.628229+0000","last_change":"2023-10-06T04:39:20.641992+0000","last_active":"2023-10-06T04:39:21.628229+0000","last_peered":"2023-10-06T04:39:21.628229+0000","last_clean":"2023-10-06T04:39:21.628229+0000","last_became_active":"2023-10-06T04:39:20.641741+0000","last_became_peered":"2023-10-06T04:39:20.641741+0000","last_unstale":"2023-10-06T04:39:21.628229+0000","last_undegraded":"2023-10-06T04:39:21.628229+0000","last_fullsized":"2023-10-06T04:39:21.628229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:26.016776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651793+0000","last_change":"2023-10-06T04:39:21.645153+0000","last_active":"2023-10-06T04:39:21.651793+0000","last_peered":"2023-10-06T04:39:21.651793+0000","last_clean":"2023-10-06T04:39:21.651793+0000","last_became_active":"2023-10-06T04:39:21.644766+0000","last_became_peered":"2023-10-06T04:39:21.644766+0000","last_unstale":"2023-10-06T04:39:21.651793+0000","last_undegraded":"2023-10-06T04:39:21.651793+0000","last_fullsized":"2023-10-06T04:39:21.651793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:40.720886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.640765+0000","last_change":"2023-10-06T04:39:16.252493+0000","last_active":"2023-10-06T04:39:21.640765+0000","last_peered":"2023-10-06T04:39:21.640765+0000","last_clean":"2023-10-06T04:39:21.640765+0000","last_became_active":"2023-10-06T04:39:16.252190+0000","last_became_peered":"2023-10-06T04:39:16.252190+0000","last_unstale":"2023-10-06T04:39:21.640765+0000","last_undegraded":"2023-10-06T04:39:21.640765+0000","last_fullsized":"2023-10-06T04:39:21.640765+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:59.554724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.636098+0000","last_change":"2023-10-06T04:39:20.639854+0000","last_active":"2023-10-06T04:39:21.636098+0000","last_peered":"2023-10-06T04:39:21.636098+0000","last_clean":"2023-10-06T04:39:21.636098+0000","last_became_active":"2023-10-06T04:39:20.639584+0000","last_became_peered":"2023-10-06T04:39:20.639584+0000","last_unstale":"2023-10-06T04:39:21.636098+0000","last_undegraded":"2023-10-06T04:39:21.636098+0000","last_fullsized":"2023-10-06T04:39:21.636098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:02.150888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656202+0000","last_change":"2023-10-06T04:39:21.653017+0000","last_active":"2023-10-06T04:39:21.656202+0000","last_peered":"2023-10-06T04:39:21.656202+0000","last_clean":"2023-10-06T04:39:21.656202+0000","last_became_active":"2023-10-06T04:39:21.652754+0000","last_became_peered":"2023-10-06T04:39:21.652754+0000","last_unstale":"2023-10-06T04:39:21.656202+0000","last_undegraded":"2023-10-06T04:39:21.656202+0000","last_fullsized":"2023-10-06T04:39:21.656202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:40.720886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.639474+0000","last_change":"2023-10-06T04:39:16.252554+0000","last_active":"2023-10-06T04:39:21.639474+0000","last_peered":"2023-10-06T04:39:21.639474+0000","last_clean":"2023-10-06T04:39:21.639474+0000","last_became_active":"2023-10-06T04:39:16.252225+0000","last_became_peered":"2023-10-06T04:39:16.252225+0000","last_unstale":"2023-10-06T04:39:21.639474+0000","last_undegraded":"2023-10-06T04:39:21.639474+0000","last_fullsized":"2023-10-06T04:39:21.639474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.280766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.633085+0000","last_change":"2023-10-06T04:39:20.644016+0000","last_active":"2023-10-06T04:39:21.633085+0000","last_peered":"2023-10-06T04:39:21.633085+0000","last_clean":"2023-10-06T04:39:21.633085+0000","last_became_active":"2023-10-06T04:39:20.643732+0000","last_became_peered":"2023-10-06T04:39:20.643732+0000","last_unstale":"2023-10-06T04:39:21.633085+0000","last_undegraded":"2023-10-06T04:39:21.633085+0000","last_fullsized":"2023-10-06T04:39:21.633085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:25.801442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.648739+0000","last_change":"2023-10-06T04:39:21.638573+0000","last_active":"2023-10-06T04:39:21.648739+0000","last_peered":"2023-10-06T04:39:21.648739+0000","last_clean":"2023-10-06T04:39:21.648739+0000","last_became_active":"2023-10-06T04:39:21.638300+0000","last_became_peered":"2023-10-06T04:39:21.638300+0000","last_unstale":"2023-10-06T04:39:21.648739+0000","last_undegraded":"2023-10-06T04:39:21.648739+0000","last_fullsized":"2023-10-06T04:39:21.648739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:23.201656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.630974+0000","last_change":"2023-10-06T04:39:16.253021+0000","last_active":"2023-10-06T04:39:21.630974+0000","last_peered":"2023-10-06T04:39:21.630974+0000","last_clean":"2023-10-06T04:39:21.630974+0000","last_became_active":"2023-10-06T04:39:16.252478+0000","last_became_peered":"2023-10-06T04:39:16.252478+0000","last_unstale":"2023-10-06T04:39:21.630974+0000","last_undegraded":"2023-10-06T04:39:21.630974+0000","last_fullsized":"2023-10-06T04:39:21.630974+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:07.439434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.628755+0000","last_change":"2023-10-06T04:39:20.642608+0000","last_active":"2023-10-06T04:39:21.628755+0000","last_peered":"2023-10-06T04:39:21.628755+0000","last_clean":"2023-10-06T04:39:21.628755+0000","last_became_active":"2023-10-06T04:39:20.642287+0000","last_became_peered":"2023-10-06T04:39:20.642287+0000","last_unstale":"2023-10-06T04:39:21.628755+0000","last_undegraded":"2023-10-06T04:39:21.628755+0000","last_fullsized":"2023-10-06T04:39:21.628755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.956516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.660666+0000","last_change":"2023-10-06T04:39:21.656717+0000","last_active":"2023-10-06T04:39:21.660666+0000","last_peered":"2023-10-06T04:39:21.660666+0000","last_clean":"2023-10-06T04:39:21.660666+0000","last_became_active":"2023-10-06T04:39:21.656373+0000","last_became_peered":"2023-10-06T04:39:21.656373+0000","last_unstale":"2023-10-06T04:39:21.660666+0000","last_undegraded":"2023-10-06T04:39:21.660666+0000","last_fullsized":"2023-10-06T04:39:21.660666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:51.885986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.630765+0000","last_change":"2023-10-06T04:39:15.587681+0000","last_active":"2023-10-06T04:39:21.630765+0000","last_peered":"2023-10-06T04:39:21.630765+0000","last_clean":"2023-10-06T04:39:21.630765+0000","last_became_active":"2023-10-06T04:39:15.587313+0000","last_became_peered":"2023-10-06T04:39:15.587313+0000","last_unstale":"2023-10-06T04:39:21.630765+0000","last_undegraded":"2023-10-06T04:39:21.630765+0000","last_fullsized":"2023-10-06T04:39:21.630765+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641010+0000","last_change":"2023-10-06T04:39:20.640831+0000","last_active":"2023-10-06T04:39:21.641010+0000","last_peered":"2023-10-06T04:39:21.641010+0000","last_clean":"2023-10-06T04:39:21.641010+0000","last_became_active":"2023-10-06T04:39:20.640545+0000","last_became_peered":"2023-10-06T04:39:20.640545+0000","last_unstale":"2023-10-06T04:39:21.641010+0000","last_undegraded":"2023-10-06T04:39:21.641010+0000","last_fullsized":"2023-10-06T04:39:21.641010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:41.984467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651879+0000","last_change":"2023-10-06T04:39:21.644674+0000","last_active":"2023-10-06T04:39:21.651879+0000","last_peered":"2023-10-06T04:39:21.651879+0000","last_clean":"2023-10-06T04:39:21.651879+0000","last_became_active":"2023-10-06T04:39:21.644407+0000","last_became_peered":"2023-10-06T04:39:21.644407+0000","last_unstale":"2023-10-06T04:39:21.651879+0000","last_undegraded":"2023-10-06T04:39:21.651879+0000","last_fullsized":"2023-10-06T04:39:21.651879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:44.939595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656564+0000","last_change":"2023-10-06T04:39:20.646257+0000","last_active":"2023-10-06T04:39:21.656564+0000","last_peered":"2023-10-06T04:39:21.656564+0000","last_clean":"2023-10-06T04:39:21.656564+0000","last_became_active":"2023-10-06T04:39:20.645914+0000","last_became_peered":"2023-10-06T04:39:20.645914+0000","last_unstale":"2023-10-06T04:39:21.656564+0000","last_undegraded":"2023-10-06T04:39:21.656564+0000","last_fullsized":"2023-10-06T04:39:21.656564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:20.086705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650672+0000","last_change":"2023-10-06T04:39:21.638557+0000","last_active":"2023-10-06T04:39:21.650672+0000","last_peered":"2023-10-06T04:39:21.650672+0000","last_clean":"2023-10-06T04:39:21.650672+0000","last_became_active":"2023-10-06T04:39:21.638310+0000","last_became_peered":"2023-10-06T04:39:21.638310+0000","last_unstale":"2023-10-06T04:39:21.650672+0000","last_undegraded":"2023-10-06T04:39:21.650672+0000","last_fullsized":"2023-10-06T04:39:21.650672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:26.810840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654092+0000","last_change":"2023-10-06T04:39:20.639506+0000","last_active":"2023-10-06T04:39:21.654092+0000","last_peered":"2023-10-06T04:39:21.654092+0000","last_clean":"2023-10-06T04:39:21.654092+0000","last_became_active":"2023-10-06T04:39:20.639218+0000","last_became_peered":"2023-10-06T04:39:20.639218+0000","last_unstale":"2023-10-06T04:39:21.654092+0000","last_undegraded":"2023-10-06T04:39:21.654092+0000","last_fullsized":"2023-10-06T04:39:21.654092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:34.035323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653773+0000","last_change":"2023-10-06T04:39:21.642939+0000","last_active":"2023-10-06T04:39:21.653773+0000","last_peered":"2023-10-06T04:39:21.653773+0000","last_clean":"2023-10-06T04:39:21.653773+0000","last_became_active":"2023-10-06T04:39:21.642669+0000","last_became_peered":"2023-10-06T04:39:21.642669+0000","last_unstale":"2023-10-06T04:39:21.653773+0000","last_undegraded":"2023-10-06T04:39:21.653773+0000","last_fullsized":"2023-10-06T04:39:21.653773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:35.969836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654879+0000","last_change":"2023-10-06T04:39:20.642036+0000","last_active":"2023-10-06T04:39:21.654879+0000","last_peered":"2023-10-06T04:39:21.654879+0000","last_clean":"2023-10-06T04:39:21.654879+0000","last_became_active":"2023-10-06T04:39:20.641779+0000","last_became_peered":"2023-10-06T04:39:20.641779+0000","last_unstale":"2023-10-06T04:39:21.654879+0000","last_undegraded":"2023-10-06T04:39:21.654879+0000","last_fullsized":"2023-10-06T04:39:21.654879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:25.801442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653650+0000","last_change":"2023-10-06T04:39:21.642305+0000","last_active":"2023-10-06T04:39:21.653650+0000","last_peered":"2023-10-06T04:39:21.653650+0000","last_clean":"2023-10-06T04:39:21.653650+0000","last_became_active":"2023-10-06T04:39:21.642047+0000","last_became_peered":"2023-10-06T04:39:21.642047+0000","last_unstale":"2023-10-06T04:39:21.653650+0000","last_undegraded":"2023-10-06T04:39:21.653650+0000","last_fullsized":"2023-10-06T04:39:21.653650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:46.146563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.645322+0000","last_change":"2023-10-06T04:39:20.638812+0000","last_active":"2023-10-06T04:39:21.645322+0000","last_peered":"2023-10-06T04:39:21.645322+0000","last_clean":"2023-10-06T04:39:21.645322+0000","last_became_active":"2023-10-06T04:39:20.638433+0000","last_became_peered":"2023-10-06T04:39:20.638433+0000","last_unstale":"2023-10-06T04:39:21.645322+0000","last_undegraded":"2023-10-06T04:39:21.645322+0000","last_fullsized":"2023-10-06T04:39:21.645322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:25.801442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641299+0000","last_change":"2023-10-06T04:39:21.639406+0000","last_active":"2023-10-06T04:39:21.641299+0000","last_peered":"2023-10-06T04:39:21.641299+0000","last_clean":"2023-10-06T04:39:21.641299+0000","last_became_active":"2023-10-06T04:39:21.639016+0000","last_became_peered":"2023-10-06T04:39:21.639016+0000","last_unstale":"2023-10-06T04:39:21.641299+0000","last_undegraded":"2023-10-06T04:39:21.641299+0000","last_fullsized":"2023-10-06T04:39:21.641299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:33.545272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657543+0000","last_change":"2023-10-06T04:39:20.644648+0000","last_active":"2023-10-06T04:39:21.657543+0000","last_peered":"2023-10-06T04:39:21.657543+0000","last_clean":"2023-10-06T04:39:21.657543+0000","last_became_active":"2023-10-06T04:39:20.644394+0000","last_became_peered":"2023-10-06T04:39:20.644394+0000","last_unstale":"2023-10-06T04:39:21.657543+0000","last_undegraded":"2023-10-06T04:39:21.657543+0000","last_fullsized":"2023-10-06T04:39:21.657543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:30:33.654378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653532+0000","last_change":"2023-10-06T04:39:21.641164+0000","last_active":"2023-10-06T04:39:21.653532+0000","last_peered":"2023-10-06T04:39:21.653532+0000","last_clean":"2023-10-06T04:39:21.653532+0000","last_became_active":"2023-10-06T04:39:21.640905+0000","last_became_peered":"2023-10-06T04:39:21.640905+0000","last_unstale":"2023-10-06T04:39:21.653532+0000","last_undegraded":"2023-10-06T04:39:21.653532+0000","last_fullsized":"2023-10-06T04:39:21.653532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:08.780680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650176+0000","last_change":"2023-10-06T04:39:21.640076+0000","last_active":"2023-10-06T04:39:21.650176+0000","last_peered":"2023-10-06T04:39:21.650176+0000","last_clean":"2023-10-06T04:39:21.650176+0000","last_became_active":"2023-10-06T04:39:21.639818+0000","last_became_peered":"2023-10-06T04:39:21.639818+0000","last_unstale":"2023-10-06T04:39:21.650176+0000","last_undegraded":"2023-10-06T04:39:21.650176+0000","last_fullsized":"2023-10-06T04:39:21.650176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:14.517515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641319+0000","last_change":"2023-10-06T04:39:21.639647+0000","last_active":"2023-10-06T04:39:21.641319+0000","last_peered":"2023-10-06T04:39:21.641319+0000","last_clean":"2023-10-06T04:39:21.641319+0000","last_became_active":"2023-10-06T04:39:21.639337+0000","last_became_peered":"2023-10-06T04:39:21.639337+0000","last_unstale":"2023-10-06T04:39:21.641319+0000","last_undegraded":"2023-10-06T04:39:21.641319+0000","last_fullsized":"2023-10-06T04:39:21.641319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:50.708331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653972+0000","last_change":"2023-10-06T04:39:21.647332+0000","last_active":"2023-10-06T04:39:21.653972+0000","last_peered":"2023-10-06T04:39:21.653972+0000","last_clean":"2023-10-06T04:39:21.653972+0000","last_became_active":"2023-10-06T04:39:21.647076+0000","last_became_peered":"2023-10-06T04:39:21.647076+0000","last_unstale":"2023-10-06T04:39:21.653972+0000","last_undegraded":"2023-10-06T04:39:21.653972+0000","last_fullsized":"2023-10-06T04:39:21.653972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:31.156663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653564+0000","last_change":"2023-10-06T04:39:21.647332+0000","last_active":"2023-10-06T04:39:21.653564+0000","last_peered":"2023-10-06T04:39:21.653564+0000","last_clean":"2023-10-06T04:39:21.653564+0000","last_became_active":"2023-10-06T04:39:21.647082+0000","last_became_peered":"2023-10-06T04:39:21.647082+0000","last_unstale":"2023-10-06T04:39:21.653564+0000","last_undegraded":"2023-10-06T04:39:21.653564+0000","last_fullsized":"2023-10-06T04:39:21.653564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:53.420342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653367+0000","last_change":"2023-10-06T04:39:21.646732+0000","last_active":"2023-10-06T04:39:21.653367+0000","last_peered":"2023-10-06T04:39:21.653367+0000","last_clean":"2023-10-06T04:39:21.653367+0000","last_became_active":"2023-10-06T04:39:21.646482+0000","last_became_peered":"2023-10-06T04:39:21.646482+0000","last_unstale":"2023-10-06T04:39:21.653367+0000","last_undegraded":"2023-10-06T04:39:21.653367+0000","last_fullsized":"2023-10-06T04:39:21.653367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:51.885986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":74184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":664552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":74738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":74184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6830000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5209999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.655}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":74274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":73455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:39:30.187 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:39:30.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.334+0000 7fc2f4c0c700 1 Processor -- start 2023-10-06T04:39:30.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.334+0000 7fc2f4c0c700 1 -- start start 2023-10-06T04:39:30.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.335+0000 7fc2f4c0c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f0068350 0x7fc2f0159720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.335+0000 7fc2f4c0c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f015b500 con 0x7fc2f0067eb0 2023-10-06T04:39:30.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.335+0000 7fc2f4c0c700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f015b7e0 con 0x7fc2f015aa00 2023-10-06T04:39:30.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.335+0000 7fc2f4c0c700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f015bac0 con 0x7fc2f0068350 2023-10-06T04:39:30.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.335+0000 7fc2edd9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc2f0067eb0 0x7fc2f0159010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60246/0 (socket says 172.21.15.112:60246) 2023-10-06T04:39:30.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.335+0000 7fc2edd9b700 1 -- 172.21.15.112:0/1519482932 learned_addr learned my addr 172.21.15.112:0/1519482932 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:30.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2eed9d700 1 --2- 172.21.15.112:0/1519482932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f0068350 0x7fc2f0159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2ed59a700 1 -- 172.21.15.112:0/1519482932 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892430023 0 0) 0x7fc2f015b500 con 0x7fc2f0067eb0 2023-10-06T04:39:30.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2ed59a700 1 -- 172.21.15.112:0/1519482932 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2d8003570 con 0x7fc2f0067eb0 2023-10-06T04:39:30.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2ed59a700 1 -- 172.21.15.112:0/1519482932 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 402321763 0 0) 0x7fc2d8003570 con 0x7fc2f0067eb0 2023-10-06T04:39:30.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2ed59a700 1 -- 172.21.15.112:0/1519482932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f0068350 msgr2=0x7fc2f0159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:30.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2ed59a700 1 --2- 172.21.15.112:0/1519482932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f0068350 0x7fc2f0159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2ed59a700 1 -- 172.21.15.112:0/1519482932 >> v1:172.21.15.179:6789/0 conn(0x7fc2f015aa00 legacy=0x7fc2f01585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2ed59a700 1 -- 172.21.15.112:0/1519482932 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f015bda0 con 0x7fc2f0067eb0 2023-10-06T04:39:30.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2ed59a700 1 -- 172.21.15.112:0/1519482932 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7fc2e4001470 con 0x7fc2f0067eb0 2023-10-06T04:39:30.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2ed59a700 1 -- 172.21.15.112:0/1519482932 >> v1:172.21.15.112:6789/0 conn(0x7fc2f0067eb0 legacy=0x7fc2f0159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2ed59a700 1 --2- 172.21.15.112:0/1519482932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f0068350 0x7fc2d8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2ed59a700 1 --2- 172.21.15.112:0/1519482932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2d8003fd0 0x7fc2d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2ed59a700 1 --2- 172.21.15.112:0/1519482932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d8004d50 0x7fc2d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2ed59a700 1 -- 172.21.15.112:0/1519482932 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f015bac0 con 0x7fc2d8003fd0 2023-10-06T04:39:30.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2ed59a700 1 -- 172.21.15.112:0/1519482932 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d800bb40 con 0x7fc2d8004d50 2023-10-06T04:39:30.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2ed59a700 1 -- 172.21.15.112:0/1519482932 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d800bd00 con 0x7fc2f0068350 2023-10-06T04:39:30.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2edd9b700 1 --2- 172.21.15.112:0/1519482932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2d8003fd0 0x7fc2d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2ee59c700 1 --2- 172.21.15.112:0/1519482932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f0068350 0x7fc2d8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2eed9d700 1 --2- 172.21.15.112:0/1519482932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d8004d50 0x7fc2d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2edd9b700 1 -- 172.21.15.112:0/1519482932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f0068350 msgr2=0x7fc2d8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:30.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2edd9b700 1 --2- 172.21.15.112:0/1519482932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f0068350 0x7fc2d8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2edd9b700 1 -- 172.21.15.112:0/1519482932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d8004d50 msgr2=0x7fc2d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:30.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2edd9b700 1 --2- 172.21.15.112:0/1519482932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d8004d50 0x7fc2d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2edd9b700 1 -- 172.21.15.112:0/1519482932 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d8003570 con 0x7fc2d8003fd0 2023-10-06T04:39:30.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2eed9d700 1 --2- 172.21.15.112:0/1519482932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d8004d50 0x7fc2d80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:30.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.336+0000 7fc2edd9b700 1 --2- 172.21.15.112:0/1519482932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2d8003fd0 0x7fc2d8004810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400c2d0 tx=0x7fc2f00c55e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692f52399ec2e542 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:30.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.337+0000 7fc2ed59a700 1 -- 172.21.15.112:0/1519482932 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e400cc00 con 0x7fc2d8003fd0 2023-10-06T04:39:30.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.337+0000 7fc2ed59a700 1 -- 172.21.15.112:0/1519482932 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e400cd60 con 0x7fc2d8003fd0 2023-10-06T04:39:30.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.337+0000 7fc2ed59a700 1 -- 172.21.15.112:0/1519482932 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4005b70 con 0x7fc2d8003fd0 2023-10-06T04:39:30.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.337+0000 7fc2f4c0c700 1 -- 172.21.15.112:0/1519482932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2d8003fd0 msgr2=0x7fc2d8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.337+0000 7fc2f4c0c700 1 --2- 172.21.15.112:0/1519482932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2d8003fd0 0x7fc2d8004810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400c2d0 tx=0x7fc2f00c55e0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.337+0000 7fc2eed9d700 1 -- 172.21.15.112:0/1519482932 reap_dead start 2023-10-06T04:39:30.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.337+0000 7fc2f4c0c700 1 -- 172.21.15.112:0/1519482932 shutdown_connections 2023-10-06T04:39:30.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.337+0000 7fc2f4c0c700 1 -- 172.21.15.112:0/1519482932 >> 172.21.15.112:0/1519482932 conn(0x7fc2f00ce5e0 msgr2=0x7fc2f00ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:30.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.337+0000 7fc2f4c0c700 1 -- 172.21.15.112:0/1519482932 shutdown_connections 2023-10-06T04:39:30.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.337+0000 7fc2f4c0c700 1 -- 172.21.15.112:0/1519482932 wait complete. 2023-10-06T04:39:30.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.338+0000 7fc2f4c0c700 1 Processor -- start 2023-10-06T04:39:30.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.338+0000 7fc2f4c0c700 1 -- start start 2023-10-06T04:39:30.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.339+0000 7fc2f4c0c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d8003fd0 0x7fc2f00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.339+0000 7fc2f4c0c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2f00a5540 0x7fc2f01543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.339+0000 7fc2f4c0c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f00ae110 0x7fc2f00ae560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.339+0000 7fc2f4c0c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00b1590 con 0x7fc2f00a5540 2023-10-06T04:39:30.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.339+0000 7fc2f4c0c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00b0bc0 con 0x7fc2d8003fd0 2023-10-06T04:39:30.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.339+0000 7fc2f4c0c700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00aeaa0 con 0x7fc2f00ae110 2023-10-06T04:39:30.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.339+0000 7fc2edd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2f00a5540 0x7fc2f01543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.339+0000 7fc2edd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2f00a5540 0x7fc2f01543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58346/0 (socket says 172.21.15.112:58346) 2023-10-06T04:39:30.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.339+0000 7fc2edd9b700 1 -- 172.21.15.112:0/245836436 learned_addr learned my addr 172.21.15.112:0/245836436 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:30.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.339+0000 7fc2ee59c700 1 --2- 172.21.15.112:0/245836436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d8003fd0 0x7fc2f00b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.339+0000 7fc2eed9d700 1 --2- 172.21.15.112:0/245836436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f00ae110 0x7fc2f00ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.339+0000 7fc2edd9b700 1 -- 172.21.15.112:0/245836436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f00ae110 msgr2=0x7fc2f00ae560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.339+0000 7fc2edd9b700 1 --2- 172.21.15.112:0/245836436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f00ae110 0x7fc2f00ae560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.339+0000 7fc2edd9b700 1 -- 172.21.15.112:0/245836436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d8003fd0 msgr2=0x7fc2f00b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.339+0000 7fc2edd9b700 1 --2- 172.21.15.112:0/245836436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d8003fd0 0x7fc2f00b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.339+0000 7fc2edd9b700 1 -- 172.21.15.112:0/245836436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f00b05b0 con 0x7fc2f00a5540 2023-10-06T04:39:30.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.339+0000 7fc2eed9d700 1 --2- 172.21.15.112:0/245836436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f00ae110 0x7fc2f00ae560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:30.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.339+0000 7fc2edd9b700 1 --2- 172.21.15.112:0/245836436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2f00a5540 0x7fc2f01543d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4005ba0 tx=0x7fc2e4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:30.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.339+0000 7fc2de7fc700 1 -- 172.21.15.112:0/245836436 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e400ced0 con 0x7fc2f00a5540 2023-10-06T04:39:30.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.340+0000 7fc2de7fc700 1 -- 172.21.15.112:0/245836436 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e4000fe0 con 0x7fc2f00a5540 2023-10-06T04:39:30.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.340+0000 7fc2f4c0c700 1 -- 172.21.15.112:0/245836436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f00b1aa0 con 0x7fc2f00a5540 2023-10-06T04:39:30.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.340+0000 7fc2de7fc700 1 -- 172.21.15.112:0/245836436 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4007510 con 0x7fc2f00a5540 2023-10-06T04:39:30.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.340+0000 7fc2f4c0c700 1 -- 172.21.15.112:0/245836436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f00b0850 con 0x7fc2f00a5540 2023-10-06T04:39:30.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.340+0000 7fc2f4c0c700 1 -- 172.21.15.112:0/245836436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f00b1590 con 0x7fc2f00a5540 2023-10-06T04:39:30.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.341+0000 7fc2de7fc700 1 -- 172.21.15.112:0/245836436 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc2e4019030 con 0x7fc2f00a5540 2023-10-06T04:39:30.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.341+0000 7fc2de7fc700 1 --2- 172.21.15.112:0/245836436 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc2d0066f30 0x7fc2d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.341+0000 7fc2de7fc700 1 -- 172.21.15.112:0/245836436 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc2e4085710 con 0x7fc2f00a5540 2023-10-06T04:39:30.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.341+0000 7fc2ee59c700 1 --2- 172.21.15.112:0/245836436 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc2d0066f30 0x7fc2d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.342+0000 7fc2ee59c700 1 --2- 172.21.15.112:0/245836436 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc2d0066f30 0x7fc2d00693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0000f80 tx=0x7fc2e00017d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:30.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.345+0000 7fc2de7fc700 1 -- 172.21.15.112:0/245836436 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2f00b1590 con 0x7fc2f00a5540 2023-10-06T04:39:30.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.525+0000 7fc2f4c0c700 1 -- 172.21.15.112:0/245836436 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc2f00b1590 con 0x7fc2d0066f30 2023-10-06T04:39:30.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.533+0000 7fc2de7fc700 1 -- 172.21.15.112:0/245836436 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286812 (secure 0 0 0) 0x7fc2f00b1590 con 0x7fc2d0066f30 2023-10-06T04:39:30.537 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:30.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.536+0000 7fc2f4c0c700 1 -- 172.21.15.112:0/245836436 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc2d0066f30 msgr2=0x7fc2d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.536+0000 7fc2f4c0c700 1 --2- 172.21.15.112:0/245836436 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc2d0066f30 0x7fc2d00693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0000f80 tx=0x7fc2e00017d0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.536+0000 7fc2f4c0c700 1 -- 172.21.15.112:0/245836436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2f00a5540 msgr2=0x7fc2f01543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.536+0000 7fc2f4c0c700 1 --2- 172.21.15.112:0/245836436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2f00a5540 0x7fc2f01543d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4005ba0 tx=0x7fc2e4015000 comp rx=0 tx=0).stop 2023-10-06T04:39:30.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.536+0000 7fc2f4c0c700 1 -- 172.21.15.112:0/245836436 shutdown_connections 2023-10-06T04:39:30.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.536+0000 7fc2f4c0c700 1 --2- 172.21.15.112:0/245836436 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc2d0066f30 0x7fc2d00693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.536+0000 7fc2f4c0c700 1 --2- 172.21.15.112:0/245836436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f00ae110 0x7fc2f00ae560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.536+0000 7fc2f4c0c700 1 --2- 172.21.15.112:0/245836436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d8003fd0 0x7fc2f00b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.536+0000 7fc2f4c0c700 1 --2- 172.21.15.112:0/245836436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2f00a5540 0x7fc2f01543d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.536+0000 7fc2f4c0c700 1 -- 172.21.15.112:0/245836436 >> 172.21.15.112:0/245836436 conn(0x7fc2f00ce5e0 msgr2=0x7fc2f01571a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:30.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.536+0000 7fc2f4c0c700 1 -- 172.21.15.112:0/245836436 shutdown_connections 2023-10-06T04:39:30.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.536+0000 7fc2f4c0c700 1 -- 172.21.15.112:0/245836436 wait complete. 2023-10-06T04:39:30.541 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-10-06T04:39:30.550 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-06T04:39:30.280424+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381124,"kb_used_data":2820,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593596,"statfs":{"total":773094113280,"available":770655842304,"internally_reserved":0,"allocated":2887680,"data_stored":1777467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.653654"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650779+0000","last_change":"2023-10-06T04:39:21.643644+0000","last_active":"2023-10-06T04:39:21.650779+0000","last_peered":"2023-10-06T04:39:21.650779+0000","last_clean":"2023-10-06T04:39:21.650779+0000","last_became_active":"2023-10-06T04:39:21.643389+0000","last_became_peered":"2023-10-06T04:39:21.643389+0000","last_unstale":"2023-10-06T04:39:21.650779+0000","last_undegraded":"2023-10-06T04:39:21.650779+0000","last_fullsized":"2023-10-06T04:39:21.650779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:14.965914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650050+0000","last_change":"2023-10-06T04:39:21.643603+0000","last_active":"2023-10-06T04:39:21.650050+0000","last_peered":"2023-10-06T04:39:21.650050+0000","last_clean":"2023-10-06T04:39:21.650050+0000","last_became_active":"2023-10-06T04:39:21.643357+0000","last_became_peered":"2023-10-06T04:39:21.643357+0000","last_unstale":"2023-10-06T04:39:21.650050+0000","last_undegraded":"2023-10-06T04:39:21.650050+0000","last_fullsized":"2023-10-06T04:39:21.650050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:15.667787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.659151+0000","last_change":"2023-10-06T04:39:21.656120+0000","last_active":"2023-10-06T04:39:21.659151+0000","last_peered":"2023-10-06T04:39:21.659151+0000","last_clean":"2023-10-06T04:39:21.659151+0000","last_became_active":"2023-10-06T04:39:21.655868+0000","last_became_peered":"2023-10-06T04:39:21.655868+0000","last_unstale":"2023-10-06T04:39:21.659151+0000","last_undegraded":"2023-10-06T04:39:21.659151+0000","last_fullsized":"2023-10-06T04:39:21.659151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:27.287173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651328+0000","last_change":"2023-10-06T04:39:21.647825+0000","last_active":"2023-10-06T04:39:21.651328+0000","last_peered":"2023-10-06T04:39:21.651328+0000","last_clean":"2023-10-06T04:39:21.651328+0000","last_became_active":"2023-10-06T04:39:21.647566+0000","last_became_peered":"2023-10-06T04:39:21.647566+0000","last_unstale":"2023-10-06T04:39:21.651328+0000","last_undegraded":"2023-10-06T04:39:21.651328+0000","last_fullsized":"2023-10-06T04:39:21.651328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:44.939595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.660715+0000","last_change":"2023-10-06T04:39:21.656951+0000","last_active":"2023-10-06T04:39:21.660715+0000","last_peered":"2023-10-06T04:39:21.660715+0000","last_clean":"2023-10-06T04:39:21.660715+0000","last_became_active":"2023-10-06T04:39:21.656705+0000","last_became_peered":"2023-10-06T04:39:21.656705+0000","last_unstale":"2023-10-06T04:39:21.660715+0000","last_undegraded":"2023-10-06T04:39:21.660715+0000","last_fullsized":"2023-10-06T04:39:21.660715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:30.052905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656740+0000","last_change":"2023-10-06T04:39:21.651985+0000","last_active":"2023-10-06T04:39:21.656740+0000","last_peered":"2023-10-06T04:39:21.656740+0000","last_clean":"2023-10-06T04:39:21.656740+0000","last_became_active":"2023-10-06T04:39:21.649488+0000","last_became_peered":"2023-10-06T04:39:21.649488+0000","last_unstale":"2023-10-06T04:39:21.656740+0000","last_undegraded":"2023-10-06T04:39:21.656740+0000","last_fullsized":"2023-10-06T04:39:21.656740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:48:03.866418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657637+0000","last_change":"2023-10-06T04:39:21.653127+0000","last_active":"2023-10-06T04:39:21.657637+0000","last_peered":"2023-10-06T04:39:21.657637+0000","last_clean":"2023-10-06T04:39:21.657637+0000","last_became_active":"2023-10-06T04:39:21.652573+0000","last_became_peered":"2023-10-06T04:39:21.652573+0000","last_unstale":"2023-10-06T04:39:21.657637+0000","last_undegraded":"2023-10-06T04:39:21.657637+0000","last_fullsized":"2023-10-06T04:39:21.657637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:02.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654141+0000","last_change":"2023-10-06T04:39:21.651949+0000","last_active":"2023-10-06T04:39:21.654141+0000","last_peered":"2023-10-06T04:39:21.654141+0000","last_clean":"2023-10-06T04:39:21.654141+0000","last_became_active":"2023-10-06T04:39:21.651637+0000","last_became_peered":"2023-10-06T04:39:21.651637+0000","last_unstale":"2023-10-06T04:39:21.654141+0000","last_undegraded":"2023-10-06T04:39:21.654141+0000","last_fullsized":"2023-10-06T04:39:21.654141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:02.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.663642+0000","last_change":"2023-10-06T04:39:21.658016+0000","last_active":"2023-10-06T04:39:21.663642+0000","last_peered":"2023-10-06T04:39:21.663642+0000","last_clean":"2023-10-06T04:39:21.663642+0000","last_became_active":"2023-10-06T04:39:21.657149+0000","last_became_peered":"2023-10-06T04:39:21.657149+0000","last_unstale":"2023-10-06T04:39:21.663642+0000","last_undegraded":"2023-10-06T04:39:21.663642+0000","last_fullsized":"2023-10-06T04:39:21.663642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:53.420342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.658796+0000","last_change":"2023-10-06T04:39:21.656885+0000","last_active":"2023-10-06T04:39:21.658796+0000","last_peered":"2023-10-06T04:39:21.658796+0000","last_clean":"2023-10-06T04:39:21.658796+0000","last_became_active":"2023-10-06T04:39:21.656652+0000","last_became_peered":"2023-10-06T04:39:21.656652+0000","last_unstale":"2023-10-06T04:39:21.658796+0000","last_undegraded":"2023-10-06T04:39:21.658796+0000","last_fullsized":"2023-10-06T04:39:21.658796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:37.183346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656795+0000","last_change":"2023-10-06T04:39:21.652303+0000","last_active":"2023-10-06T04:39:21.656795+0000","last_peered":"2023-10-06T04:39:21.656795+0000","last_clean":"2023-10-06T04:39:21.656795+0000","last_became_active":"2023-10-06T04:39:21.652040+0000","last_became_peered":"2023-10-06T04:39:21.652040+0000","last_unstale":"2023-10-06T04:39:21.656795+0000","last_undegraded":"2023-10-06T04:39:21.656795+0000","last_fullsized":"2023-10-06T04:39:21.656795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:50.708331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.658359+0000","last_change":"2023-10-06T04:39:21.655931+0000","last_active":"2023-10-06T04:39:21.658359+0000","last_peered":"2023-10-06T04:39:21.658359+0000","last_clean":"2023-10-06T04:39:21.658359+0000","last_became_active":"2023-10-06T04:39:21.655663+0000","last_became_peered":"2023-10-06T04:39:21.655663+0000","last_unstale":"2023-10-06T04:39:21.658359+0000","last_undegraded":"2023-10-06T04:39:21.658359+0000","last_fullsized":"2023-10-06T04:39:21.658359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:30:34.663775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650823+0000","last_change":"2023-10-06T04:39:21.643679+0000","last_active":"2023-10-06T04:39:21.650823+0000","last_peered":"2023-10-06T04:39:21.650823+0000","last_clean":"2023-10-06T04:39:21.650823+0000","last_became_active":"2023-10-06T04:39:21.643341+0000","last_became_peered":"2023-10-06T04:39:21.643341+0000","last_unstale":"2023-10-06T04:39:21.650823+0000","last_undegraded":"2023-10-06T04:39:21.650823+0000","last_fullsized":"2023-10-06T04:39:21.650823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:27.026173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653958+0000","last_change":"2023-10-06T04:39:21.651998+0000","last_active":"2023-10-06T04:39:21.653958+0000","last_peered":"2023-10-06T04:39:21.653958+0000","last_clean":"2023-10-06T04:39:21.653958+0000","last_became_active":"2023-10-06T04:39:21.651702+0000","last_became_peered":"2023-10-06T04:39:21.651702+0000","last_unstale":"2023-10-06T04:39:21.653958+0000","last_undegraded":"2023-10-06T04:39:21.653958+0000","last_fullsized":"2023-10-06T04:39:21.653958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:23.201656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657656+0000","last_change":"2023-10-06T04:39:21.653318+0000","last_active":"2023-10-06T04:39:21.657656+0000","last_peered":"2023-10-06T04:39:21.657656+0000","last_clean":"2023-10-06T04:39:21.657656+0000","last_became_active":"2023-10-06T04:39:21.652877+0000","last_became_peered":"2023-10-06T04:39:21.652877+0000","last_unstale":"2023-10-06T04:39:21.657656+0000","last_undegraded":"2023-10-06T04:39:21.657656+0000","last_fullsized":"2023-10-06T04:39:21.657656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:23.201656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656760+0000","last_change":"2023-10-06T04:39:21.649928+0000","last_active":"2023-10-06T04:39:21.656760+0000","last_peered":"2023-10-06T04:39:21.656760+0000","last_clean":"2023-10-06T04:39:21.656760+0000","last_became_active":"2023-10-06T04:39:21.649638+0000","last_became_peered":"2023-10-06T04:39:21.649638+0000","last_unstale":"2023-10-06T04:39:21.656760+0000","last_undegraded":"2023-10-06T04:39:21.656760+0000","last_fullsized":"2023-10-06T04:39:21.656760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:54.256525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.660798+0000","last_change":"2023-10-06T04:39:21.657715+0000","last_active":"2023-10-06T04:39:21.660798+0000","last_peered":"2023-10-06T04:39:21.660798+0000","last_clean":"2023-10-06T04:39:21.660798+0000","last_became_active":"2023-10-06T04:39:21.656464+0000","last_became_peered":"2023-10-06T04:39:21.656464+0000","last_unstale":"2023-10-06T04:39:21.660798+0000","last_undegraded":"2023-10-06T04:39:21.660798+0000","last_fullsized":"2023-10-06T04:39:21.660798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:37.183346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.658960+0000","last_change":"2023-10-06T04:39:21.655935+0000","last_active":"2023-10-06T04:39:21.658960+0000","last_peered":"2023-10-06T04:39:21.658960+0000","last_clean":"2023-10-06T04:39:21.658960+0000","last_became_active":"2023-10-06T04:39:21.655700+0000","last_became_peered":"2023-10-06T04:39:21.655700+0000","last_unstale":"2023-10-06T04:39:21.658960+0000","last_undegraded":"2023-10-06T04:39:21.658960+0000","last_fullsized":"2023-10-06T04:39:21.658960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:30.052905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650721+0000","last_change":"2023-10-06T04:39:21.642376+0000","last_active":"2023-10-06T04:39:21.650721+0000","last_peered":"2023-10-06T04:39:21.650721+0000","last_clean":"2023-10-06T04:39:21.650721+0000","last_became_active":"2023-10-06T04:39:21.642132+0000","last_became_peered":"2023-10-06T04:39:21.642132+0000","last_unstale":"2023-10-06T04:39:21.650721+0000","last_undegraded":"2023-10-06T04:39:21.650721+0000","last_fullsized":"2023-10-06T04:39:21.650721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:57:07.955415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657008+0000","last_change":"2023-10-06T04:39:21.651106+0000","last_active":"2023-10-06T04:39:21.657008+0000","last_peered":"2023-10-06T04:39:21.657008+0000","last_clean":"2023-10-06T04:39:21.657008+0000","last_became_active":"2023-10-06T04:39:21.650595+0000","last_became_peered":"2023-10-06T04:39:21.650595+0000","last_unstale":"2023-10-06T04:39:21.657008+0000","last_undegraded":"2023-10-06T04:39:21.657008+0000","last_fullsized":"2023-10-06T04:39:21.657008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:39.953564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657675+0000","last_change":"2023-10-06T04:39:21.654113+0000","last_active":"2023-10-06T04:39:21.657675+0000","last_peered":"2023-10-06T04:39:21.657675+0000","last_clean":"2023-10-06T04:39:21.657675+0000","last_became_active":"2023-10-06T04:39:21.653847+0000","last_became_peered":"2023-10-06T04:39:21.653847+0000","last_unstale":"2023-10-06T04:39:21.657675+0000","last_undegraded":"2023-10-06T04:39:21.657675+0000","last_fullsized":"2023-10-06T04:39:21.657675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:37.183346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.660671+0000","last_change":"2023-10-06T04:39:21.656316+0000","last_active":"2023-10-06T04:39:21.660671+0000","last_peered":"2023-10-06T04:39:21.660671+0000","last_clean":"2023-10-06T04:39:21.660671+0000","last_became_active":"2023-10-06T04:39:21.655902+0000","last_became_peered":"2023-10-06T04:39:21.655902+0000","last_unstale":"2023-10-06T04:39:21.660671+0000","last_undegraded":"2023-10-06T04:39:21.660671+0000","last_fullsized":"2023-10-06T04:39:21.660671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:23.201656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654941+0000","last_change":"2023-10-06T04:39:21.651840+0000","last_active":"2023-10-06T04:39:21.654941+0000","last_peered":"2023-10-06T04:39:21.654941+0000","last_clean":"2023-10-06T04:39:21.654941+0000","last_became_active":"2023-10-06T04:39:21.651580+0000","last_became_peered":"2023-10-06T04:39:21.651580+0000","last_unstale":"2023-10-06T04:39:21.654941+0000","last_undegraded":"2023-10-06T04:39:21.654941+0000","last_fullsized":"2023-10-06T04:39:21.654941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:56.545180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657569+0000","last_change":"2023-10-06T04:39:21.650621+0000","last_active":"2023-10-06T04:39:21.657569+0000","last_peered":"2023-10-06T04:39:21.657569+0000","last_clean":"2023-10-06T04:39:21.657569+0000","last_became_active":"2023-10-06T04:39:21.650370+0000","last_became_peered":"2023-10-06T04:39:21.650370+0000","last_unstale":"2023-10-06T04:39:21.657569+0000","last_undegraded":"2023-10-06T04:39:21.657569+0000","last_fullsized":"2023-10-06T04:39:21.657569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.886362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653273+0000","last_change":"2023-10-06T04:39:21.649124+0000","last_active":"2023-10-06T04:39:21.653273+0000","last_peered":"2023-10-06T04:39:21.653273+0000","last_clean":"2023-10-06T04:39:21.653273+0000","last_became_active":"2023-10-06T04:39:21.648871+0000","last_became_peered":"2023-10-06T04:39:21.648871+0000","last_unstale":"2023-10-06T04:39:21.653273+0000","last_undegraded":"2023-10-06T04:39:21.653273+0000","last_fullsized":"2023-10-06T04:39:21.653273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:15.667787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649304+0000","last_change":"2023-10-06T04:39:21.639325+0000","last_active":"2023-10-06T04:39:21.649304+0000","last_peered":"2023-10-06T04:39:21.649304+0000","last_clean":"2023-10-06T04:39:21.649304+0000","last_became_active":"2023-10-06T04:39:21.639068+0000","last_became_peered":"2023-10-06T04:39:21.639068+0000","last_unstale":"2023-10-06T04:39:21.649304+0000","last_undegraded":"2023-10-06T04:39:21.649304+0000","last_fullsized":"2023-10-06T04:39:21.649304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:52.077624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651949+0000","last_change":"2023-10-06T04:39:21.646735+0000","last_active":"2023-10-06T04:39:21.651949+0000","last_peered":"2023-10-06T04:39:21.651949+0000","last_clean":"2023-10-06T04:39:21.651949+0000","last_became_active":"2023-10-06T04:39:21.646325+0000","last_became_peered":"2023-10-06T04:39:21.646325+0000","last_unstale":"2023-10-06T04:39:21.651949+0000","last_undegraded":"2023-10-06T04:39:21.651949+0000","last_fullsized":"2023-10-06T04:39:21.651949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.886362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.652192+0000","last_change":"2023-10-06T04:39:20.642499+0000","last_active":"2023-10-06T04:39:21.652192+0000","last_peered":"2023-10-06T04:39:21.652192+0000","last_clean":"2023-10-06T04:39:21.652192+0000","last_became_active":"2023-10-06T04:39:20.642246+0000","last_became_peered":"2023-10-06T04:39:20.642246+0000","last_unstale":"2023-10-06T04:39:21.652192+0000","last_undegraded":"2023-10-06T04:39:21.652192+0000","last_fullsized":"2023-10-06T04:39:21.652192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.956516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649570+0000","last_change":"2023-10-06T04:39:21.644626+0000","last_active":"2023-10-06T04:39:21.649570+0000","last_peered":"2023-10-06T04:39:21.649570+0000","last_clean":"2023-10-06T04:39:21.649570+0000","last_became_active":"2023-10-06T04:39:21.644333+0000","last_became_peered":"2023-10-06T04:39:21.644333+0000","last_unstale":"2023-10-06T04:39:21.649570+0000","last_undegraded":"2023-10-06T04:39:21.649570+0000","last_fullsized":"2023-10-06T04:39:21.649570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:54.256525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.628179+0000","last_change":"2023-10-06T04:39:20.639697+0000","last_active":"2023-10-06T04:39:21.628179+0000","last_peered":"2023-10-06T04:39:21.628179+0000","last_clean":"2023-10-06T04:39:21.628179+0000","last_became_active":"2023-10-06T04:39:20.639431+0000","last_became_peered":"2023-10-06T04:39:20.639431+0000","last_unstale":"2023-10-06T04:39:21.628179+0000","last_undegraded":"2023-10-06T04:39:21.628179+0000","last_fullsized":"2023-10-06T04:39:21.628179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:20.086705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.663680+0000","last_change":"2023-10-06T04:39:21.659222+0000","last_active":"2023-10-06T04:39:21.663680+0000","last_peered":"2023-10-06T04:39:21.663680+0000","last_clean":"2023-10-06T04:39:21.663680+0000","last_became_active":"2023-10-06T04:39:21.659030+0000","last_became_peered":"2023-10-06T04:39:21.659030+0000","last_unstale":"2023-10-06T04:39:21.663680+0000","last_undegraded":"2023-10-06T04:39:21.663680+0000","last_fullsized":"2023-10-06T04:39:21.663680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.886362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.636144+0000","last_change":"2023-10-06T04:39:20.642433+0000","last_active":"2023-10-06T04:39:21.636144+0000","last_peered":"2023-10-06T04:39:21.636144+0000","last_clean":"2023-10-06T04:39:21.636144+0000","last_became_active":"2023-10-06T04:39:20.640984+0000","last_became_peered":"2023-10-06T04:39:20.640984+0000","last_unstale":"2023-10-06T04:39:21.636144+0000","last_undegraded":"2023-10-06T04:39:21.636144+0000","last_fullsized":"2023-10-06T04:39:21.636144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:41.984467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651186+0000","last_change":"2023-10-06T04:39:21.643087+0000","last_active":"2023-10-06T04:39:21.651186+0000","last_peered":"2023-10-06T04:39:21.651186+0000","last_clean":"2023-10-06T04:39:21.651186+0000","last_became_active":"2023-10-06T04:39:21.642825+0000","last_became_peered":"2023-10-06T04:39:21.642825+0000","last_unstale":"2023-10-06T04:39:21.651186+0000","last_undegraded":"2023-10-06T04:39:21.651186+0000","last_fullsized":"2023-10-06T04:39:21.651186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:38.337736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.642745+0000","last_change":"2023-10-06T04:39:20.644712+0000","last_active":"2023-10-06T04:39:21.642745+0000","last_peered":"2023-10-06T04:39:21.642745+0000","last_clean":"2023-10-06T04:39:21.642745+0000","last_became_active":"2023-10-06T04:39:20.644415+0000","last_became_peered":"2023-10-06T04:39:20.644415+0000","last_unstale":"2023-10-06T04:39:21.642745+0000","last_undegraded":"2023-10-06T04:39:21.642745+0000","last_fullsized":"2023-10-06T04:39:21.642745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.956516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641262+0000","last_change":"2023-10-06T04:39:21.638794+0000","last_active":"2023-10-06T04:39:21.641262+0000","last_peered":"2023-10-06T04:39:21.641262+0000","last_clean":"2023-10-06T04:39:21.641262+0000","last_became_active":"2023-10-06T04:39:21.638555+0000","last_became_peered":"2023-10-06T04:39:21.638555+0000","last_unstale":"2023-10-06T04:39:21.641262+0000","last_undegraded":"2023-10-06T04:39:21.641262+0000","last_fullsized":"2023-10-06T04:39:21.641262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:48.632302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.639947+0000","last_change":"2023-10-06T04:39:20.643255+0000","last_active":"2023-10-06T04:39:21.639947+0000","last_peered":"2023-10-06T04:39:21.639947+0000","last_clean":"2023-10-06T04:39:21.639947+0000","last_became_active":"2023-10-06T04:39:20.642932+0000","last_became_peered":"2023-10-06T04:39:20.642932+0000","last_unstale":"2023-10-06T04:39:21.639947+0000","last_undegraded":"2023-10-06T04:39:21.639947+0000","last_fullsized":"2023-10-06T04:39:21.639947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:20.086705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649490+0000","last_change":"2023-10-06T04:39:21.643526+0000","last_active":"2023-10-06T04:39:21.649490+0000","last_peered":"2023-10-06T04:39:21.649490+0000","last_clean":"2023-10-06T04:39:21.649490+0000","last_became_active":"2023-10-06T04:39:21.643270+0000","last_became_peered":"2023-10-06T04:39:21.643270+0000","last_unstale":"2023-10-06T04:39:21.649490+0000","last_undegraded":"2023-10-06T04:39:21.649490+0000","last_fullsized":"2023-10-06T04:39:21.649490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:47.582081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654054+0000","last_change":"2023-10-06T04:39:20.647036+0000","last_active":"2023-10-06T04:39:21.654054+0000","last_peered":"2023-10-06T04:39:21.654054+0000","last_clean":"2023-10-06T04:39:21.654054+0000","last_became_active":"2023-10-06T04:39:20.646772+0000","last_became_peered":"2023-10-06T04:39:20.646772+0000","last_unstale":"2023-10-06T04:39:21.654054+0000","last_undegraded":"2023-10-06T04:39:21.654054+0000","last_fullsized":"2023-10-06T04:39:21.654054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:13.508117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653264+0000","last_change":"2023-10-06T04:39:21.648922+0000","last_active":"2023-10-06T04:39:21.653264+0000","last_peered":"2023-10-06T04:39:21.653264+0000","last_clean":"2023-10-06T04:39:21.653264+0000","last_became_active":"2023-10-06T04:39:21.648665+0000","last_became_peered":"2023-10-06T04:39:21.648665+0000","last_unstale":"2023-10-06T04:39:21.653264+0000","last_undegraded":"2023-10-06T04:39:21.653264+0000","last_fullsized":"2023-10-06T04:39:21.653264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:35:46.706541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.659518+0000","last_change":"2023-10-06T04:39:20.644243+0000","last_active":"2023-10-06T04:39:21.659518+0000","last_peered":"2023-10-06T04:39:21.659518+0000","last_clean":"2023-10-06T04:39:21.659518+0000","last_became_active":"2023-10-06T04:39:20.643934+0000","last_became_peered":"2023-10-06T04:39:20.643934+0000","last_unstale":"2023-10-06T04:39:21.659518+0000","last_undegraded":"2023-10-06T04:39:21.659518+0000","last_fullsized":"2023-10-06T04:39:21.659518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:30:33.654378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653554+0000","last_change":"2023-10-06T04:39:21.641258+0000","last_active":"2023-10-06T04:39:21.653554+0000","last_peered":"2023-10-06T04:39:21.653554+0000","last_clean":"2023-10-06T04:39:21.653554+0000","last_became_active":"2023-10-06T04:39:21.640963+0000","last_became_peered":"2023-10-06T04:39:21.640963+0000","last_unstale":"2023-10-06T04:39:21.653554+0000","last_undegraded":"2023-10-06T04:39:21.653554+0000","last_fullsized":"2023-10-06T04:39:21.653554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:30.317889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656880+0000","last_change":"2023-10-06T04:39:20.649614+0000","last_active":"2023-10-06T04:39:21.656880+0000","last_peered":"2023-10-06T04:39:21.656880+0000","last_clean":"2023-10-06T04:39:21.656880+0000","last_became_active":"2023-10-06T04:39:20.649327+0000","last_became_peered":"2023-10-06T04:39:20.649327+0000","last_unstale":"2023-10-06T04:39:21.656880+0000","last_undegraded":"2023-10-06T04:39:21.656880+0000","last_fullsized":"2023-10-06T04:39:21.656880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:34.104262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649589+0000","last_change":"2023-10-06T04:39:21.644535+0000","last_active":"2023-10-06T04:39:21.649589+0000","last_peered":"2023-10-06T04:39:21.649589+0000","last_clean":"2023-10-06T04:39:21.649589+0000","last_became_active":"2023-10-06T04:39:21.644260+0000","last_became_peered":"2023-10-06T04:39:21.644260+0000","last_unstale":"2023-10-06T04:39:21.649589+0000","last_undegraded":"2023-10-06T04:39:21.649589+0000","last_fullsized":"2023-10-06T04:39:21.649589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:30.052905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.643005+0000","last_change":"2023-10-06T04:39:20.641086+0000","last_active":"2023-10-06T04:39:21.643005+0000","last_peered":"2023-10-06T04:39:21.643005+0000","last_clean":"2023-10-06T04:39:21.643005+0000","last_became_active":"2023-10-06T04:39:20.640581+0000","last_became_peered":"2023-10-06T04:39:20.640581+0000","last_unstale":"2023-10-06T04:39:21.643005+0000","last_undegraded":"2023-10-06T04:39:21.643005+0000","last_fullsized":"2023-10-06T04:39:21.643005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:34.035323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651928+0000","last_change":"2023-10-06T04:39:21.646546+0000","last_active":"2023-10-06T04:39:21.651928+0000","last_peered":"2023-10-06T04:39:21.651928+0000","last_clean":"2023-10-06T04:39:21.651928+0000","last_became_active":"2023-10-06T04:39:21.645987+0000","last_became_peered":"2023-10-06T04:39:21.645987+0000","last_unstale":"2023-10-06T04:39:21.651928+0000","last_undegraded":"2023-10-06T04:39:21.651928+0000","last_fullsized":"2023-10-06T04:39:21.651928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:52.077624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641875+0000","last_change":"2023-10-06T04:39:20.648674+0000","last_active":"2023-10-06T04:39:21.641875+0000","last_peered":"2023-10-06T04:39:21.641875+0000","last_clean":"2023-10-06T04:39:21.641875+0000","last_became_active":"2023-10-06T04:39:20.648394+0000","last_became_peered":"2023-10-06T04:39:20.648394+0000","last_unstale":"2023-10-06T04:39:21.641875+0000","last_undegraded":"2023-10-06T04:39:21.641875+0000","last_fullsized":"2023-10-06T04:39:21.641875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:15.387433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.660625+0000","last_change":"2023-10-06T04:39:21.656280+0000","last_active":"2023-10-06T04:39:21.660625+0000","last_peered":"2023-10-06T04:39:21.660625+0000","last_clean":"2023-10-06T04:39:21.660625+0000","last_became_active":"2023-10-06T04:39:21.655973+0000","last_became_peered":"2023-10-06T04:39:21.655973+0000","last_unstale":"2023-10-06T04:39:21.660625+0000","last_undegraded":"2023-10-06T04:39:21.660625+0000","last_fullsized":"2023-10-06T04:39:21.660625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:56.545180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650234+0000","last_change":"2023-10-06T04:39:20.641641+0000","last_active":"2023-10-06T04:39:21.650234+0000","last_peered":"2023-10-06T04:39:21.650234+0000","last_clean":"2023-10-06T04:39:21.650234+0000","last_became_active":"2023-10-06T04:39:20.641335+0000","last_became_peered":"2023-10-06T04:39:20.641335+0000","last_unstale":"2023-10-06T04:39:21.650234+0000","last_undegraded":"2023-10-06T04:39:21.650234+0000","last_fullsized":"2023-10-06T04:39:21.650234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.956516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649486+0000","last_change":"2023-10-06T04:39:21.642393+0000","last_active":"2023-10-06T04:39:21.649486+0000","last_peered":"2023-10-06T04:39:21.649486+0000","last_clean":"2023-10-06T04:39:21.649486+0000","last_became_active":"2023-10-06T04:39:21.641909+0000","last_became_peered":"2023-10-06T04:39:21.641909+0000","last_unstale":"2023-10-06T04:39:21.649486+0000","last_undegraded":"2023-10-06T04:39:21.649486+0000","last_fullsized":"2023-10-06T04:39:21.649486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:02.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656881+0000","last_change":"2023-10-06T04:39:20.648860+0000","last_active":"2023-10-06T04:39:21.656881+0000","last_peered":"2023-10-06T04:39:21.656881+0000","last_clean":"2023-10-06T04:39:21.656881+0000","last_became_active":"2023-10-06T04:39:20.648534+0000","last_became_peered":"2023-10-06T04:39:20.648534+0000","last_unstale":"2023-10-06T04:39:21.656881+0000","last_undegraded":"2023-10-06T04:39:21.656881+0000","last_fullsized":"2023-10-06T04:39:21.656881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:02.150888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651553+0000","last_change":"2023-10-06T04:39:21.644510+0000","last_active":"2023-10-06T04:39:21.651553+0000","last_peered":"2023-10-06T04:39:21.651553+0000","last_clean":"2023-10-06T04:39:21.651553+0000","last_became_active":"2023-10-06T04:39:21.644240+0000","last_became_peered":"2023-10-06T04:39:21.644240+0000","last_unstale":"2023-10-06T04:39:21.651553+0000","last_undegraded":"2023-10-06T04:39:21.651553+0000","last_fullsized":"2023-10-06T04:39:21.651553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:51.885986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654601+0000","last_change":"2023-10-06T04:39:20.649002+0000","last_active":"2023-10-06T04:39:21.654601+0000","last_peered":"2023-10-06T04:39:21.654601+0000","last_clean":"2023-10-06T04:39:21.654601+0000","last_became_active":"2023-10-06T04:39:20.648668+0000","last_became_peered":"2023-10-06T04:39:20.648668+0000","last_unstale":"2023-10-06T04:39:21.654601+0000","last_undegraded":"2023-10-06T04:39:21.654601+0000","last_fullsized":"2023-10-06T04:39:21.654601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:37.328339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650007+0000","last_change":"2023-10-06T04:39:21.636412+0000","last_active":"2023-10-06T04:39:21.650007+0000","last_peered":"2023-10-06T04:39:21.650007+0000","last_clean":"2023-10-06T04:39:21.650007+0000","last_became_active":"2023-10-06T04:39:21.636129+0000","last_became_peered":"2023-10-06T04:39:21.636129+0000","last_unstale":"2023-10-06T04:39:21.650007+0000","last_undegraded":"2023-10-06T04:39:21.650007+0000","last_fullsized":"2023-10-06T04:39:21.650007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:23.201656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.652225+0000","last_change":"2023-10-06T04:39:20.644212+0000","last_active":"2023-10-06T04:39:21.652225+0000","last_peered":"2023-10-06T04:39:21.652225+0000","last_clean":"2023-10-06T04:39:21.652225+0000","last_became_active":"2023-10-06T04:39:20.643961+0000","last_became_peered":"2023-10-06T04:39:20.643961+0000","last_unstale":"2023-10-06T04:39:21.652225+0000","last_undegraded":"2023-10-06T04:39:21.652225+0000","last_fullsized":"2023-10-06T04:39:21.652225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:43.930198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650010+0000","last_change":"2023-10-06T04:39:21.641026+0000","last_active":"2023-10-06T04:39:21.650010+0000","last_peered":"2023-10-06T04:39:21.650010+0000","last_clean":"2023-10-06T04:39:21.650010+0000","last_became_active":"2023-10-06T04:39:21.640757+0000","last_became_peered":"2023-10-06T04:39:21.640757+0000","last_unstale":"2023-10-06T04:39:21.650010+0000","last_undegraded":"2023-10-06T04:39:21.650010+0000","last_fullsized":"2023-10-06T04:39:21.650010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:35.113660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.639626+0000","last_change":"2023-10-06T04:39:20.637507+0000","last_active":"2023-10-06T04:39:21.639626+0000","last_peered":"2023-10-06T04:39:21.639626+0000","last_clean":"2023-10-06T04:39:21.639626+0000","last_became_active":"2023-10-06T04:39:20.637209+0000","last_became_peered":"2023-10-06T04:39:20.637209+0000","last_unstale":"2023-10-06T04:39:21.639626+0000","last_undegraded":"2023-10-06T04:39:21.639626+0000","last_fullsized":"2023-10-06T04:39:21.639626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:30:33.654378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654743+0000","last_change":"2023-10-06T04:39:21.652401+0000","last_active":"2023-10-06T04:39:21.654743+0000","last_peered":"2023-10-06T04:39:21.654743+0000","last_clean":"2023-10-06T04:39:21.654743+0000","last_became_active":"2023-10-06T04:39:21.652150+0000","last_became_peered":"2023-10-06T04:39:21.652150+0000","last_unstale":"2023-10-06T04:39:21.654743+0000","last_undegraded":"2023-10-06T04:39:21.654743+0000","last_fullsized":"2023-10-06T04:39:21.654743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:02.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651501+0000","last_change":"2023-10-06T04:39:20.643661+0000","last_active":"2023-10-06T04:39:21.651501+0000","last_peered":"2023-10-06T04:39:21.651501+0000","last_clean":"2023-10-06T04:39:21.651501+0000","last_became_active":"2023-10-06T04:39:20.643353+0000","last_became_peered":"2023-10-06T04:39:20.643353+0000","last_unstale":"2023-10-06T04:39:21.651501+0000","last_undegraded":"2023-10-06T04:39:21.651501+0000","last_fullsized":"2023-10-06T04:39:21.651501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:37.328339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656988+0000","last_change":"2023-10-06T04:39:21.650918+0000","last_active":"2023-10-06T04:39:21.656988+0000","last_peered":"2023-10-06T04:39:21.656988+0000","last_clean":"2023-10-06T04:39:21.656988+0000","last_became_active":"2023-10-06T04:39:21.650308+0000","last_became_peered":"2023-10-06T04:39:21.650308+0000","last_unstale":"2023-10-06T04:39:21.656988+0000","last_undegraded":"2023-10-06T04:39:21.656988+0000","last_fullsized":"2023-10-06T04:39:21.656988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:54.734766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.631765+0000","last_change":"2023-10-06T04:39:20.643726+0000","last_active":"2023-10-06T04:39:21.631765+0000","last_peered":"2023-10-06T04:39:21.631765+0000","last_clean":"2023-10-06T04:39:21.631765+0000","last_became_active":"2023-10-06T04:39:20.643431+0000","last_became_peered":"2023-10-06T04:39:20.643431+0000","last_unstale":"2023-10-06T04:39:21.631765+0000","last_undegraded":"2023-10-06T04:39:21.631765+0000","last_fullsized":"2023-10-06T04:39:21.631765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:26.016776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.659132+0000","last_change":"2023-10-06T04:39:21.656050+0000","last_active":"2023-10-06T04:39:21.659132+0000","last_peered":"2023-10-06T04:39:21.659132+0000","last_clean":"2023-10-06T04:39:21.659132+0000","last_became_active":"2023-10-06T04:39:21.655770+0000","last_became_peered":"2023-10-06T04:39:21.655770+0000","last_unstale":"2023-10-06T04:39:21.659132+0000","last_undegraded":"2023-10-06T04:39:21.659132+0000","last_fullsized":"2023-10-06T04:39:21.659132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:48.632302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.632742+0000","last_change":"2023-10-06T04:39:20.646573+0000","last_active":"2023-10-06T04:39:21.632742+0000","last_peered":"2023-10-06T04:39:21.632742+0000","last_clean":"2023-10-06T04:39:21.632742+0000","last_became_active":"2023-10-06T04:39:20.646304+0000","last_became_peered":"2023-10-06T04:39:20.646304+0000","last_unstale":"2023-10-06T04:39:21.632742+0000","last_undegraded":"2023-10-06T04:39:21.632742+0000","last_fullsized":"2023-10-06T04:39:21.632742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:34.035323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653927+0000","last_change":"2023-10-06T04:39:21.647116+0000","last_active":"2023-10-06T04:39:21.653927+0000","last_peered":"2023-10-06T04:39:21.653927+0000","last_clean":"2023-10-06T04:39:21.653927+0000","last_became_active":"2023-10-06T04:39:21.646843+0000","last_became_peered":"2023-10-06T04:39:21.646843+0000","last_unstale":"2023-10-06T04:39:21.653927+0000","last_undegraded":"2023-10-06T04:39:21.653927+0000","last_fullsized":"2023-10-06T04:39:21.653927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:44.744728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.636029+0000","last_change":"2023-10-06T04:39:20.643002+0000","last_active":"2023-10-06T04:39:21.636029+0000","last_peered":"2023-10-06T04:39:21.636029+0000","last_clean":"2023-10-06T04:39:21.636029+0000","last_became_active":"2023-10-06T04:39:20.642751+0000","last_became_peered":"2023-10-06T04:39:20.642751+0000","last_unstale":"2023-10-06T04:39:21.636029+0000","last_undegraded":"2023-10-06T04:39:21.636029+0000","last_fullsized":"2023-10-06T04:39:21.636029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:34.035323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651772+0000","last_change":"2023-10-06T04:39:21.644991+0000","last_active":"2023-10-06T04:39:21.651772+0000","last_peered":"2023-10-06T04:39:21.651772+0000","last_clean":"2023-10-06T04:39:21.651772+0000","last_became_active":"2023-10-06T04:39:21.644463+0000","last_became_peered":"2023-10-06T04:39:21.644463+0000","last_unstale":"2023-10-06T04:39:21.651772+0000","last_undegraded":"2023-10-06T04:39:21.651772+0000","last_fullsized":"2023-10-06T04:39:21.651772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.886362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.646559+0000","last_change":"2023-10-06T04:39:20.644886+0000","last_active":"2023-10-06T04:39:21.646559+0000","last_peered":"2023-10-06T04:39:21.646559+0000","last_clean":"2023-10-06T04:39:21.646559+0000","last_became_active":"2023-10-06T04:39:20.644539+0000","last_became_peered":"2023-10-06T04:39:20.644539+0000","last_unstale":"2023-10-06T04:39:21.646559+0000","last_undegraded":"2023-10-06T04:39:21.646559+0000","last_fullsized":"2023-10-06T04:39:21.646559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.956516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.636207+0000","last_change":"2023-10-06T04:39:16.067723+0000","last_active":"2023-10-06T04:39:21.636207+0000","last_peered":"2023-10-06T04:39:21.636207+0000","last_clean":"2023-10-06T04:39:21.636207+0000","last_became_active":"2023-10-06T04:39:16.067325+0000","last_became_peered":"2023-10-06T04:39:16.067325+0000","last_unstale":"2023-10-06T04:39:21.636207+0000","last_undegraded":"2023-10-06T04:39:21.636207+0000","last_fullsized":"2023-10-06T04:39:21.636207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.649652+0000","last_change":"2023-10-06T04:39:21.645095+0000","last_active":"2023-10-06T04:39:21.649652+0000","last_peered":"2023-10-06T04:39:21.649652+0000","last_clean":"2023-10-06T04:39:21.649652+0000","last_became_active":"2023-10-06T04:39:21.643941+0000","last_became_peered":"2023-10-06T04:39:21.643941+0000","last_unstale":"2023-10-06T04:39:21.649652+0000","last_undegraded":"2023-10-06T04:39:21.649652+0000","last_fullsized":"2023-10-06T04:39:21.649652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:37.183346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.636787+0000","last_change":"2023-10-06T04:39:15.592391+0000","last_active":"2023-10-06T04:39:21.636787+0000","last_peered":"2023-10-06T04:39:21.636787+0000","last_clean":"2023-10-06T04:39:21.636787+0000","last_became_active":"2023-10-06T04:39:15.592094+0000","last_became_peered":"2023-10-06T04:39:15.592094+0000","last_unstale":"2023-10-06T04:39:21.636787+0000","last_undegraded":"2023-10-06T04:39:21.636787+0000","last_fullsized":"2023-10-06T04:39:21.636787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.280766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:39:23.917747+0000","last_change":"2023-10-06T04:39:20.641845+0000","last_active":"2023-10-06T04:39:23.917747+0000","last_peered":"2023-10-06T04:39:23.917747+0000","last_clean":"2023-10-06T04:39:23.917747+0000","last_became_active":"2023-10-06T04:39:20.641582+0000","last_became_peered":"2023-10-06T04:39:20.641582+0000","last_unstale":"2023-10-06T04:39:23.917747+0000","last_undegraded":"2023-10-06T04:39:23.917747+0000","last_fullsized":"2023-10-06T04:39:23.917747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:25.801442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650028+0000","last_change":"2023-10-06T04:39:21.640130+0000","last_active":"2023-10-06T04:39:21.650028+0000","last_peered":"2023-10-06T04:39:21.650028+0000","last_clean":"2023-10-06T04:39:21.650028+0000","last_became_active":"2023-10-06T04:39:21.639874+0000","last_became_peered":"2023-10-06T04:39:21.639874+0000","last_unstale":"2023-10-06T04:39:21.650028+0000","last_undegraded":"2023-10-06T04:39:21.650028+0000","last_fullsized":"2023-10-06T04:39:21.650028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:33.545272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.628189+0000","last_change":"2023-10-06T04:39:15.585112+0000","last_active":"2023-10-06T04:39:21.628189+0000","last_peered":"2023-10-06T04:39:21.628189+0000","last_clean":"2023-10-06T04:39:21.628189+0000","last_became_active":"2023-10-06T04:39:15.584853+0000","last_became_peered":"2023-10-06T04:39:15.584853+0000","last_unstale":"2023-10-06T04:39:21.628189+0000","last_undegraded":"2023-10-06T04:39:21.628189+0000","last_fullsized":"2023-10-06T04:39:21.628189+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641467+0000","last_change":"2023-10-06T04:39:15.588017+0000","last_active":"2023-10-06T04:39:21.641467+0000","last_peered":"2023-10-06T04:39:21.641467+0000","last_clean":"2023-10-06T04:39:21.641467+0000","last_became_active":"2023-10-06T04:39:15.586771+0000","last_became_peered":"2023-10-06T04:39:15.586771+0000","last_unstale":"2023-10-06T04:39:21.641467+0000","last_undegraded":"2023-10-06T04:39:21.641467+0000","last_fullsized":"2023-10-06T04:39:21.641467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:35.225282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641917+0000","last_change":"2023-10-06T04:39:20.646203+0000","last_active":"2023-10-06T04:39:21.641917+0000","last_peered":"2023-10-06T04:39:21.641917+0000","last_clean":"2023-10-06T04:39:21.641917+0000","last_became_active":"2023-10-06T04:39:20.645902+0000","last_became_peered":"2023-10-06T04:39:20.645902+0000","last_unstale":"2023-10-06T04:39:21.641917+0000","last_undegraded":"2023-10-06T04:39:21.641917+0000","last_fullsized":"2023-10-06T04:39:21.641917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:26.016776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.660606+0000","last_change":"2023-10-06T04:39:21.656264+0000","last_active":"2023-10-06T04:39:21.660606+0000","last_peered":"2023-10-06T04:39:21.660606+0000","last_clean":"2023-10-06T04:39:21.660606+0000","last_became_active":"2023-10-06T04:39:21.655944+0000","last_became_peered":"2023-10-06T04:39:21.655944+0000","last_unstale":"2023-10-06T04:39:21.660606+0000","last_undegraded":"2023-10-06T04:39:21.660606+0000","last_fullsized":"2023-10-06T04:39:21.660606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:47.582081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641321+0000","last_change":"2023-10-06T04:39:16.252521+0000","last_active":"2023-10-06T04:39:21.641321+0000","last_peered":"2023-10-06T04:39:21.641321+0000","last_clean":"2023-10-06T04:39:21.641321+0000","last_became_active":"2023-10-06T04:39:16.252245+0000","last_became_peered":"2023-10-06T04:39:16.252245+0000","last_unstale":"2023-10-06T04:39:21.641321+0000","last_undegraded":"2023-10-06T04:39:21.641321+0000","last_fullsized":"2023-10-06T04:39:21.641321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:17.694713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.628229+0000","last_change":"2023-10-06T04:39:20.641992+0000","last_active":"2023-10-06T04:39:21.628229+0000","last_peered":"2023-10-06T04:39:21.628229+0000","last_clean":"2023-10-06T04:39:21.628229+0000","last_became_active":"2023-10-06T04:39:20.641741+0000","last_became_peered":"2023-10-06T04:39:20.641741+0000","last_unstale":"2023-10-06T04:39:21.628229+0000","last_undegraded":"2023-10-06T04:39:21.628229+0000","last_fullsized":"2023-10-06T04:39:21.628229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:26.016776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651793+0000","last_change":"2023-10-06T04:39:21.645153+0000","last_active":"2023-10-06T04:39:21.651793+0000","last_peered":"2023-10-06T04:39:21.651793+0000","last_clean":"2023-10-06T04:39:21.651793+0000","last_became_active":"2023-10-06T04:39:21.644766+0000","last_became_peered":"2023-10-06T04:39:21.644766+0000","last_unstale":"2023-10-06T04:39:21.651793+0000","last_undegraded":"2023-10-06T04:39:21.651793+0000","last_fullsized":"2023-10-06T04:39:21.651793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:40.720886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.640765+0000","last_change":"2023-10-06T04:39:16.252493+0000","last_active":"2023-10-06T04:39:21.640765+0000","last_peered":"2023-10-06T04:39:21.640765+0000","last_clean":"2023-10-06T04:39:21.640765+0000","last_became_active":"2023-10-06T04:39:16.252190+0000","last_became_peered":"2023-10-06T04:39:16.252190+0000","last_unstale":"2023-10-06T04:39:21.640765+0000","last_undegraded":"2023-10-06T04:39:21.640765+0000","last_fullsized":"2023-10-06T04:39:21.640765+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:59.554724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.636098+0000","last_change":"2023-10-06T04:39:20.639854+0000","last_active":"2023-10-06T04:39:21.636098+0000","last_peered":"2023-10-06T04:39:21.636098+0000","last_clean":"2023-10-06T04:39:21.636098+0000","last_became_active":"2023-10-06T04:39:20.639584+0000","last_became_peered":"2023-10-06T04:39:20.639584+0000","last_unstale":"2023-10-06T04:39:21.636098+0000","last_undegraded":"2023-10-06T04:39:21.636098+0000","last_fullsized":"2023-10-06T04:39:21.636098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:02.150888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656202+0000","last_change":"2023-10-06T04:39:21.653017+0000","last_active":"2023-10-06T04:39:21.656202+0000","last_peered":"2023-10-06T04:39:21.656202+0000","last_clean":"2023-10-06T04:39:21.656202+0000","last_became_active":"2023-10-06T04:39:21.652754+0000","last_became_peered":"2023-10-06T04:39:21.652754+0000","last_unstale":"2023-10-06T04:39:21.656202+0000","last_undegraded":"2023-10-06T04:39:21.656202+0000","last_fullsized":"2023-10-06T04:39:21.656202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:40.720886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.639474+0000","last_change":"2023-10-06T04:39:16.252554+0000","last_active":"2023-10-06T04:39:21.639474+0000","last_peered":"2023-10-06T04:39:21.639474+0000","last_clean":"2023-10-06T04:39:21.639474+0000","last_became_active":"2023-10-06T04:39:16.252225+0000","last_became_peered":"2023-10-06T04:39:16.252225+0000","last_unstale":"2023-10-06T04:39:21.639474+0000","last_undegraded":"2023-10-06T04:39:21.639474+0000","last_fullsized":"2023-10-06T04:39:21.639474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.280766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.633085+0000","last_change":"2023-10-06T04:39:20.644016+0000","last_active":"2023-10-06T04:39:21.633085+0000","last_peered":"2023-10-06T04:39:21.633085+0000","last_clean":"2023-10-06T04:39:21.633085+0000","last_became_active":"2023-10-06T04:39:20.643732+0000","last_became_peered":"2023-10-06T04:39:20.643732+0000","last_unstale":"2023-10-06T04:39:21.633085+0000","last_undegraded":"2023-10-06T04:39:21.633085+0000","last_fullsized":"2023-10-06T04:39:21.633085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:25.801442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.648739+0000","last_change":"2023-10-06T04:39:21.638573+0000","last_active":"2023-10-06T04:39:21.648739+0000","last_peered":"2023-10-06T04:39:21.648739+0000","last_clean":"2023-10-06T04:39:21.648739+0000","last_became_active":"2023-10-06T04:39:21.638300+0000","last_became_peered":"2023-10-06T04:39:21.638300+0000","last_unstale":"2023-10-06T04:39:21.648739+0000","last_undegraded":"2023-10-06T04:39:21.648739+0000","last_fullsized":"2023-10-06T04:39:21.648739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:23.201656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.630974+0000","last_change":"2023-10-06T04:39:16.253021+0000","last_active":"2023-10-06T04:39:21.630974+0000","last_peered":"2023-10-06T04:39:21.630974+0000","last_clean":"2023-10-06T04:39:21.630974+0000","last_became_active":"2023-10-06T04:39:16.252478+0000","last_became_peered":"2023-10-06T04:39:16.252478+0000","last_unstale":"2023-10-06T04:39:21.630974+0000","last_undegraded":"2023-10-06T04:39:21.630974+0000","last_fullsized":"2023-10-06T04:39:21.630974+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:07.439434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.628755+0000","last_change":"2023-10-06T04:39:20.642608+0000","last_active":"2023-10-06T04:39:21.628755+0000","last_peered":"2023-10-06T04:39:21.628755+0000","last_clean":"2023-10-06T04:39:21.628755+0000","last_became_active":"2023-10-06T04:39:20.642287+0000","last_became_peered":"2023-10-06T04:39:20.642287+0000","last_unstale":"2023-10-06T04:39:21.628755+0000","last_undegraded":"2023-10-06T04:39:21.628755+0000","last_fullsized":"2023-10-06T04:39:21.628755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.956516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.660666+0000","last_change":"2023-10-06T04:39:21.656717+0000","last_active":"2023-10-06T04:39:21.660666+0000","last_peered":"2023-10-06T04:39:21.660666+0000","last_clean":"2023-10-06T04:39:21.660666+0000","last_became_active":"2023-10-06T04:39:21.656373+0000","last_became_peered":"2023-10-06T04:39:21.656373+0000","last_unstale":"2023-10-06T04:39:21.660666+0000","last_undegraded":"2023-10-06T04:39:21.660666+0000","last_fullsized":"2023-10-06T04:39:21.660666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:51.885986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.630765+0000","last_change":"2023-10-06T04:39:15.587681+0000","last_active":"2023-10-06T04:39:21.630765+0000","last_peered":"2023-10-06T04:39:21.630765+0000","last_clean":"2023-10-06T04:39:21.630765+0000","last_became_active":"2023-10-06T04:39:15.587313+0000","last_became_peered":"2023-10-06T04:39:15.587313+0000","last_unstale":"2023-10-06T04:39:21.630765+0000","last_undegraded":"2023-10-06T04:39:21.630765+0000","last_fullsized":"2023-10-06T04:39:21.630765+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641010+0000","last_change":"2023-10-06T04:39:20.640831+0000","last_active":"2023-10-06T04:39:21.641010+0000","last_peered":"2023-10-06T04:39:21.641010+0000","last_clean":"2023-10-06T04:39:21.641010+0000","last_became_active":"2023-10-06T04:39:20.640545+0000","last_became_peered":"2023-10-06T04:39:20.640545+0000","last_unstale":"2023-10-06T04:39:21.641010+0000","last_undegraded":"2023-10-06T04:39:21.641010+0000","last_fullsized":"2023-10-06T04:39:21.641010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:41.984467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.651879+0000","last_change":"2023-10-06T04:39:21.644674+0000","last_active":"2023-10-06T04:39:21.651879+0000","last_peered":"2023-10-06T04:39:21.651879+0000","last_clean":"2023-10-06T04:39:21.651879+0000","last_became_active":"2023-10-06T04:39:21.644407+0000","last_became_peered":"2023-10-06T04:39:21.644407+0000","last_unstale":"2023-10-06T04:39:21.651879+0000","last_undegraded":"2023-10-06T04:39:21.651879+0000","last_fullsized":"2023-10-06T04:39:21.651879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:44.939595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.656564+0000","last_change":"2023-10-06T04:39:20.646257+0000","last_active":"2023-10-06T04:39:21.656564+0000","last_peered":"2023-10-06T04:39:21.656564+0000","last_clean":"2023-10-06T04:39:21.656564+0000","last_became_active":"2023-10-06T04:39:20.645914+0000","last_became_peered":"2023-10-06T04:39:20.645914+0000","last_unstale":"2023-10-06T04:39:21.656564+0000","last_undegraded":"2023-10-06T04:39:21.656564+0000","last_fullsized":"2023-10-06T04:39:21.656564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:20.086705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650672+0000","last_change":"2023-10-06T04:39:21.638557+0000","last_active":"2023-10-06T04:39:21.650672+0000","last_peered":"2023-10-06T04:39:21.650672+0000","last_clean":"2023-10-06T04:39:21.650672+0000","last_became_active":"2023-10-06T04:39:21.638310+0000","last_became_peered":"2023-10-06T04:39:21.638310+0000","last_unstale":"2023-10-06T04:39:21.650672+0000","last_undegraded":"2023-10-06T04:39:21.650672+0000","last_fullsized":"2023-10-06T04:39:21.650672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:26.810840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654092+0000","last_change":"2023-10-06T04:39:20.639506+0000","last_active":"2023-10-06T04:39:21.654092+0000","last_peered":"2023-10-06T04:39:21.654092+0000","last_clean":"2023-10-06T04:39:21.654092+0000","last_became_active":"2023-10-06T04:39:20.639218+0000","last_became_peered":"2023-10-06T04:39:20.639218+0000","last_unstale":"2023-10-06T04:39:21.654092+0000","last_undegraded":"2023-10-06T04:39:21.654092+0000","last_fullsized":"2023-10-06T04:39:21.654092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:34.035323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653773+0000","last_change":"2023-10-06T04:39:21.642939+0000","last_active":"2023-10-06T04:39:21.653773+0000","last_peered":"2023-10-06T04:39:21.653773+0000","last_clean":"2023-10-06T04:39:21.653773+0000","last_became_active":"2023-10-06T04:39:21.642669+0000","last_became_peered":"2023-10-06T04:39:21.642669+0000","last_unstale":"2023-10-06T04:39:21.653773+0000","last_undegraded":"2023-10-06T04:39:21.653773+0000","last_fullsized":"2023-10-06T04:39:21.653773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:35.969836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.654879+0000","last_change":"2023-10-06T04:39:20.642036+0000","last_active":"2023-10-06T04:39:21.654879+0000","last_peered":"2023-10-06T04:39:21.654879+0000","last_clean":"2023-10-06T04:39:21.654879+0000","last_became_active":"2023-10-06T04:39:20.641779+0000","last_became_peered":"2023-10-06T04:39:20.641779+0000","last_unstale":"2023-10-06T04:39:21.654879+0000","last_undegraded":"2023-10-06T04:39:21.654879+0000","last_fullsized":"2023-10-06T04:39:21.654879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:25.801442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653650+0000","last_change":"2023-10-06T04:39:21.642305+0000","last_active":"2023-10-06T04:39:21.653650+0000","last_peered":"2023-10-06T04:39:21.653650+0000","last_clean":"2023-10-06T04:39:21.653650+0000","last_became_active":"2023-10-06T04:39:21.642047+0000","last_became_peered":"2023-10-06T04:39:21.642047+0000","last_unstale":"2023-10-06T04:39:21.653650+0000","last_undegraded":"2023-10-06T04:39:21.653650+0000","last_fullsized":"2023-10-06T04:39:21.653650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:46.146563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.645322+0000","last_change":"2023-10-06T04:39:20.638812+0000","last_active":"2023-10-06T04:39:21.645322+0000","last_peered":"2023-10-06T04:39:21.645322+0000","last_clean":"2023-10-06T04:39:21.645322+0000","last_became_active":"2023-10-06T04:39:20.638433+0000","last_became_peered":"2023-10-06T04:39:20.638433+0000","last_unstale":"2023-10-06T04:39:21.645322+0000","last_undegraded":"2023-10-06T04:39:21.645322+0000","last_fullsized":"2023-10-06T04:39:21.645322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:25.801442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641299+0000","last_change":"2023-10-06T04:39:21.639406+0000","last_active":"2023-10-06T04:39:21.641299+0000","last_peered":"2023-10-06T04:39:21.641299+0000","last_clean":"2023-10-06T04:39:21.641299+0000","last_became_active":"2023-10-06T04:39:21.639016+0000","last_became_peered":"2023-10-06T04:39:21.639016+0000","last_unstale":"2023-10-06T04:39:21.641299+0000","last_undegraded":"2023-10-06T04:39:21.641299+0000","last_fullsized":"2023-10-06T04:39:21.641299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:33.545272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.657543+0000","last_change":"2023-10-06T04:39:20.644648+0000","last_active":"2023-10-06T04:39:21.657543+0000","last_peered":"2023-10-06T04:39:21.657543+0000","last_clean":"2023-10-06T04:39:21.657543+0000","last_became_active":"2023-10-06T04:39:20.644394+0000","last_became_peered":"2023-10-06T04:39:20.644394+0000","last_unstale":"2023-10-06T04:39:21.657543+0000","last_undegraded":"2023-10-06T04:39:21.657543+0000","last_fullsized":"2023-10-06T04:39:21.657543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:19.608464+0000","last_clean_scrub_stamp":"2023-10-06T04:39:19.608464+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:30:33.654378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653532+0000","last_change":"2023-10-06T04:39:21.641164+0000","last_active":"2023-10-06T04:39:21.653532+0000","last_peered":"2023-10-06T04:39:21.653532+0000","last_clean":"2023-10-06T04:39:21.653532+0000","last_became_active":"2023-10-06T04:39:21.640905+0000","last_became_peered":"2023-10-06T04:39:21.640905+0000","last_unstale":"2023-10-06T04:39:21.653532+0000","last_undegraded":"2023-10-06T04:39:21.653532+0000","last_fullsized":"2023-10-06T04:39:21.653532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:08.780680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.650176+0000","last_change":"2023-10-06T04:39:21.640076+0000","last_active":"2023-10-06T04:39:21.650176+0000","last_peered":"2023-10-06T04:39:21.650176+0000","last_clean":"2023-10-06T04:39:21.650176+0000","last_became_active":"2023-10-06T04:39:21.639818+0000","last_became_peered":"2023-10-06T04:39:21.639818+0000","last_unstale":"2023-10-06T04:39:21.650176+0000","last_undegraded":"2023-10-06T04:39:21.650176+0000","last_fullsized":"2023-10-06T04:39:21.650176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:14.517515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.641319+0000","last_change":"2023-10-06T04:39:21.639647+0000","last_active":"2023-10-06T04:39:21.641319+0000","last_peered":"2023-10-06T04:39:21.641319+0000","last_clean":"2023-10-06T04:39:21.641319+0000","last_became_active":"2023-10-06T04:39:21.639337+0000","last_became_peered":"2023-10-06T04:39:21.639337+0000","last_unstale":"2023-10-06T04:39:21.641319+0000","last_undegraded":"2023-10-06T04:39:21.641319+0000","last_fullsized":"2023-10-06T04:39:21.641319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:50.708331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653972+0000","last_change":"2023-10-06T04:39:21.647332+0000","last_active":"2023-10-06T04:39:21.653972+0000","last_peered":"2023-10-06T04:39:21.653972+0000","last_clean":"2023-10-06T04:39:21.653972+0000","last_became_active":"2023-10-06T04:39:21.647076+0000","last_became_peered":"2023-10-06T04:39:21.647076+0000","last_unstale":"2023-10-06T04:39:21.653972+0000","last_undegraded":"2023-10-06T04:39:21.653972+0000","last_fullsized":"2023-10-06T04:39:21.653972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:31.156663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653564+0000","last_change":"2023-10-06T04:39:21.647332+0000","last_active":"2023-10-06T04:39:21.653564+0000","last_peered":"2023-10-06T04:39:21.653564+0000","last_clean":"2023-10-06T04:39:21.653564+0000","last_became_active":"2023-10-06T04:39:21.647082+0000","last_became_peered":"2023-10-06T04:39:21.647082+0000","last_unstale":"2023-10-06T04:39:21.653564+0000","last_undegraded":"2023-10-06T04:39:21.653564+0000","last_fullsized":"2023-10-06T04:39:21.653564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:53.420342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:39:21.653367+0000","last_change":"2023-10-06T04:39:21.646732+0000","last_active":"2023-10-06T04:39:21.653367+0000","last_peered":"2023-10-06T04:39:21.653367+0000","last_clean":"2023-10-06T04:39:21.653367+0000","last_became_active":"2023-10-06T04:39:21.646482+0000","last_became_peered":"2023-10-06T04:39:21.646482+0000","last_unstale":"2023-10-06T04:39:21.653367+0000","last_undegraded":"2023-10-06T04:39:21.653367+0000","last_fullsized":"2023-10-06T04:39:21.653367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:20.617861+0000","last_clean_scrub_stamp":"2023-10-06T04:39:20.617861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:51.885986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":74184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":664552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":74738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":74184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6830000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5209999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.655}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":74274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":73455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:39:30.559 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T04:39:30.559 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T04:39:30.559 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T04:39:30.559 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T04:39:30.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.701+0000 7f76c209f700 1 Processor -- start 2023-10-06T04:39:30.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.701+0000 7f76c209f700 1 -- start start 2023-10-06T04:39:30.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.702+0000 7f76c209f700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f76bc0af6f0 0x7f76bc06dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.702+0000 7f76c209f700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76bc0afb60 0x7f76bc06e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.702+0000 7f76c209f700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76bc15d890 con 0x7f76bc159940 2023-10-06T04:39:30.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.702+0000 7f76c209f700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76bc15db70 con 0x7f76bc0af6f0 2023-10-06T04:39:30.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.702+0000 7f76c209f700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc15de50 con 0x7f76bc0afb60 2023-10-06T04:39:30.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.703+0000 7f76baffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f76bc0af6f0 0x7f76bc06dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.703+0000 7f76baffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f76bc0af6f0 0x7f76bc06dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.112:59880/0 (socket says 172.21.15.112:59880) 2023-10-06T04:39:30.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.703+0000 7f76baffd700 1 -- 172.21.15.112:0/3116046040 learned_addr learned my addr 172.21.15.112:0/3116046040 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:30.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.703+0000 7f76bbfff700 1 --2- 172.21.15.112:0/3116046040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76bc0afb60 0x7f76bc06e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.703+0000 7f76baffd700 1 -- 172.21.15.112:0/3116046040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76bc0afb60 msgr2=0x7f76bc06e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:30.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.703+0000 7f76baffd700 1 --2- 172.21.15.112:0/3116046040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76bc0afb60 0x7f76bc06e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.703+0000 7f76baffd700 1 -- 172.21.15.112:0/3116046040 >> v1:172.21.15.179:6789/0 conn(0x7f76bc159940 legacy=0x7f76bc06ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.703+0000 7f76baffd700 1 -- 172.21.15.112:0/3116046040 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc15e130 con 0x7f76bc0af6f0 2023-10-06T04:39:30.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.703+0000 7f76baffd700 1 --2- 172.21.15.112:0/3116046040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76bc0af6f0 0x7f76bc06dce0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f76b00099b0 tx=0x7f76b0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52194090a757f614 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:30.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.703+0000 7f76ba7fc700 1 -- 172.21.15.112:0/3116046040 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0009ea0 con 0x7f76bc0af6f0 2023-10-06T04:39:30.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.703+0000 7f76ba7fc700 1 -- 172.21.15.112:0/3116046040 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b000b860 con 0x7f76bc0af6f0 2023-10-06T04:39:30.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.703+0000 7f76ba7fc700 1 -- 172.21.15.112:0/3116046040 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b000bc00 con 0x7f76bc0af6f0 2023-10-06T04:39:30.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.704+0000 7f76c209f700 1 -- 172.21.15.112:0/3116046040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76bc0af6f0 msgr2=0x7f76bc06dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.704+0000 7f76c209f700 1 --2- 172.21.15.112:0/3116046040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76bc0af6f0 0x7f76bc06dce0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f76b00099b0 tx=0x7f76b0009250 comp rx=0 tx=0).stop 2023-10-06T04:39:30.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.704+0000 7f76c209f700 1 -- 172.21.15.112:0/3116046040 shutdown_connections 2023-10-06T04:39:30.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.704+0000 7f76c209f700 1 --2- 172.21.15.112:0/3116046040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76bc0afb60 0x7f76bc06e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.704+0000 7f76c209f700 1 --2- 172.21.15.112:0/3116046040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76bc0af6f0 0x7f76bc06dce0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.704+0000 7f76c209f700 1 -- 172.21.15.112:0/3116046040 >> 172.21.15.112:0/3116046040 conn(0x7f76bc06d8e0 msgr2=0x7f76bc0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:30.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.704+0000 7f76c209f700 1 -- 172.21.15.112:0/3116046040 shutdown_connections 2023-10-06T04:39:30.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.704+0000 7f76c209f700 1 -- 172.21.15.112:0/3116046040 wait complete. 2023-10-06T04:39:30.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.705+0000 7f76c209f700 1 Processor -- start 2023-10-06T04:39:30.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.705+0000 7f76c209f700 1 -- start start 2023-10-06T04:39:30.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.706+0000 7f76c209f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76bc0af6f0 0x7f76bc13c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.706+0000 7f76c209f700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76bc0afb60 0x7f76bc157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.706+0000 7f76c209f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76bc159940 0x7f76bc157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.706+0000 7f76c209f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc0a9bc0 con 0x7f76bc159940 2023-10-06T04:39:30.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.706+0000 7f76c209f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc0aca50 con 0x7f76bc0af6f0 2023-10-06T04:39:30.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.706+0000 7f76c209f700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc0abe40 con 0x7f76bc0afb60 2023-10-06T04:39:30.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.706+0000 7f76bbfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76bc159940 0x7f76bc157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.706+0000 7f76bbfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76bc159940 0x7f76bc157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58360/0 (socket says 172.21.15.112:58360) 2023-10-06T04:39:30.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.706+0000 7f76bb7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76bc0af6f0 0x7f76bc13c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.706+0000 7f76bbfff700 1 -- 172.21.15.112:0/2161090342 learned_addr learned my addr 172.21.15.112:0/2161090342 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:30.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.706+0000 7f76baffd700 1 --2- 172.21.15.112:0/2161090342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76bc0afb60 0x7f76bc157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.706+0000 7f76bbfff700 1 -- 172.21.15.112:0/2161090342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76bc0afb60 msgr2=0x7f76bc157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.706+0000 7f76bbfff700 1 --2- 172.21.15.112:0/2161090342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76bc0afb60 0x7f76bc157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.706+0000 7f76bbfff700 1 -- 172.21.15.112:0/2161090342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76bc0af6f0 msgr2=0x7f76bc13c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.706+0000 7f76bbfff700 1 --2- 172.21.15.112:0/2161090342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76bc0af6f0 0x7f76bc13c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.706+0000 7f76bbfff700 1 -- 172.21.15.112:0/2161090342 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b00094f0 con 0x7f76bc159940 2023-10-06T04:39:30.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.707+0000 7f76bbfff700 1 --2- 172.21.15.112:0/2161090342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76bc159940 0x7f76bc157960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f76b400ea50 tx=0x7f76b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:30.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.707+0000 7f76a37fe700 1 -- 172.21.15.112:0/2161090342 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b400ee90 con 0x7f76bc159940 2023-10-06T04:39:30.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.707+0000 7f76a37fe700 1 -- 172.21.15.112:0/2161090342 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b400c850 con 0x7f76bc159940 2023-10-06T04:39:30.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.707+0000 7f76c209f700 1 -- 172.21.15.112:0/2161090342 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76bc0ac120 con 0x7f76bc159940 2023-10-06T04:39:30.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.707+0000 7f76a37fe700 1 -- 172.21.15.112:0/2161090342 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b400cc10 con 0x7f76bc159940 2023-10-06T04:39:30.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.707+0000 7f76c209f700 1 -- 172.21.15.112:0/2161090342 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76bc0ac6e0 con 0x7f76bc159940 2023-10-06T04:39:30.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.708+0000 7f76c209f700 1 -- 172.21.15.112:0/2161090342 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76bc05f230 con 0x7f76bc159940 2023-10-06T04:39:30.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.709+0000 7f76a37fe700 1 -- 172.21.15.112:0/2161090342 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f76b4013470 con 0x7f76bc159940 2023-10-06T04:39:30.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.710+0000 7f76a37fe700 1 --2- 172.21.15.112:0/2161090342 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f76a8066f30 0x7f76a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:30.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.710+0000 7f76a37fe700 1 -- 172.21.15.112:0/2161090342 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f76b4085150 con 0x7f76bc159940 2023-10-06T04:39:30.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.710+0000 7f76bb7fe700 1 --2- 172.21.15.112:0/2161090342 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f76a8066f30 0x7f76a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:30.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.710+0000 7f76bb7fe700 1 --2- 172.21.15.112:0/2161090342 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f76a8066f30 0x7f76a80693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f76ac007fd0 tx=0x7f76ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:30.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.713+0000 7f76a37fe700 1 -- 172.21.15.112:0/2161090342 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76b4052240 con 0x7f76bc159940 2023-10-06T04:39:30.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.936+0000 7f76c209f700 1 -- 172.21.15.112:0/2161090342 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f76bc14d5a0 con 0x7f76bc159940 2023-10-06T04:39:30.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.936+0000 7f76a37fe700 1 -- 172.21.15.112:0/2161090342 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f76b4055860 con 0x7f76bc159940 2023-10-06T04:39:30.938 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:30.938 INFO:teuthology.orchestra.run.smithi112.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T04:39:30.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.938+0000 7f76c209f700 1 -- 172.21.15.112:0/2161090342 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f76a8066f30 msgr2=0x7f76a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.938+0000 7f76c209f700 1 --2- 172.21.15.112:0/2161090342 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f76a8066f30 0x7f76a80693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f76ac007fd0 tx=0x7f76ac009040 comp rx=0 tx=0).stop 2023-10-06T04:39:30.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.938+0000 7f76c209f700 1 -- 172.21.15.112:0/2161090342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76bc159940 msgr2=0x7f76bc157960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:30.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.938+0000 7f76c209f700 1 --2- 172.21.15.112:0/2161090342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76bc159940 0x7f76bc157960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f76b400ea50 tx=0x7f76b40091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.938+0000 7f76c209f700 1 -- 172.21.15.112:0/2161090342 shutdown_connections 2023-10-06T04:39:30.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.938+0000 7f76c209f700 1 --2- 172.21.15.112:0/2161090342 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f76a8066f30 0x7f76a80693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.938+0000 7f76c209f700 1 --2- 172.21.15.112:0/2161090342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76bc159940 0x7f76bc157960 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.938+0000 7f76c209f700 1 --2- 172.21.15.112:0/2161090342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76bc0af6f0 0x7f76bc13c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.938+0000 7f76c209f700 1 --2- 172.21.15.112:0/2161090342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76bc0afb60 0x7f76bc157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:30.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.938+0000 7f76c209f700 1 -- 172.21.15.112:0/2161090342 >> 172.21.15.112:0/2161090342 conn(0x7f76bc06d8e0 msgr2=0x7f76bc06ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:30.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.938+0000 7f76c209f700 1 -- 172.21.15.112:0/2161090342 shutdown_connections 2023-10-06T04:39:30.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:30.938+0000 7f76c209f700 1 -- 172.21.15.112:0/2161090342 wait complete. 2023-10-06T04:39:30.951 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T04:39:30.951 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:31.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.064+0000 7f16485b2700 1 Processor -- start 2023-10-06T04:39:31.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.064+0000 7f16485b2700 1 -- start start 2023-10-06T04:39:31.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.065+0000 7f16485b2700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1640159d50 0x7f16400b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.065+0000 7f16485b2700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f164015a120 0x7f16400cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.065+0000 7f16485b2700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16400cd740 con 0x7f16400b0e70 2023-10-06T04:39:31.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.065+0000 7f16485b2700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16400ccb30 con 0x7f1640159d50 2023-10-06T04:39:31.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.065+0000 7f16485b2700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16400cce10 con 0x7f164015a120 2023-10-06T04:39:31.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.065+0000 7f164634e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1640159d50 0x7f16400b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.065+0000 7f1645b4d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f164015a120 0x7f16400cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.065+0000 7f164634e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1640159d50 0x7f16400b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.112:59898/0 (socket says 172.21.15.112:59898) 2023-10-06T04:39:31.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.065+0000 7f164634e700 1 -- 172.21.15.112:0/1140302385 learned_addr learned my addr 172.21.15.112:0/1140302385 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:31.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.065+0000 7f1646b4f700 1 --1- 172.21.15.112:0/1140302385 >> v1:172.21.15.179:6789/0 conn(0x7f16400b0e70 0x7f164006db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.112:56242/0 (socket says 172.21.15.112:56242) 2023-10-06T04:39:31.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.065+0000 7f164634e700 1 -- 172.21.15.112:0/1140302385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f164015a120 msgr2=0x7f16400cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:31.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.065+0000 7f164634e700 1 --2- 172.21.15.112:0/1140302385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f164015a120 0x7f16400cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.065+0000 7f164634e700 1 -- 172.21.15.112:0/1140302385 >> v1:172.21.15.179:6789/0 conn(0x7f16400b0e70 legacy=0x7f164006db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.065+0000 7f164634e700 1 -- 172.21.15.112:0/1140302385 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16400cd0f0 con 0x7f1640159d50 2023-10-06T04:39:31.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.066+0000 7f164634e700 1 --2- 172.21.15.112:0/1140302385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1640159d50 0x7f16400b3040 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f163c009f20 tx=0x7f163c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a22ff23b6ad2e99b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:31.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.066+0000 7f164534c700 1 -- 172.21.15.112:0/1140302385 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c00e070 con 0x7f1640159d50 2023-10-06T04:39:31.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.066+0000 7f164534c700 1 -- 172.21.15.112:0/1140302385 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163c00b8d0 con 0x7f1640159d50 2023-10-06T04:39:31.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.066+0000 7f164534c700 1 -- 172.21.15.112:0/1140302385 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c0092e0 con 0x7f1640159d50 2023-10-06T04:39:31.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.066+0000 7f16485b2700 1 -- 172.21.15.112:0/1140302385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1640159d50 msgr2=0x7f16400b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.066+0000 7f16485b2700 1 --2- 172.21.15.112:0/1140302385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1640159d50 0x7f16400b3040 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f163c009f20 tx=0x7f163c009840 comp rx=0 tx=0).stop 2023-10-06T04:39:31.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.066+0000 7f16485b2700 1 -- 172.21.15.112:0/1140302385 shutdown_connections 2023-10-06T04:39:31.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.066+0000 7f16485b2700 1 --2- 172.21.15.112:0/1140302385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1640159d50 0x7f16400b3040 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.066+0000 7f16485b2700 1 --2- 172.21.15.112:0/1140302385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f164015a120 0x7f16400cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.066+0000 7f16485b2700 1 -- 172.21.15.112:0/1140302385 >> 172.21.15.112:0/1140302385 conn(0x7f1640099b60 msgr2=0x7f164006cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:31.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.066+0000 7f16485b2700 1 -- 172.21.15.112:0/1140302385 shutdown_connections 2023-10-06T04:39:31.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.066+0000 7f16485b2700 1 -- 172.21.15.112:0/1140302385 wait complete. 2023-10-06T04:39:31.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.067+0000 7f16485b2700 1 Processor -- start 2023-10-06T04:39:31.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.068+0000 7f16485b2700 1 -- start start 2023-10-06T04:39:31.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.068+0000 7f16485b2700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16400b0e70 0x7f1640155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.068+0000 7f16485b2700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1640159d50 0x7f164016d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.068+0000 7f16485b2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f164015a120 0x7f164016deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.068+0000 7f16485b2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1640156810 con 0x7f164015a120 2023-10-06T04:39:31.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.068+0000 7f16485b2700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1640156250 con 0x7f16400b0e70 2023-10-06T04:39:31.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.068+0000 7f16485b2700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1640156530 con 0x7f1640159d50 2023-10-06T04:39:31.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.068+0000 7f1646b4f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f164015a120 0x7f164016deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.068+0000 7f1646b4f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f164015a120 0x7f164016deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58368/0 (socket says 172.21.15.112:58368) 2023-10-06T04:39:31.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.068+0000 7f1646b4f700 1 -- 172.21.15.112:0/2875102601 learned_addr learned my addr 172.21.15.112:0/2875102601 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:31.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.068+0000 7f1645b4d700 1 --2- 172.21.15.112:0/2875102601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1640159d50 0x7f164016d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.068+0000 7f164634e700 1 --2- 172.21.15.112:0/2875102601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16400b0e70 0x7f1640155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.069+0000 7f1646b4f700 1 -- 172.21.15.112:0/2875102601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1640159d50 msgr2=0x7f164016d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.069+0000 7f1646b4f700 1 --2- 172.21.15.112:0/2875102601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1640159d50 0x7f164016d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.069+0000 7f1646b4f700 1 -- 172.21.15.112:0/2875102601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16400b0e70 msgr2=0x7f1640155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.069+0000 7f1646b4f700 1 --2- 172.21.15.112:0/2875102601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16400b0e70 0x7f1640155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.069+0000 7f1646b4f700 1 -- 172.21.15.112:0/2875102601 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c009ae0 con 0x7f164015a120 2023-10-06T04:39:31.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.069+0000 7f1646b4f700 1 --2- 172.21.15.112:0/2875102601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f164015a120 0x7f164016deb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f163800c7e0 tx=0x7f1638007e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:31.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.069+0000 7f16367fc700 1 -- 172.21.15.112:0/2875102601 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1638005a70 con 0x7f164015a120 2023-10-06T04:39:31.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.069+0000 7f16367fc700 1 -- 172.21.15.112:0/2875102601 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1638005bf0 con 0x7f164015a120 2023-10-06T04:39:31.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.069+0000 7f16485b2700 1 -- 172.21.15.112:0/2875102601 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164015da10 con 0x7f164015a120 2023-10-06T04:39:31.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.069+0000 7f16367fc700 1 -- 172.21.15.112:0/2875102601 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16380070d0 con 0x7f164015a120 2023-10-06T04:39:31.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.069+0000 7f16485b2700 1 -- 172.21.15.112:0/2875102601 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164009eb90 con 0x7f164015a120 2023-10-06T04:39:31.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.070+0000 7f16485b2700 1 -- 172.21.15.112:0/2875102601 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164015d870 con 0x7f164015a120 2023-10-06T04:39:31.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.070+0000 7f16367fc700 1 -- 172.21.15.112:0/2875102601 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1638007440 con 0x7f164015a120 2023-10-06T04:39:31.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.071+0000 7f16367fc700 1 --2- 172.21.15.112:0/2875102601 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1624066f30 0x7f16240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.071+0000 7f16367fc700 1 -- 172.21.15.112:0/2875102601 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1638083a60 con 0x7f164015a120 2023-10-06T04:39:31.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.071+0000 7f164634e700 1 --2- 172.21.15.112:0/2875102601 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1624066f30 0x7f16240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.071+0000 7f164634e700 1 --2- 172.21.15.112:0/2875102601 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1624066f30 0x7f16240693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f163c009880 tx=0x7f163c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:31.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.075+0000 7f16367fc700 1 -- 172.21.15.112:0/2875102601 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f164015d870 con 0x7f164015a120 2023-10-06T04:39:31.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.257+0000 7f16485b2700 1 -- 172.21.15.112:0/2875102601 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f164015d870 con 0x7f164015a120 2023-10-06T04:39:31.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.257+0000 7f16367fc700 1 -- 172.21.15.112:0/2875102601 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f164015d870 con 0x7f164015a120 2023-10-06T04:39:31.259 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:31.259 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:39:22.637355+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:18.657040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:19.972295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:31.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.259+0000 7f16485b2700 1 -- 172.21.15.112:0/2875102601 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1624066f30 msgr2=0x7f16240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.259+0000 7f16485b2700 1 --2- 172.21.15.112:0/2875102601 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1624066f30 0x7f16240693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f163c009880 tx=0x7f163c017000 comp rx=0 tx=0).stop 2023-10-06T04:39:31.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.259+0000 7f16485b2700 1 -- 172.21.15.112:0/2875102601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f164015a120 msgr2=0x7f164016deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.259+0000 7f16485b2700 1 --2- 172.21.15.112:0/2875102601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f164015a120 0x7f164016deb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f163800c7e0 tx=0x7f1638007e70 comp rx=0 tx=0).stop 2023-10-06T04:39:31.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.259+0000 7f16485b2700 1 -- 172.21.15.112:0/2875102601 shutdown_connections 2023-10-06T04:39:31.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.259+0000 7f16485b2700 1 --2- 172.21.15.112:0/2875102601 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1624066f30 0x7f16240693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.259+0000 7f16485b2700 1 --2- 172.21.15.112:0/2875102601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f164015a120 0x7f164016deb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.259+0000 7f16485b2700 1 --2- 172.21.15.112:0/2875102601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16400b0e70 0x7f1640155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.259+0000 7f16485b2700 1 --2- 172.21.15.112:0/2875102601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1640159d50 0x7f164016d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.259+0000 7f16485b2700 1 -- 172.21.15.112:0/2875102601 >> 172.21.15.112:0/2875102601 conn(0x7f1640099b60 msgr2=0x7f1640150d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:31.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.259+0000 7f16485b2700 1 -- 172.21.15.112:0/2875102601 shutdown_connections 2023-10-06T04:39:31.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.260+0000 7f16485b2700 1 -- 172.21.15.112:0/2875102601 wait complete. 2023-10-06T04:39:31.273 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:13.929254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:39:14.321892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:39:18.657040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:39:19.972295+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:39:31.274 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:39:31.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.390+0000 7f87cdfc4700 1 Processor -- start 2023-10-06T04:39:31.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.390+0000 7f87cdfc4700 1 -- start start 2023-10-06T04:39:31.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.390+0000 7f87cdfc4700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87c815d620 0x7f87c8068050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.390+0000 7f87cdfc4700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f87c8068590 0x7f87c806df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.390+0000 7f87cdfc4700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c806daf0 con 0x7f87c8159a50 2023-10-06T04:39:31.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.390+0000 7f87cdfc4700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c8068a30 con 0x7f87c8068590 2023-10-06T04:39:31.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.390+0000 7f87cdfc4700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c80b3fc0 con 0x7f87c815d620 2023-10-06T04:39:31.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.391+0000 7f87c7fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f87c8068590 0x7f87c806df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.391+0000 7f87c6ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87c815d620 0x7f87c8068050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.391+0000 7f87c77fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f87c8159a50 0x7f87c80b38b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.112:56254/0 (socket says 172.21.15.112:56254) 2023-10-06T04:39:31.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.391+0000 7f87c7fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f87c8068590 0x7f87c806df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.112:59902/0 (socket says 172.21.15.112:59902) 2023-10-06T04:39:31.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.391+0000 7f87c6ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87c815d620 0x7f87c8068050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.112:60162/0 (socket says 172.21.15.112:60162) 2023-10-06T04:39:31.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.391+0000 7f87c77fe700 1 -- 172.21.15.112:0/588399008 learned_addr learned my addr 172.21.15.112:0/588399008 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:31.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.391+0000 7f87c7fff700 1 -- 172.21.15.112:0/588399008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87c815d620 msgr2=0x7f87c8068050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:31.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.391+0000 7f87c7fff700 1 --2- 172.21.15.112:0/588399008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87c815d620 0x7f87c8068050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.391+0000 7f87c7fff700 1 -- 172.21.15.112:0/588399008 >> v1:172.21.15.179:6789/0 conn(0x7f87c8159a50 legacy=0x7f87c80b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.391+0000 7f87c7fff700 1 -- 172.21.15.112:0/588399008 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c815db20 con 0x7f87c8068590 2023-10-06T04:39:31.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.391+0000 7f87c67fc700 1 -- 172.21.15.112:0/588399008 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95626279 0 0) 0x7f87c806daf0 con 0x7f87c8159a50 2023-10-06T04:39:31.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.391+0000 7f87c7fff700 1 --2- 172.21.15.112:0/588399008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87c8068590 0x7f87c806df80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f87c00098e0 tx=0x7f87c00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9327097b832552af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:31.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.391+0000 7f87c67fc700 1 -- 172.21.15.112:0/588399008 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c000b640 con 0x7f87c8068590 2023-10-06T04:39:31.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.391+0000 7f87c67fc700 1 -- 172.21.15.112:0/588399008 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c000b7a0 con 0x7f87c8068590 2023-10-06T04:39:31.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.391+0000 7f87c67fc700 1 -- 172.21.15.112:0/588399008 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c000bb40 con 0x7f87c8068590 2023-10-06T04:39:31.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.392+0000 7f87cdfc4700 1 -- 172.21.15.112:0/588399008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87c8068590 msgr2=0x7f87c806df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.392+0000 7f87cdfc4700 1 --2- 172.21.15.112:0/588399008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87c8068590 0x7f87c806df80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f87c00098e0 tx=0x7f87c00091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.392+0000 7f87cdfc4700 1 -- 172.21.15.112:0/588399008 shutdown_connections 2023-10-06T04:39:31.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.392+0000 7f87cdfc4700 1 --2- 172.21.15.112:0/588399008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87c8068590 0x7f87c806df80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.392+0000 7f87cdfc4700 1 --2- 172.21.15.112:0/588399008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87c815d620 0x7f87c8068050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.392+0000 7f87cdfc4700 1 -- 172.21.15.112:0/588399008 >> 172.21.15.112:0/588399008 conn(0x7f87c80631f0 msgr2=0x7f87c80635f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:31.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.392+0000 7f87cdfc4700 1 -- 172.21.15.112:0/588399008 shutdown_connections 2023-10-06T04:39:31.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.392+0000 7f87cdfc4700 1 -- 172.21.15.112:0/588399008 wait complete. 2023-10-06T04:39:31.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.393+0000 7f87cdfc4700 1 Processor -- start 2023-10-06T04:39:31.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.393+0000 7f87cdfc4700 1 -- start start 2023-10-06T04:39:31.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.394+0000 7f87cdfc4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87c8068590 0x7f87c80cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.394+0000 7f87cdfc4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87c8159a50 0x7f87c806eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.394+0000 7f87cdfc4700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87c815d620 0x7f87c806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.394+0000 7f87cdfc4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c815beb0 con 0x7f87c8068590 2023-10-06T04:39:31.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.394+0000 7f87cdfc4700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c81569a0 con 0x7f87c8159a50 2023-10-06T04:39:31.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.394+0000 7f87cdfc4700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c815bbd0 con 0x7f87c815d620 2023-10-06T04:39:31.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.394+0000 7f87c77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87c8068590 0x7f87c80cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.394+0000 7f87c77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87c8068590 0x7f87c80cd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58376/0 (socket says 172.21.15.112:58376) 2023-10-06T04:39:31.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.394+0000 7f87c77fe700 1 -- 172.21.15.112:0/2568838721 learned_addr learned my addr 172.21.15.112:0/2568838721 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:31.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.394+0000 7f87c6ffd700 1 --2- 172.21.15.112:0/2568838721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87c8159a50 0x7f87c806eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.394+0000 7f87c7fff700 1 --2- 172.21.15.112:0/2568838721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87c815d620 0x7f87c806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.394+0000 7f87c77fe700 1 -- 172.21.15.112:0/2568838721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87c815d620 msgr2=0x7f87c806f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.394+0000 7f87c77fe700 1 --2- 172.21.15.112:0/2568838721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87c815d620 0x7f87c806f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.394+0000 7f87c77fe700 1 -- 172.21.15.112:0/2568838721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87c8159a50 msgr2=0x7f87c806eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.394+0000 7f87c77fe700 1 --2- 172.21.15.112:0/2568838721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87c8159a50 0x7f87c806eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.394+0000 7f87c77fe700 1 -- 172.21.15.112:0/2568838721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c0009420 con 0x7f87c8068590 2023-10-06T04:39:31.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.394+0000 7f87c6ffd700 1 --2- 172.21.15.112:0/2568838721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87c8159a50 0x7f87c806eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:31.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.394+0000 7f87c77fe700 1 --2- 172.21.15.112:0/2568838721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87c8068590 0x7f87c80cd200 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f87b800cd80 tx=0x7f87b8001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:31.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.394+0000 7f87af7fe700 1 -- 172.21.15.112:0/2568838721 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b800aa60 con 0x7f87c8068590 2023-10-06T04:39:31.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.395+0000 7f87af7fe700 1 -- 172.21.15.112:0/2568838721 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b800abc0 con 0x7f87c8068590 2023-10-06T04:39:31.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.395+0000 7f87cdfc4700 1 -- 172.21.15.112:0/2568838721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c8156c40 con 0x7f87c8068590 2023-10-06T04:39:31.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.395+0000 7f87af7fe700 1 -- 172.21.15.112:0/2568838721 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b80070f0 con 0x7f87c8068590 2023-10-06T04:39:31.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.395+0000 7f87cdfc4700 1 -- 172.21.15.112:0/2568838721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c815ae60 con 0x7f87c8068590 2023-10-06T04:39:31.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.395+0000 7f87cdfc4700 1 -- 172.21.15.112:0/2568838721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c8157160 con 0x7f87c8068590 2023-10-06T04:39:31.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.396+0000 7f87af7fe700 1 -- 172.21.15.112:0/2568838721 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87b80074e0 con 0x7f87c8068590 2023-10-06T04:39:31.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.396+0000 7f87af7fe700 1 --2- 172.21.15.112:0/2568838721 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f87b4066f30 0x7f87b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.396+0000 7f87af7fe700 1 -- 172.21.15.112:0/2568838721 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f87b8084ac0 con 0x7f87c8068590 2023-10-06T04:39:31.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.396+0000 7f87c6ffd700 1 --2- 172.21.15.112:0/2568838721 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f87b4066f30 0x7f87b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.397+0000 7f87c6ffd700 1 --2- 172.21.15.112:0/2568838721 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f87b4066f30 0x7f87b40693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f87c80b24c0 tx=0x7f87bc0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:31.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.400+0000 7f87af7fe700 1 -- 172.21.15.112:0/2568838721 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87c8157160 con 0x7f87c8068590 2023-10-06T04:39:31.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.583+0000 7f87cdfc4700 1 -- 172.21.15.112:0/2568838721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f87c805f230 con 0x7f87c8068590 2023-10-06T04:39:31.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.584+0000 7f87af7fe700 1 -- 172.21.15.112:0/2568838721 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f87b8051bb0 con 0x7f87c8068590 2023-10-06T04:39:31.585 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-10-06T04:39:31.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.586+0000 7f87cdfc4700 1 -- 172.21.15.112:0/2568838721 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f87b4066f30 msgr2=0x7f87b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.586+0000 7f87cdfc4700 1 --2- 172.21.15.112:0/2568838721 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f87b4066f30 0x7f87b40693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f87c80b24c0 tx=0x7f87bc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.586+0000 7f87cdfc4700 1 -- 172.21.15.112:0/2568838721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87c8068590 msgr2=0x7f87c80cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.586+0000 7f87cdfc4700 1 --2- 172.21.15.112:0/2568838721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87c8068590 0x7f87c80cd200 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f87b800cd80 tx=0x7f87b8001ae0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.586+0000 7f87cdfc4700 1 -- 172.21.15.112:0/2568838721 shutdown_connections 2023-10-06T04:39:31.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.586+0000 7f87cdfc4700 1 --2- 172.21.15.112:0/2568838721 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f87b4066f30 0x7f87b40693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.586+0000 7f87cdfc4700 1 --2- 172.21.15.112:0/2568838721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87c815d620 0x7f87c806f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.586+0000 7f87cdfc4700 1 --2- 172.21.15.112:0/2568838721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87c8068590 0x7f87c80cd200 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.586+0000 7f87cdfc4700 1 --2- 172.21.15.112:0/2568838721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87c8159a50 0x7f87c806eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.586+0000 7f87cdfc4700 1 -- 172.21.15.112:0/2568838721 >> 172.21.15.112:0/2568838721 conn(0x7f87c80631f0 msgr2=0x7f87c80ae600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:31.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.586+0000 7f87cdfc4700 1 -- 172.21.15.112:0/2568838721 shutdown_connections 2023-10-06T04:39:31.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.586+0000 7f87cdfc4700 1 -- 172.21.15.112:0/2568838721 wait complete. 2023-10-06T04:39:31.599 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:39:31.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.714+0000 7f245764f700 1 Processor -- start 2023-10-06T04:39:31.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.715+0000 7f245764f700 1 -- start start 2023-10-06T04:39:31.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.715+0000 7f245764f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2450159a20 0x7f24500cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.715+0000 7f245764f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245015af50 con 0x7f245015c720 2023-10-06T04:39:31.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.715+0000 7f245764f700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245015e370 con 0x7f245006d3b0 2023-10-06T04:39:31.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.715+0000 7f245764f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24500cca70 con 0x7f2450159a20 2023-10-06T04:39:31.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.715+0000 7f24553eb700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2450159a20 0x7f24500cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.715+0000 7f2455bec700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f245015c720 0x7f245015dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60262/0 (socket says 172.21.15.112:60262) 2023-10-06T04:39:31.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.716+0000 7f2455bec700 1 -- 172.21.15.112:0/426644784 learned_addr learned my addr 172.21.15.112:0/426644784 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:31.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.716+0000 7f24553eb700 1 -- 172.21.15.112:0/426644784 >> v1:172.21.15.179:6789/0 conn(0x7f245006d3b0 legacy=0x7f245015d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.716+0000 7f24553eb700 1 -- 172.21.15.112:0/426644784 >> v1:172.21.15.112:6789/0 conn(0x7f245015c720 legacy=0x7f245015dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.716+0000 7f24553eb700 1 -- 172.21.15.112:0/426644784 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24500cae50 con 0x7f2450159a20 2023-10-06T04:39:31.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.716+0000 7f2447fff700 1 -- 172.21.15.112:0/426644784 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80980967 0 0) 0x7f245015af50 con 0x7f245015c720 2023-10-06T04:39:31.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.716+0000 7f24553eb700 1 --2- 172.21.15.112:0/426644784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2450159a20 0x7f24500cb7f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f244c0098e0 tx=0x7f244c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6deb9cfb57aa36e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:31.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.716+0000 7f2447fff700 1 -- 172.21.15.112:0/426644784 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c009e80 con 0x7f2450159a20 2023-10-06T04:39:31.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.716+0000 7f2447fff700 1 -- 172.21.15.112:0/426644784 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c00b860 con 0x7f2450159a20 2023-10-06T04:39:31.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.716+0000 7f2447fff700 1 -- 172.21.15.112:0/426644784 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c00bbe0 con 0x7f2450159a20 2023-10-06T04:39:31.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.717+0000 7f245764f700 1 -- 172.21.15.112:0/426644784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2450159a20 msgr2=0x7f24500cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.717+0000 7f245764f700 1 --2- 172.21.15.112:0/426644784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2450159a20 0x7f24500cb7f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f244c0098e0 tx=0x7f244c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.717+0000 7f245764f700 1 -- 172.21.15.112:0/426644784 shutdown_connections 2023-10-06T04:39:31.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.717+0000 7f245764f700 1 --2- 172.21.15.112:0/426644784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2450159a20 0x7f24500cb7f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.717+0000 7f245764f700 1 -- 172.21.15.112:0/426644784 >> 172.21.15.112:0/426644784 conn(0x7f245006cfb0 msgr2=0x7f24500d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:31.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.717+0000 7f245764f700 1 -- 172.21.15.112:0/426644784 shutdown_connections 2023-10-06T04:39:31.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.717+0000 7f245764f700 1 -- 172.21.15.112:0/426644784 wait complete. 2023-10-06T04:39:31.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.718+0000 7f245764f700 1 Processor -- start 2023-10-06T04:39:31.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.718+0000 7f245764f700 1 -- start start 2023-10-06T04:39:31.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.719+0000 7f245764f700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f245006d3b0 0x7f24500b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.719+0000 7f245764f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2450159a20 0x7f245016e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.719+0000 7f245764f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245015c720 0x7f245014a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.719+0000 7f245764f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24500b4f10 con 0x7f245015c720 2023-10-06T04:39:31.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.719+0000 7f245764f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2450158970 con 0x7f2450159a20 2023-10-06T04:39:31.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.719+0000 7f245764f700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2450159180 con 0x7f245006d3b0 2023-10-06T04:39:31.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.719+0000 7f2455bec700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245015c720 0x7f245014a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.719+0000 7f24553eb700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f245006d3b0 0x7f24500b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.719+0000 7f2455bec700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245015c720 0x7f245014a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58386/0 (socket says 172.21.15.112:58386) 2023-10-06T04:39:31.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.719+0000 7f2455bec700 1 -- 172.21.15.112:0/3648840475 learned_addr learned my addr 172.21.15.112:0/3648840475 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:31.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.719+0000 7f2454bea700 1 --2- 172.21.15.112:0/3648840475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2450159a20 0x7f245016e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.719+0000 7f2455bec700 1 -- 172.21.15.112:0/3648840475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f245006d3b0 msgr2=0x7f24500b05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.719+0000 7f2455bec700 1 --2- 172.21.15.112:0/3648840475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f245006d3b0 0x7f24500b05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.719+0000 7f2455bec700 1 -- 172.21.15.112:0/3648840475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2450159a20 msgr2=0x7f245016e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.719+0000 7f2455bec700 1 --2- 172.21.15.112:0/3648840475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2450159a20 0x7f245016e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.719+0000 7f2455bec700 1 -- 172.21.15.112:0/3648840475 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244c009420 con 0x7f245015c720 2023-10-06T04:39:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.719+0000 7f2455bec700 1 --2- 172.21.15.112:0/3648840475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245015c720 0x7f245014a070 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f244800ccc0 tx=0x7f2448001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.720+0000 7f24457fa700 1 -- 172.21.15.112:0/3648840475 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244800a8a0 con 0x7f245015c720 2023-10-06T04:39:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.720+0000 7f24457fa700 1 -- 172.21.15.112:0/3648840475 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244800aa00 con 0x7f245015c720 2023-10-06T04:39:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.720+0000 7f245764f700 1 -- 172.21.15.112:0/3648840475 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245016e5b0 con 0x7f245015c720 2023-10-06T04:39:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.720+0000 7f24457fa700 1 -- 172.21.15.112:0/3648840475 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244800adc0 con 0x7f245015c720 2023-10-06T04:39:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.720+0000 7f245764f700 1 -- 172.21.15.112:0/3648840475 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24500b5140 con 0x7f245015c720 2023-10-06T04:39:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.721+0000 7f245764f700 1 -- 172.21.15.112:0/3648840475 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f245005f230 con 0x7f245015c720 2023-10-06T04:39:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.721+0000 7f24457fa700 1 -- 172.21.15.112:0/3648840475 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2448007300 con 0x7f245015c720 2023-10-06T04:39:31.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.721+0000 7f24457fa700 1 --2- 172.21.15.112:0/3648840475 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2434066f30 0x7f24340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:31.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.721+0000 7f24553eb700 1 --2- 172.21.15.112:0/3648840475 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2434066f30 0x7f24340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:31.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.721+0000 7f24457fa700 1 -- 172.21.15.112:0/3648840475 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f24480849d0 con 0x7f245015c720 2023-10-06T04:39:31.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.722+0000 7f24553eb700 1 --2- 172.21.15.112:0/3648840475 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2434066f30 0x7f24340693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f244c0093f0 tx=0x7f244c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:31.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.726+0000 7f24457fa700 1 -- 172.21.15.112:0/3648840475 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2448051b60 con 0x7f245015c720 2023-10-06T04:39:31.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.906+0000 7f245764f700 1 -- 172.21.15.112:0/3648840475 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f245009e400 con 0x7f245015c720 2023-10-06T04:39:31.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.906+0000 7f24457fa700 1 -- 172.21.15.112:0/3648840475 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2448055180 con 0x7f245015c720 2023-10-06T04:39:31.908 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-10-06T04:39:31.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.909+0000 7f245764f700 1 -- 172.21.15.112:0/3648840475 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2434066f30 msgr2=0x7f24340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.909+0000 7f245764f700 1 --2- 172.21.15.112:0/3648840475 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2434066f30 0x7f24340693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f244c0093f0 tx=0x7f244c017000 comp rx=0 tx=0).stop 2023-10-06T04:39:31.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.909+0000 7f245764f700 1 -- 172.21.15.112:0/3648840475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245015c720 msgr2=0x7f245014a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:31.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.909+0000 7f245764f700 1 --2- 172.21.15.112:0/3648840475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245015c720 0x7f245014a070 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f244800ccc0 tx=0x7f2448001a80 comp rx=0 tx=0).stop 2023-10-06T04:39:31.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.909+0000 7f245764f700 1 -- 172.21.15.112:0/3648840475 shutdown_connections 2023-10-06T04:39:31.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.909+0000 7f245764f700 1 --2- 172.21.15.112:0/3648840475 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2434066f30 0x7f24340693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.909+0000 7f245764f700 1 --2- 172.21.15.112:0/3648840475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245015c720 0x7f245014a070 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.909+0000 7f245764f700 1 --2- 172.21.15.112:0/3648840475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f245006d3b0 0x7f24500b05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.909+0000 7f245764f700 1 --2- 172.21.15.112:0/3648840475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2450159a20 0x7f245016e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:31.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.909+0000 7f245764f700 1 -- 172.21.15.112:0/3648840475 >> 172.21.15.112:0/3648840475 conn(0x7f245006cfb0 msgr2=0x7f2450154090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:31.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.909+0000 7f245764f700 1 -- 172.21.15.112:0/3648840475 shutdown_connections 2023-10-06T04:39:31.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:31.909+0000 7f245764f700 1 -- 172.21.15.112:0/3648840475 wait complete. 2023-10-06T04:39:31.922 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:39:32.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.038+0000 7f041e20d700 1 Processor -- start 2023-10-06T04:39:32.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.038+0000 7f041e20d700 1 -- start start 2023-10-06T04:39:32.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.039+0000 7f041e20d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0418159a20 0x7f04180cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.039+0000 7f041e20d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f041806d3b0 0x7f04180cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.039+0000 7f041e20d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041815af50 con 0x7f041815a9f0 2023-10-06T04:39:32.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.039+0000 7f041e20d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04180cca70 con 0x7f041806d3b0 2023-10-06T04:39:32.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.039+0000 7f041e20d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041808a080 con 0x7f0418159a20 2023-10-06T04:39:32.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.039+0000 7f040ffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f041806d3b0 0x7f04180cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.039+0000 7f040ffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f041806d3b0 0x7f04180cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58390/0 (socket says 172.21.15.112:58390) 2023-10-06T04:39:32.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.039+0000 7f040ffff700 1 -- 172.21.15.112:0/3947248184 learned_addr learned my addr 172.21.15.112:0/3947248184 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:32.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.039+0000 7f04177fe700 1 --2- 172.21.15.112:0/3947248184 >> v2:172.21.15.179:3300/0 conn(0x7f0418159a20 0x7f04180cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.039+0000 7f040ffff700 1 -- 172.21.15.112:0/3947248184 >> v2:172.21.15.179:3300/0 conn(0x7f0418159a20 msgr2=0x7f04180cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.039+0000 7f040ffff700 1 --2- 172.21.15.112:0/3947248184 >> v2:172.21.15.179:3300/0 conn(0x7f0418159a20 0x7f04180cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.039+0000 7f040ffff700 1 -- 172.21.15.112:0/3947248184 >> v1:172.21.15.179:6789/0 conn(0x7f041815a9f0 legacy=0x7f041815d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.039+0000 7f040ffff700 1 -- 172.21.15.112:0/3947248184 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04180cae50 con 0x7f041806d3b0 2023-10-06T04:39:32.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.039+0000 7f04177fe700 1 --2- 172.21.15.112:0/3947248184 >> v2:172.21.15.179:3300/0 conn(0x7f0418159a20 0x7f04180cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:32.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.039+0000 7f040ffff700 1 --2- 172.21.15.112:0/3947248184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f041806d3b0 0x7f04180cbd30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0418088260 tx=0x7f0400009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9980037e60cd2710 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.039+0000 7f0416ffd700 1 -- 172.21.15.112:0/3947248184 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040000b820 con 0x7f041806d3b0 2023-10-06T04:39:32.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.039+0000 7f0416ffd700 1 -- 172.21.15.112:0/3947248184 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040000b980 con 0x7f041806d3b0 2023-10-06T04:39:32.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.039+0000 7f0416ffd700 1 -- 172.21.15.112:0/3947248184 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040000bd20 con 0x7f041806d3b0 2023-10-06T04:39:32.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.040+0000 7f041e20d700 1 -- 172.21.15.112:0/3947248184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f041806d3b0 msgr2=0x7f04180cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.040+0000 7f041e20d700 1 --2- 172.21.15.112:0/3947248184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f041806d3b0 0x7f04180cbd30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0418088260 tx=0x7f0400009250 comp rx=0 tx=0).stop 2023-10-06T04:39:32.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.040+0000 7f041e20d700 1 -- 172.21.15.112:0/3947248184 shutdown_connections 2023-10-06T04:39:32.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.040+0000 7f041e20d700 1 --2- 172.21.15.112:0/3947248184 >> v2:172.21.15.179:3300/0 conn(0x7f0418159a20 0x7f04180cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.040+0000 7f041e20d700 1 --2- 172.21.15.112:0/3947248184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f041806d3b0 0x7f04180cbd30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.040+0000 7f041e20d700 1 -- 172.21.15.112:0/3947248184 >> 172.21.15.112:0/3947248184 conn(0x7f041806cfb0 msgr2=0x7f04180d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.040+0000 7f041e20d700 1 -- 172.21.15.112:0/3947248184 shutdown_connections 2023-10-06T04:39:32.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.040+0000 7f041e20d700 1 -- 172.21.15.112:0/3947248184 wait complete. 2023-10-06T04:39:32.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.041+0000 7f041e20d700 1 Processor -- start 2023-10-06T04:39:32.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.041+0000 7f041e20d700 1 -- start start 2023-10-06T04:39:32.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f041e20d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f041806d3b0 0x7f041816af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f041e20d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0418159a20 0x7f0418155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f041e20d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f041815a9f0 0x7f0418156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f041e20d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041816a930 con 0x7f041806d3b0 2023-10-06T04:39:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f041e20d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0418159030 con 0x7f0418159a20 2023-10-06T04:39:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f041e20d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04180b1320 con 0x7f041815a9f0 2023-10-06T04:39:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f04177fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f041806d3b0 0x7f041816af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f04177fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f041806d3b0 0x7f041816af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58402/0 (socket says 172.21.15.112:58402) 2023-10-06T04:39:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f04177fe700 1 -- 172.21.15.112:0/1094018809 learned_addr learned my addr 172.21.15.112:0/1094018809 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f040ffff700 1 --2- 172.21.15.112:0/1094018809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0418159a20 0x7f0418155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f0417fff700 1 --2- 172.21.15.112:0/1094018809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f041815a9f0 0x7f0418156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f04177fe700 1 -- 172.21.15.112:0/1094018809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f041815a9f0 msgr2=0x7f0418156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f04177fe700 1 --2- 172.21.15.112:0/1094018809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f041815a9f0 0x7f0418156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f04177fe700 1 -- 172.21.15.112:0/1094018809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0418159a20 msgr2=0x7f0418155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f04177fe700 1 --2- 172.21.15.112:0/1094018809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0418159a20 0x7f0418155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f04177fe700 1 -- 172.21.15.112:0/1094018809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04000094f0 con 0x7f041806d3b0 2023-10-06T04:39:32.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f040ffff700 1 --2- 172.21.15.112:0/1094018809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0418159a20 0x7f0418155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:32.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f04177fe700 1 --2- 172.21.15.112:0/1094018809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f041806d3b0 0x7f041816af10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f040800e8d0 tx=0x7f0408008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f040f7fe700 1 -- 172.21.15.112:0/1094018809 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040800ee70 con 0x7f041806d3b0 2023-10-06T04:39:32.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f040f7fe700 1 -- 172.21.15.112:0/1094018809 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040800c5e0 con 0x7f041806d3b0 2023-10-06T04:39:32.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f041e20d700 1 -- 172.21.15.112:0/1094018809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0418158a70 con 0x7f041806d3b0 2023-10-06T04:39:32.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.042+0000 7f040f7fe700 1 -- 172.21.15.112:0/1094018809 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040800c980 con 0x7f041806d3b0 2023-10-06T04:39:32.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.043+0000 7f041e20d700 1 -- 172.21.15.112:0/1094018809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04180b0fb0 con 0x7f041806d3b0 2023-10-06T04:39:32.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.043+0000 7f041e20d700 1 -- 172.21.15.112:0/1094018809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041805f230 con 0x7f041806d3b0 2023-10-06T04:39:32.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.044+0000 7f040f7fe700 1 -- 172.21.15.112:0/1094018809 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0408013410 con 0x7f041806d3b0 2023-10-06T04:39:32.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.044+0000 7f040f7fe700 1 --2- 172.21.15.112:0/1094018809 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f03f8066f30 0x7f03f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.044+0000 7f040f7fe700 1 -- 172.21.15.112:0/1094018809 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0408084480 con 0x7f041806d3b0 2023-10-06T04:39:32.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.044+0000 7f040ffff700 1 --2- 172.21.15.112:0/1094018809 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f03f8066f30 0x7f03f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.045+0000 7f040ffff700 1 --2- 172.21.15.112:0/1094018809 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f03f8066f30 0x7f03f80693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0418088260 tx=0x7f0400017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.048+0000 7f040f7fe700 1 -- 172.21.15.112:0/1094018809 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0408051590 con 0x7f041806d3b0 2023-10-06T04:39:32.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.230+0000 7f041e20d700 1 -- 172.21.15.112:0/1094018809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f04180cb0f0 con 0x7f041806d3b0 2023-10-06T04:39:32.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.230+0000 7f040f7fe700 1 -- 172.21.15.112:0/1094018809 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0408054bb0 con 0x7f041806d3b0 2023-10-06T04:39:32.232 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-10-06T04:39:32.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.232+0000 7f041e20d700 1 -- 172.21.15.112:0/1094018809 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f03f8066f30 msgr2=0x7f03f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.232+0000 7f041e20d700 1 --2- 172.21.15.112:0/1094018809 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f03f8066f30 0x7f03f80693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0418088260 tx=0x7f0400017000 comp rx=0 tx=0).stop 2023-10-06T04:39:32.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.232+0000 7f041e20d700 1 -- 172.21.15.112:0/1094018809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f041806d3b0 msgr2=0x7f041816af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.232+0000 7f041e20d700 1 --2- 172.21.15.112:0/1094018809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f041806d3b0 0x7f041816af10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f040800e8d0 tx=0x7f0408008040 comp rx=0 tx=0).stop 2023-10-06T04:39:32.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.232+0000 7f041e20d700 1 -- 172.21.15.112:0/1094018809 shutdown_connections 2023-10-06T04:39:32.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.232+0000 7f041e20d700 1 --2- 172.21.15.112:0/1094018809 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f03f8066f30 0x7f03f80693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.232+0000 7f041e20d700 1 --2- 172.21.15.112:0/1094018809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f041815a9f0 0x7f0418156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.235 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.232+0000 7f041e20d700 1 --2- 172.21.15.112:0/1094018809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f041806d3b0 0x7f041816af10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.235 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.232+0000 7f041e20d700 1 --2- 172.21.15.112:0/1094018809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0418159a20 0x7f0418155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.235 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.232+0000 7f041e20d700 1 -- 172.21.15.112:0/1094018809 >> 172.21.15.112:0/1094018809 conn(0x7f041806cfb0 msgr2=0x7f041814d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.235 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.232+0000 7f041e20d700 1 -- 172.21.15.112:0/1094018809 shutdown_connections 2023-10-06T04:39:32.235 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.232+0000 7f041e20d700 1 -- 172.21.15.112:0/1094018809 wait complete. 2023-10-06T04:39:32.246 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:39:32.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.361+0000 7f5ff3b41700 1 Processor -- start 2023-10-06T04:39:32.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.361+0000 7f5ff3b41700 1 -- start start 2023-10-06T04:39:32.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff3b41700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5fec06d3b0 0x7f5fec15be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff3b41700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec15af50 con 0x7f5fec159a20 2023-10-06T04:39:32.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff3b41700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec0cae50 con 0x7f5fec0cbf00 2023-10-06T04:39:32.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff3b41700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fec0cca70 con 0x7f5fec06d3b0 2023-10-06T04:39:32.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff18dd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5fec159a20 0x7f5fec0cb7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60278/0 (socket says 172.21.15.112:60278) 2023-10-06T04:39:32.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff18dd700 1 -- 172.21.15.112:0/512285402 learned_addr learned my addr 172.21.15.112:0/512285402 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:32.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff08db700 1 -- 172.21.15.112:0/512285402 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571371148 0 0) 0x7f5fec15af50 con 0x7f5fec159a20 2023-10-06T04:39:32.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff08db700 1 -- 172.21.15.112:0/512285402 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fd8003570 con 0x7f5fec159a20 2023-10-06T04:39:32.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff20de700 1 --2- 172.21.15.112:0/512285402 >> v2:172.21.15.179:3300/0 conn(0x7f5fec06d3b0 0x7f5fec15be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff08db700 1 -- 172.21.15.112:0/512285402 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2919465368 0 0) 0x7f5fd8003570 con 0x7f5fec159a20 2023-10-06T04:39:32.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff08db700 1 -- 172.21.15.112:0/512285402 >> v2:172.21.15.179:3300/0 conn(0x7f5fec06d3b0 msgr2=0x7f5fec15be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff08db700 1 --2- 172.21.15.112:0/512285402 >> v2:172.21.15.179:3300/0 conn(0x7f5fec06d3b0 0x7f5fec15be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff08db700 1 -- 172.21.15.112:0/512285402 >> v1:172.21.15.179:6789/0 conn(0x7f5fec0cbf00 legacy=0x7f5fec15b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff08db700 1 -- 172.21.15.112:0/512285402 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec0cb0f0 con 0x7f5fec159a20 2023-10-06T04:39:32.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff08db700 1 -- 172.21.15.112:0/512285402 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f5fe40017f0 con 0x7f5fec159a20 2023-10-06T04:39:32.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff08db700 1 -- 172.21.15.112:0/512285402 >> v1:172.21.15.112:6789/0 conn(0x7f5fec159a20 legacy=0x7f5fec0cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff08db700 1 --2- 172.21.15.112:0/512285402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fd8003a60 0x7f5fd8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff08db700 1 --2- 172.21.15.112:0/512285402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fd8004810 0x7f5fd8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff08db700 1 --2- 172.21.15.112:0/512285402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd80052e0 0x7f5fd800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff08db700 1 -- 172.21.15.112:0/512285402 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0cca70 con 0x7f5fd80052e0 2023-10-06T04:39:32.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff08db700 1 -- 172.21.15.112:0/512285402 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd800c230 con 0x7f5fd8003a60 2023-10-06T04:39:32.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.362+0000 7f5ff08db700 1 -- 172.21.15.112:0/512285402 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd800c3f0 con 0x7f5fd8004810 2023-10-06T04:39:32.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.363+0000 7f5ff20de700 1 --2- 172.21.15.112:0/512285402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd80052e0 0x7f5fd800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.363+0000 7f5ff18dd700 1 --2- 172.21.15.112:0/512285402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fd8003a60 0x7f5fd8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.363+0000 7f5ff10dc700 1 --2- 172.21.15.112:0/512285402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fd8004810 0x7f5fd8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.363+0000 7f5ff20de700 1 -- 172.21.15.112:0/512285402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fd8004810 msgr2=0x7f5fd8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.363+0000 7f5ff20de700 1 --2- 172.21.15.112:0/512285402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fd8004810 0x7f5fd8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.363+0000 7f5ff20de700 1 -- 172.21.15.112:0/512285402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fd8003a60 msgr2=0x7f5fd8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.363+0000 7f5ff20de700 1 --2- 172.21.15.112:0/512285402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fd8003a60 0x7f5fd8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.363+0000 7f5ff20de700 1 -- 172.21.15.112:0/512285402 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd8003570 con 0x7f5fd80052e0 2023-10-06T04:39:32.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.363+0000 7f5ff20de700 1 -- 172.21.15.112:0/512285402 reap_dead start 2023-10-06T04:39:32.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.363+0000 7f5ff20de700 1 --2- 172.21.15.112:0/512285402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd80052e0 0x7f5fd800ba60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800bb70 tx=0x7f5fe8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7b8d0128e24dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.363+0000 7f5ff08db700 1 -- 172.21.15.112:0/512285402 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe800b4e0 con 0x7f5fd80052e0 2023-10-06T04:39:32.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.363+0000 7f5ff08db700 1 -- 172.21.15.112:0/512285402 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe800d5d0 con 0x7f5fd80052e0 2023-10-06T04:39:32.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.363+0000 7f5ff08db700 1 -- 172.21.15.112:0/512285402 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe800d990 con 0x7f5fd80052e0 2023-10-06T04:39:32.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.364+0000 7f5ff3b41700 1 -- 172.21.15.112:0/512285402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd80052e0 msgr2=0x7f5fd800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.364+0000 7f5ff3b41700 1 --2- 172.21.15.112:0/512285402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd80052e0 0x7f5fd800ba60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800bb70 tx=0x7f5fe8008040 comp rx=0 tx=0).stop 2023-10-06T04:39:32.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.364+0000 7f5ff3b41700 1 -- 172.21.15.112:0/512285402 shutdown_connections 2023-10-06T04:39:32.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.364+0000 7f5ff3b41700 1 --2- 172.21.15.112:0/512285402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd80052e0 0x7f5fd800ba60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.364+0000 7f5ff3b41700 1 -- 172.21.15.112:0/512285402 >> 172.21.15.112:0/512285402 conn(0x7f5fec06cfb0 msgr2=0x7f5fec0d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.364+0000 7f5ff3b41700 1 -- 172.21.15.112:0/512285402 shutdown_connections 2023-10-06T04:39:32.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.364+0000 7f5ff3b41700 1 -- 172.21.15.112:0/512285402 wait complete. 2023-10-06T04:39:32.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.365+0000 7f5ff3b41700 1 Processor -- start 2023-10-06T04:39:32.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.365+0000 7f5ff3b41700 1 -- start start 2023-10-06T04:39:32.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.366+0000 7f5ff3b41700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fd80052e0 0x7f5fec16d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.366+0000 7f5ff3b41700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fec16e350 0x7f5fec16dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.366+0000 7f5ff3b41700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fec0b0800 0x7f5fec0b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.366+0000 7f5ff3b41700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec16b670 con 0x7f5fec0b0800 2023-10-06T04:39:32.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.366+0000 7f5ff3b41700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0b18e0 con 0x7f5fd80052e0 2023-10-06T04:39:32.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.366+0000 7f5ff3b41700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0b1bc0 con 0x7f5fec16e350 2023-10-06T04:39:32.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.366+0000 7f5ff20de700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fec0b0800 0x7f5fec0b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.366+0000 7f5ff20de700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fec0b0800 0x7f5fec0b0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58410/0 (socket says 172.21.15.112:58410) 2023-10-06T04:39:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.366+0000 7f5ff20de700 1 -- 172.21.15.112:0/4224543059 learned_addr learned my addr 172.21.15.112:0/4224543059 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.366+0000 7f5ff10dc700 1 --2- 172.21.15.112:0/4224543059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fec16e350 0x7f5fec16dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.366+0000 7f5ff20de700 1 -- 172.21.15.112:0/4224543059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fec16e350 msgr2=0x7f5fec16dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.366+0000 7f5ff20de700 1 --2- 172.21.15.112:0/4224543059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fec16e350 0x7f5fec16dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.366+0000 7f5ff20de700 1 -- 172.21.15.112:0/4224543059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fd80052e0 msgr2=0x7f5fec16d730 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:39:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.366+0000 7f5ff20de700 1 --2- 172.21.15.112:0/4224543059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fd80052e0 0x7f5fec16d730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.366+0000 7f5ff20de700 1 -- 172.21.15.112:0/4224543059 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec0b1ea0 con 0x7f5fec0b0800 2023-10-06T04:39:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.366+0000 7f5ff20de700 1 --2- 172.21.15.112:0/4224543059 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fec0b0800 0x7f5fec0b0c80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800bfd0 tx=0x7f5fe8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.366+0000 7f5fe1ffb700 1 -- 172.21.15.112:0/4224543059 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe800a040 con 0x7f5fec0b0800 2023-10-06T04:39:32.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.366+0000 7f5fe1ffb700 1 -- 172.21.15.112:0/4224543059 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe8022030 con 0x7f5fec0b0800 2023-10-06T04:39:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.366+0000 7f5ff3b41700 1 -- 172.21.15.112:0/4224543059 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fec16b300 con 0x7f5fec0b0800 2023-10-06T04:39:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.366+0000 7f5fe1ffb700 1 -- 172.21.15.112:0/4224543059 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8012bc0 con 0x7f5fec0b0800 2023-10-06T04:39:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.366+0000 7f5ff3b41700 1 -- 172.21.15.112:0/4224543059 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fec0b1380 con 0x7f5fec0b0800 2023-10-06T04:39:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.367+0000 7f5ff3b41700 1 -- 172.21.15.112:0/4224543059 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fec16b490 con 0x7f5fec0b0800 2023-10-06T04:39:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.368+0000 7f5fe1ffb700 1 -- 172.21.15.112:0/4224543059 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5fe8028480 con 0x7f5fec0b0800 2023-10-06T04:39:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.368+0000 7f5fe1ffb700 1 --2- 172.21.15.112:0/4224543059 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5fd0066f60 0x7f5fd0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.368+0000 7f5ff18dd700 1 --2- 172.21.15.112:0/4224543059 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5fd0066f60 0x7f5fd0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.368+0000 7f5fe1ffb700 1 -- 172.21.15.112:0/4224543059 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5fe8085910 con 0x7f5fec0b0800 2023-10-06T04:39:32.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.369+0000 7f5ff18dd700 1 --2- 172.21.15.112:0/4224543059 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5fd0066f60 0x7f5fd0069410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4001190 tx=0x7f5fec064630 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.373+0000 7f5fe1ffb700 1 -- 172.21.15.112:0/4224543059 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fe8052b60 con 0x7f5fec0b0800 2023-10-06T04:39:32.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.556+0000 7f5ff3b41700 1 -- 172.21.15.112:0/4224543059 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5fec0b1660 con 0x7f5fec0b0800 2023-10-06T04:39:32.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.557+0000 7f5fe1ffb700 1 -- 172.21.15.112:0/4224543059 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5fe8056180 con 0x7f5fec0b0800 2023-10-06T04:39:32.559 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-10-06T04:39:32.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.559+0000 7f5ff3b41700 1 -- 172.21.15.112:0/4224543059 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5fd0066f60 msgr2=0x7f5fd0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.559+0000 7f5ff3b41700 1 --2- 172.21.15.112:0/4224543059 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5fd0066f60 0x7f5fd0069410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4001190 tx=0x7f5fec064630 comp rx=0 tx=0).stop 2023-10-06T04:39:32.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.559+0000 7f5ff3b41700 1 -- 172.21.15.112:0/4224543059 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fec0b0800 msgr2=0x7f5fec0b0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.559+0000 7f5ff3b41700 1 --2- 172.21.15.112:0/4224543059 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fec0b0800 0x7f5fec0b0c80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800bfd0 tx=0x7f5fe8018000 comp rx=0 tx=0).stop 2023-10-06T04:39:32.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.559+0000 7f5ff3b41700 1 -- 172.21.15.112:0/4224543059 shutdown_connections 2023-10-06T04:39:32.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.559+0000 7f5ff3b41700 1 --2- 172.21.15.112:0/4224543059 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5fd0066f60 0x7f5fd0069410 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.559+0000 7f5ff3b41700 1 --2- 172.21.15.112:0/4224543059 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fec0b0800 0x7f5fec0b0c80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.559+0000 7f5ff3b41700 1 --2- 172.21.15.112:0/4224543059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fd80052e0 0x7f5fec16d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.559+0000 7f5ff3b41700 1 --2- 172.21.15.112:0/4224543059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fec16e350 0x7f5fec16dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.559+0000 7f5ff3b41700 1 -- 172.21.15.112:0/4224543059 >> 172.21.15.112:0/4224543059 conn(0x7f5fec06cfb0 msgr2=0x7f5fec0cb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.559+0000 7f5ff3b41700 1 -- 172.21.15.112:0/4224543059 shutdown_connections 2023-10-06T04:39:32.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.559+0000 7f5ff3b41700 1 -- 172.21.15.112:0/4224543059 wait complete. 2023-10-06T04:39:32.572 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:39:32.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.685+0000 7f6f81454700 1 Processor -- start 2023-10-06T04:39:32.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.685+0000 7f6f81454700 1 -- start start 2023-10-06T04:39:32.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.686+0000 7f6f81454700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6f7c15dfa0 0x7f6f7c15b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.686+0000 7f6f81454700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6f7c06cfb0 0x7f6f7c15b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.686+0000 7f6f81454700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7c0ae950 con 0x7f6f7c15d4c0 2023-10-06T04:39:32.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.686+0000 7f6f81454700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7c0ae020 con 0x7f6f7c06cfb0 2023-10-06T04:39:32.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.686+0000 7f6f81454700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7c0ae300 con 0x7f6f7c15dfa0 2023-10-06T04:39:32.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.686+0000 7f6f7b7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6f7c06cfb0 0x7f6f7c15b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.686+0000 7f6f7b7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6f7c06cfb0 0x7f6f7c15b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58422/0 (socket says 172.21.15.112:58422) 2023-10-06T04:39:32.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.686+0000 7f6f7b7fe700 1 -- 172.21.15.112:0/4205801150 learned_addr learned my addr 172.21.15.112:0/4205801150 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:32.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.686+0000 7f6f7a7fc700 1 --2- 172.21.15.112:0/4205801150 >> v2:172.21.15.179:3300/0 conn(0x7f6f7c15dfa0 0x7f6f7c15b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.686+0000 7f6f7b7fe700 1 -- 172.21.15.112:0/4205801150 >> v2:172.21.15.179:3300/0 conn(0x7f6f7c15dfa0 msgr2=0x7f6f7c15b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.686+0000 7f6f7b7fe700 1 --2- 172.21.15.112:0/4205801150 >> v2:172.21.15.179:3300/0 conn(0x7f6f7c15dfa0 0x7f6f7c15b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.686+0000 7f6f7b7fe700 1 -- 172.21.15.112:0/4205801150 >> v1:172.21.15.179:6789/0 conn(0x7f6f7c15d4c0 legacy=0x7f6f7c15d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:32.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.686+0000 7f6f7b7fe700 1 -- 172.21.15.112:0/4205801150 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c0ae5e0 con 0x7f6f7c06cfb0 2023-10-06T04:39:32.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.686+0000 7f6f7b7fe700 1 --2- 172.21.15.112:0/4205801150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f7c06cfb0 0x7f6f7c15b800 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0b02b0 tx=0x7f6f6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc30e0b2691f1953 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.686+0000 7f6f79ffb700 1 -- 172.21.15.112:0/4205801150 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c00b820 con 0x7f6f7c06cfb0 2023-10-06T04:39:32.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.686+0000 7f6f79ffb700 1 -- 172.21.15.112:0/4205801150 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c00b980 con 0x7f6f7c06cfb0 2023-10-06T04:39:32.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.686+0000 7f6f79ffb700 1 -- 172.21.15.112:0/4205801150 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c00bd20 con 0x7f6f7c06cfb0 2023-10-06T04:39:32.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.687+0000 7f6f81454700 1 -- 172.21.15.112:0/4205801150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f7c06cfb0 msgr2=0x7f6f7c15b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.687+0000 7f6f81454700 1 --2- 172.21.15.112:0/4205801150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f7c06cfb0 0x7f6f7c15b800 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0b02b0 tx=0x7f6f6c009250 comp rx=0 tx=0).stop 2023-10-06T04:39:32.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.687+0000 7f6f81454700 1 -- 172.21.15.112:0/4205801150 shutdown_connections 2023-10-06T04:39:32.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.687+0000 7f6f81454700 1 --2- 172.21.15.112:0/4205801150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f7c06cfb0 0x7f6f7c15b800 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.687+0000 7f6f81454700 1 --2- 172.21.15.112:0/4205801150 >> v2:172.21.15.179:3300/0 conn(0x7f6f7c15dfa0 0x7f6f7c15b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.687+0000 7f6f81454700 1 -- 172.21.15.112:0/4205801150 >> 172.21.15.112:0/4205801150 conn(0x7f6f7c08a240 msgr2=0x7f6f7c099b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:32.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.687+0000 7f6f81454700 1 -- 172.21.15.112:0/4205801150 shutdown_connections 2023-10-06T04:39:32.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.687+0000 7f6f81454700 1 -- 172.21.15.112:0/4205801150 wait complete. 2023-10-06T04:39:32.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.688+0000 7f6f81454700 1 Processor -- start 2023-10-06T04:39:32.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.688+0000 7f6f81454700 1 -- start start 2023-10-06T04:39:32.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.689+0000 7f6f81454700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f7c06cfb0 0x7f6f7c15a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.689+0000 7f6f81454700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f7c15d4c0 0x7f6f7c0c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.689+0000 7f6f81454700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f7c15dfa0 0x7f6f7c0c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.689+0000 7f6f81454700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c16adf0 con 0x7f6f7c15dfa0 2023-10-06T04:39:32.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.689+0000 7f6f81454700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c16bf20 con 0x7f6f7c06cfb0 2023-10-06T04:39:32.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.689+0000 7f6f81454700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c16b030 con 0x7f6f7c15d4c0 2023-10-06T04:39:32.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.689+0000 7f6f7b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f7c15dfa0 0x7f6f7c0c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.689+0000 7f6f7b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f7c15dfa0 0x7f6f7c0c6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58424/0 (socket says 172.21.15.112:58424) 2023-10-06T04:39:32.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.689+0000 7f6f7b7fe700 1 -- 172.21.15.112:0/2076031300 learned_addr learned my addr 172.21.15.112:0/2076031300 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:32.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.689+0000 7f6f7a7fc700 1 --2- 172.21.15.112:0/2076031300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f7c15d4c0 0x7f6f7c0c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.689+0000 7f6f7affd700 1 --2- 172.21.15.112:0/2076031300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f7c06cfb0 0x7f6f7c15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.689+0000 7f6f7b7fe700 1 -- 172.21.15.112:0/2076031300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f7c15d4c0 msgr2=0x7f6f7c0c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.689+0000 7f6f7b7fe700 1 --2- 172.21.15.112:0/2076031300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f7c15d4c0 0x7f6f7c0c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.689+0000 7f6f7b7fe700 1 -- 172.21.15.112:0/2076031300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f7c06cfb0 msgr2=0x7f6f7c15a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:32.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.689+0000 7f6f7b7fe700 1 --2- 172.21.15.112:0/2076031300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f7c06cfb0 0x7f6f7c15a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:32.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.689+0000 7f6f7b7fe700 1 -- 172.21.15.112:0/2076031300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c0094f0 con 0x7f6f7c15dfa0 2023-10-06T04:39:32.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.689+0000 7f6f7affd700 1 --2- 172.21.15.112:0/2076031300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f7c06cfb0 0x7f6f7c15a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:32.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.689+0000 7f6f7b7fe700 1 --2- 172.21.15.112:0/2076031300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f7c15dfa0 0x7f6f7c0c6830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0b6a40 tx=0x7f6f6c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.690+0000 7f6f62ffd700 1 -- 172.21.15.112:0/2076031300 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c01b450 con 0x7f6f7c15dfa0 2023-10-06T04:39:32.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.690+0000 7f6f62ffd700 1 -- 172.21.15.112:0/2076031300 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c020070 con 0x7f6f7c15dfa0 2023-10-06T04:39:32.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.690+0000 7f6f81454700 1 -- 172.21.15.112:0/2076031300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f7c16b310 con 0x7f6f7c15dfa0 2023-10-06T04:39:32.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.690+0000 7f6f62ffd700 1 -- 172.21.15.112:0/2076031300 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c01b820 con 0x7f6f7c15dfa0 2023-10-06T04:39:32.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.690+0000 7f6f81454700 1 -- 172.21.15.112:0/2076031300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7c16b8d0 con 0x7f6f7c15dfa0 2023-10-06T04:39:32.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.691+0000 7f6f81454700 1 -- 172.21.15.112:0/2076031300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f7c05f230 con 0x7f6f7c15dfa0 2023-10-06T04:39:32.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.691+0000 7f6f62ffd700 1 -- 172.21.15.112:0/2076031300 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f6c022030 con 0x7f6f7c15dfa0 2023-10-06T04:39:32.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.691+0000 7f6f62ffd700 1 --2- 172.21.15.112:0/2076031300 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6f68066f30 0x7f6f680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:32.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.691+0000 7f6f62ffd700 1 -- 172.21.15.112:0/2076031300 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6f6c0867c0 con 0x7f6f7c15dfa0 2023-10-06T04:39:32.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.691+0000 7f6f7affd700 1 --2- 172.21.15.112:0/2076031300 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6f68066f30 0x7f6f680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:32.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.692+0000 7f6f7affd700 1 --2- 172.21.15.112:0/2076031300 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6f68066f30 0x7f6f680693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c06d7e0 tx=0x7f6f740096c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:32.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.696+0000 7f6f62ffd700 1 -- 172.21.15.112:0/2076031300 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f6c0538d0 con 0x7f6f7c15dfa0 2023-10-06T04:39:32.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.925+0000 7f6f81454700 1 -- 172.21.15.112:0/2076031300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f7c05f230 con 0x7f6f7c15dfa0 2023-10-06T04:39:33.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.925+0000 7f6f62ffd700 1 -- 172.21.15.112:0/2076031300 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f6f6c056ef0 con 0x7f6f7c15dfa0 2023-10-06T04:39:33.190 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:33.190 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1694304040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1694304040},{"type":"v1","addr":"172.21.15.112:6837","nonce":1694304040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3750383657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3750383657},{"type":"v1","addr":"172.21.15.112:6835","nonce":3750383657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2217480877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2217480877},{"type":"v1","addr":"172.21.15.179:6834","nonce":2217480877}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:39:21.015278+0000","modified":"2023-10-06T04:39:24.651029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/140836226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":140836226},{"type":"v1","addr":"172.21.15.179:6835","nonce":140836226}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:39:33.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.927+0000 7f6f81454700 1 -- 172.21.15.112:0/2076031300 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6f68066f30 msgr2=0x7f6f680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.927+0000 7f6f81454700 1 --2- 172.21.15.112:0/2076031300 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6f68066f30 0x7f6f680693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c06d7e0 tx=0x7f6f740096c0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.927+0000 7f6f81454700 1 -- 172.21.15.112:0/2076031300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f7c15dfa0 msgr2=0x7f6f7c0c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.927+0000 7f6f81454700 1 --2- 172.21.15.112:0/2076031300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f7c15dfa0 0x7f6f7c0c6830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0b6a40 tx=0x7f6f6c016000 comp rx=0 tx=0).stop 2023-10-06T04:39:33.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.927+0000 7f6f81454700 1 -- 172.21.15.112:0/2076031300 shutdown_connections 2023-10-06T04:39:33.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.927+0000 7f6f81454700 1 --2- 172.21.15.112:0/2076031300 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6f68066f30 0x7f6f680693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.927+0000 7f6f81454700 1 --2- 172.21.15.112:0/2076031300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f7c15dfa0 0x7f6f7c0c6830 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.927+0000 7f6f81454700 1 --2- 172.21.15.112:0/2076031300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f7c06cfb0 0x7f6f7c15a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.927+0000 7f6f81454700 1 --2- 172.21.15.112:0/2076031300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f7c15d4c0 0x7f6f7c0c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.927+0000 7f6f81454700 1 -- 172.21.15.112:0/2076031300 >> 172.21.15.112:0/2076031300 conn(0x7f6f7c08a240 msgr2=0x7f6f7c0b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:33.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.927+0000 7f6f81454700 1 -- 172.21.15.112:0/2076031300 shutdown_connections 2023-10-06T04:39:33.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:32.927+0000 7f6f81454700 1 -- 172.21.15.112:0/2076031300 wait complete. 2023-10-06T04:39:33.192 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 7 2023-10-06T04:39:33.193 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:33.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.307+0000 7fc5654f8700 1 Processor -- start 2023-10-06T04:39:33.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.308+0000 7fc5654f8700 1 -- start start 2023-10-06T04:39:33.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.308+0000 7fc5654f8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc560156340 0x7fc56006b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.308+0000 7fc5654f8700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc560156710 0x7fc5600b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.308+0000 7fc5654f8700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56015b000 con 0x7fc56006bde0 2023-10-06T04:39:33.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.308+0000 7fc5654f8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56006b410 con 0x7fc560156340 2023-10-06T04:39:33.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.308+0000 7fc5654f8700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56015ad20 con 0x7fc560156710 2023-10-06T04:39:33.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.309+0000 7fc55effd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc560156340 0x7fc56006b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.309+0000 7fc55effd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc560156340 0x7fc56006b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58438/0 (socket says 172.21.15.112:58438) 2023-10-06T04:39:33.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.309+0000 7fc55effd700 1 -- 172.21.15.112:0/4137911502 learned_addr learned my addr 172.21.15.112:0/4137911502 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:33.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.309+0000 7fc55effd700 1 -- 172.21.15.112:0/4137911502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc560156710 msgr2=0x7fc5600b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:33.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.309+0000 7fc55f7fe700 1 --2- 172.21.15.112:0/4137911502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc560156710 0x7fc5600b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.309+0000 7fc55effd700 1 --2- 172.21.15.112:0/4137911502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc560156710 0x7fc5600b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.309+0000 7fc55effd700 1 -- 172.21.15.112:0/4137911502 >> v1:172.21.15.179:6789/0 conn(0x7fc56006bde0 legacy=0x7fc560067b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:33.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.309+0000 7fc55effd700 1 -- 172.21.15.112:0/4137911502 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56006adc0 con 0x7fc560156340 2023-10-06T04:39:33.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.309+0000 7fc55effd700 1 --2- 172.21.15.112:0/4137911502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc560156340 0x7fc56006b8a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc55000d1a0 tx=0x7fc55000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a2c57bd61ef67f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:33.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.309+0000 7fc55dffb700 1 -- 172.21.15.112:0/4137911502 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc550010070 con 0x7fc560156340 2023-10-06T04:39:33.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.309+0000 7fc55dffb700 1 -- 172.21.15.112:0/4137911502 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55000de80 con 0x7fc560156340 2023-10-06T04:39:33.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.309+0000 7fc55dffb700 1 -- 172.21.15.112:0/4137911502 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55000b320 con 0x7fc560156340 2023-10-06T04:39:33.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.310+0000 7fc5654f8700 1 -- 172.21.15.112:0/4137911502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc560156340 msgr2=0x7fc56006b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.310+0000 7fc5654f8700 1 --2- 172.21.15.112:0/4137911502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc560156340 0x7fc56006b8a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc55000d1a0 tx=0x7fc55000ba50 comp rx=0 tx=0).stop 2023-10-06T04:39:33.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.310+0000 7fc5654f8700 1 -- 172.21.15.112:0/4137911502 shutdown_connections 2023-10-06T04:39:33.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.310+0000 7fc5654f8700 1 --2- 172.21.15.112:0/4137911502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc560156710 0x7fc5600b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.310+0000 7fc5654f8700 1 --2- 172.21.15.112:0/4137911502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc560156340 0x7fc56006b8a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.310+0000 7fc5654f8700 1 -- 172.21.15.112:0/4137911502 >> 172.21.15.112:0/4137911502 conn(0x7fc56006e350 msgr2=0x7fc5600cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:33.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.310+0000 7fc5654f8700 1 -- 172.21.15.112:0/4137911502 shutdown_connections 2023-10-06T04:39:33.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.310+0000 7fc5654f8700 1 -- 172.21.15.112:0/4137911502 wait complete. 2023-10-06T04:39:33.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.311+0000 7fc5654f8700 1 Processor -- start 2023-10-06T04:39:33.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.311+0000 7fc5654f8700 1 -- start start 2023-10-06T04:39:33.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc5654f8700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc56006bde0 0x7fc56014e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc5654f8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc560156340 0x7fc5600c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc5654f8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc560156710 0x7fc5600c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc5654f8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc560157530 con 0x7fc560156710 2023-10-06T04:39:33.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc5654f8700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5600cce30 con 0x7fc560156340 2023-10-06T04:39:33.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc5654f8700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc560156c40 con 0x7fc56006bde0 2023-10-06T04:39:33.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc55f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc560156710 0x7fc5600c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc55f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc560156710 0x7fc5600c6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58452/0 (socket says 172.21.15.112:58452) 2023-10-06T04:39:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc55f7fe700 1 -- 172.21.15.112:0/3041755787 learned_addr learned my addr 172.21.15.112:0/3041755787 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc55e7fc700 1 --2- 172.21.15.112:0/3041755787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc560156340 0x7fc5600c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc55effd700 1 --2- 172.21.15.112:0/3041755787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc56006bde0 0x7fc56014e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc55f7fe700 1 -- 172.21.15.112:0/3041755787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc56006bde0 msgr2=0x7fc56014e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc55f7fe700 1 --2- 172.21.15.112:0/3041755787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc56006bde0 0x7fc56014e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc55f7fe700 1 -- 172.21.15.112:0/3041755787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc560156340 msgr2=0x7fc5600c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc55f7fe700 1 --2- 172.21.15.112:0/3041755787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc560156340 0x7fc5600c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc55f7fe700 1 -- 172.21.15.112:0/3041755787 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55000bcf0 con 0x7fc560156710 2023-10-06T04:39:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc55f7fe700 1 --2- 172.21.15.112:0/3041755787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc560156710 0x7fc5600c6d30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc55800c880 tx=0x7fc558008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc546ffd700 1 -- 172.21.15.112:0/3041755787 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558011600 con 0x7fc560156710 2023-10-06T04:39:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc546ffd700 1 -- 172.21.15.112:0/3041755787 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc558011760 con 0x7fc560156710 2023-10-06T04:39:33.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc5654f8700 1 -- 172.21.15.112:0/3041755787 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc560156ee0 con 0x7fc560156710 2023-10-06T04:39:33.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc546ffd700 1 -- 172.21.15.112:0/3041755787 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558011b20 con 0x7fc560156710 2023-10-06T04:39:33.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.312+0000 7fc5654f8700 1 -- 172.21.15.112:0/3041755787 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc560169e50 con 0x7fc560156710 2023-10-06T04:39:33.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.313+0000 7fc5654f8700 1 -- 172.21.15.112:0/3041755787 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5601576e0 con 0x7fc560156710 2023-10-06T04:39:33.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.314+0000 7fc546ffd700 1 -- 172.21.15.112:0/3041755787 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc558018360 con 0x7fc560156710 2023-10-06T04:39:33.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.314+0000 7fc546ffd700 1 --2- 172.21.15.112:0/3041755787 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc54c066f30 0x7fc54c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.314+0000 7fc55effd700 1 --2- 172.21.15.112:0/3041755787 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc54c066f30 0x7fc54c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.314+0000 7fc546ffd700 1 -- 172.21.15.112:0/3041755787 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc558084250 con 0x7fc560156710 2023-10-06T04:39:33.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.314+0000 7fc55effd700 1 --2- 172.21.15.112:0/3041755787 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc54c066f30 0x7fc54c0693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc55000ba90 tx=0x7fc550019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:33.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.318+0000 7fc546ffd700 1 -- 172.21.15.112:0/3041755787 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5601576e0 con 0x7fc560156710 2023-10-06T04:39:33.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.503+0000 7fc5654f8700 1 -- 172.21.15.112:0/3041755787 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc56005f230 con 0x7fc560156710 2023-10-06T04:39:33.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.504+0000 7fc546ffd700 1 -- 172.21.15.112:0/3041755787 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7fc558054df0 con 0x7fc560156710 2023-10-06T04:39:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:33.506 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:39:22.637355+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:18.657040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:19.972295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:33.507 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.506+0000 7fc5654f8700 1 -- 172.21.15.112:0/3041755787 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc54c066f30 msgr2=0x7fc54c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.506+0000 7fc5654f8700 1 --2- 172.21.15.112:0/3041755787 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc54c066f30 0x7fc54c0693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc55000ba90 tx=0x7fc550019000 comp rx=0 tx=0).stop 2023-10-06T04:39:33.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.506+0000 7fc5654f8700 1 -- 172.21.15.112:0/3041755787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc560156710 msgr2=0x7fc5600c6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.506+0000 7fc5654f8700 1 --2- 172.21.15.112:0/3041755787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc560156710 0x7fc5600c6d30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc55800c880 tx=0x7fc558008040 comp rx=0 tx=0).stop 2023-10-06T04:39:33.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.506+0000 7fc5654f8700 1 -- 172.21.15.112:0/3041755787 shutdown_connections 2023-10-06T04:39:33.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.506+0000 7fc5654f8700 1 --2- 172.21.15.112:0/3041755787 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc54c066f30 0x7fc54c0693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.506+0000 7fc5654f8700 1 --2- 172.21.15.112:0/3041755787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc560156710 0x7fc5600c6d30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.506+0000 7fc5654f8700 1 --2- 172.21.15.112:0/3041755787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc56006bde0 0x7fc56014e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.506+0000 7fc5654f8700 1 --2- 172.21.15.112:0/3041755787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc560156340 0x7fc5600c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.506+0000 7fc5654f8700 1 -- 172.21.15.112:0/3041755787 >> 172.21.15.112:0/3041755787 conn(0x7fc56006e350 msgr2=0x7fc56014ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:33.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.506+0000 7fc5654f8700 1 -- 172.21.15.112:0/3041755787 shutdown_connections 2023-10-06T04:39:33.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.506+0000 7fc5654f8700 1 -- 172.21.15.112:0/3041755787 wait complete. 2023-10-06T04:39:33.520 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:13.929254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:39:14.321892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:39:18.657040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:39:19.972295+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:39:33.520 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:39:33.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.636+0000 7f49f9dd8700 1 Processor -- start 2023-10-06T04:39:33.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.636+0000 7f49f9dd8700 1 -- start start 2023-10-06T04:39:33.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.637+0000 7f49f9dd8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f49f406cee0 0x7f49f4159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.637+0000 7f49f9dd8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f40b0ae0 con 0x7f49f4159840 2023-10-06T04:39:33.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.637+0000 7f49f9dd8700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f406b930 con 0x7f49f406b450 2023-10-06T04:39:33.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.637+0000 7f49f9dd8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f406bef0 con 0x7f49f406cee0 2023-10-06T04:39:33.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.637+0000 7f49f95d7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f49f406cee0 0x7f49f4159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.637+0000 7f49f8dd6700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f49f4159840 0x7f49f40cb880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60284/0 (socket says 172.21.15.112:60284) 2023-10-06T04:39:33.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.637+0000 7f49f8dd6700 1 -- 172.21.15.112:0/1327595161 learned_addr learned my addr 172.21.15.112:0/1327595161 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:33.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.637+0000 7f49f95d7700 1 -- 172.21.15.112:0/1327595161 >> v1:172.21.15.179:6789/0 conn(0x7f49f406b450 legacy=0x7f49f406c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.637+0000 7f49f95d7700 1 -- 172.21.15.112:0/1327595161 >> v1:172.21.15.112:6789/0 conn(0x7f49f4159840 legacy=0x7f49f40cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.637+0000 7f49f95d7700 1 -- 172.21.15.112:0/1327595161 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f406bc10 con 0x7f49f406cee0 2023-10-06T04:39:33.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.637+0000 7f49eb7fe700 1 -- 172.21.15.112:0/1327595161 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286821905 0 0) 0x7f49f40b0ae0 con 0x7f49f4159840 2023-10-06T04:39:33.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.637+0000 7f49f95d7700 1 --2- 172.21.15.112:0/1327595161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f406cee0 0x7f49f4159c10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49ec009e60 tx=0x7f49ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254c77096904ad28 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:33.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.638+0000 7f49eb7fe700 1 -- 172.21.15.112:0/1327595161 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ec00e070 con 0x7f49f406cee0 2023-10-06T04:39:33.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.638+0000 7f49eb7fe700 1 -- 172.21.15.112:0/1327595161 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ec00bc30 con 0x7f49f406cee0 2023-10-06T04:39:33.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.638+0000 7f49eb7fe700 1 -- 172.21.15.112:0/1327595161 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ec012430 con 0x7f49f406cee0 2023-10-06T04:39:33.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.638+0000 7f49f9dd8700 1 -- 172.21.15.112:0/1327595161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f406cee0 msgr2=0x7f49f4159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.638+0000 7f49f9dd8700 1 --2- 172.21.15.112:0/1327595161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f406cee0 0x7f49f4159c10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49ec009e60 tx=0x7f49ec009780 comp rx=0 tx=0).stop 2023-10-06T04:39:33.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.638+0000 7f49f9dd8700 1 -- 172.21.15.112:0/1327595161 shutdown_connections 2023-10-06T04:39:33.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.638+0000 7f49f9dd8700 1 --2- 172.21.15.112:0/1327595161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f406cee0 0x7f49f4159c10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.638+0000 7f49f9dd8700 1 -- 172.21.15.112:0/1327595161 >> 172.21.15.112:0/1327595161 conn(0x7f49f406d8e0 msgr2=0x7f49f406dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:33.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.638+0000 7f49f9dd8700 1 -- 172.21.15.112:0/1327595161 shutdown_connections 2023-10-06T04:39:33.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.639+0000 7f49f9dd8700 1 -- 172.21.15.112:0/1327595161 wait complete. 2023-10-06T04:39:33.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.640+0000 7f49f9dd8700 1 Processor -- start 2023-10-06T04:39:33.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.640+0000 7f49f9dd8700 1 -- start start 2023-10-06T04:39:33.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.640+0000 7f49f9dd8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49f406b450 0x7f49f41518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.640+0000 7f49f9dd8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f406cee0 0x7f49f41543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.640+0000 7f49f9dd8700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f4159840 0x7f49f41548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.640+0000 7f49f9dd8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40b34b0 con 0x7f49f406cee0 2023-10-06T04:39:33.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.640+0000 7f49f9dd8700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40c4e60 con 0x7f49f406b450 2023-10-06T04:39:33.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.640+0000 7f49f9dd8700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40c4530 con 0x7f49f4159840 2023-10-06T04:39:33.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.641+0000 7f49ebfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f406cee0 0x7f49f41543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.641+0000 7f49ebfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f406cee0 0x7f49f41543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58480/0 (socket says 172.21.15.112:58480) 2023-10-06T04:39:33.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.641+0000 7f49ebfff700 1 -- 172.21.15.112:0/81372833 learned_addr learned my addr 172.21.15.112:0/81372833 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:33.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.641+0000 7f49f8dd6700 1 --2- 172.21.15.112:0/81372833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49f406b450 0x7f49f41518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.641+0000 7f49f95d7700 1 --2- 172.21.15.112:0/81372833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f4159840 0x7f49f41548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.641+0000 7f49ebfff700 1 -- 172.21.15.112:0/81372833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f4159840 msgr2=0x7f49f41548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.641+0000 7f49ebfff700 1 --2- 172.21.15.112:0/81372833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f4159840 0x7f49f41548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.641+0000 7f49ebfff700 1 -- 172.21.15.112:0/81372833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49f406b450 msgr2=0x7f49f41518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.641+0000 7f49ebfff700 1 --2- 172.21.15.112:0/81372833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49f406b450 0x7f49f41518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.641+0000 7f49ebfff700 1 -- 172.21.15.112:0/81372833 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ec009a20 con 0x7f49f406cee0 2023-10-06T04:39:33.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.641+0000 7f49ebfff700 1 --2- 172.21.15.112:0/81372833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f406cee0 0x7f49f41543b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f49e400c590 tx=0x7f49e400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:33.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.641+0000 7f49e8ff9700 1 -- 172.21.15.112:0/81372833 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4011590 con 0x7f49f406cee0 2023-10-06T04:39:33.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.641+0000 7f49e8ff9700 1 -- 172.21.15.112:0/81372833 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e4011710 con 0x7f49f406cee0 2023-10-06T04:39:33.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.641+0000 7f49f9dd8700 1 -- 172.21.15.112:0/81372833 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f40c4810 con 0x7f49f406cee0 2023-10-06T04:39:33.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.641+0000 7f49e8ff9700 1 -- 172.21.15.112:0/81372833 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4011ad0 con 0x7f49f406cee0 2023-10-06T04:39:33.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.641+0000 7f49f9dd8700 1 -- 172.21.15.112:0/81372833 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f4151e20 con 0x7f49f406cee0 2023-10-06T04:39:33.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.642+0000 7f49f9dd8700 1 -- 172.21.15.112:0/81372833 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f40c4fd0 con 0x7f49f406cee0 2023-10-06T04:39:33.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.642+0000 7f49e8ff9700 1 -- 172.21.15.112:0/81372833 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49e401b3b0 con 0x7f49f406cee0 2023-10-06T04:39:33.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.643+0000 7f49e8ff9700 1 --2- 172.21.15.112:0/81372833 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f49e0066f30 0x7f49e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.643+0000 7f49f8dd6700 1 --2- 172.21.15.112:0/81372833 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f49e0066f30 0x7f49e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.643+0000 7f49e8ff9700 1 -- 172.21.15.112:0/81372833 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f49e4083b00 con 0x7f49f406cee0 2023-10-06T04:39:33.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.643+0000 7f49f8dd6700 1 --2- 172.21.15.112:0/81372833 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f49e0066f30 0x7f49e00693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f49f0007160 tx=0x7f49f0007f50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:33.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.647+0000 7f49e8ff9700 1 -- 172.21.15.112:0/81372833 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49e4050c10 con 0x7f49f406cee0 2023-10-06T04:39:33.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.829+0000 7f49f9dd8700 1 -- 172.21.15.112:0/81372833 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f49f405f230 con 0x7f49f406cee0 2023-10-06T04:39:33.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.830+0000 7f49e8ff9700 1 -- 172.21.15.112:0/81372833 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f49e4017070 con 0x7f49f406cee0 2023-10-06T04:39:33.831 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-10-06T04:39:33.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.832+0000 7f49f9dd8700 1 -- 172.21.15.112:0/81372833 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f49e0066f30 msgr2=0x7f49e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.832+0000 7f49f9dd8700 1 --2- 172.21.15.112:0/81372833 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f49e0066f30 0x7f49e00693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f49f0007160 tx=0x7f49f0007f50 comp rx=0 tx=0).stop 2023-10-06T04:39:33.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.832+0000 7f49f9dd8700 1 -- 172.21.15.112:0/81372833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f406cee0 msgr2=0x7f49f41543b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.832+0000 7f49f9dd8700 1 --2- 172.21.15.112:0/81372833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f406cee0 0x7f49f41543b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f49e400c590 tx=0x7f49e400c8a0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.832+0000 7f49f9dd8700 1 -- 172.21.15.112:0/81372833 shutdown_connections 2023-10-06T04:39:33.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.832+0000 7f49f9dd8700 1 --2- 172.21.15.112:0/81372833 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f49e0066f30 0x7f49e00693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.832+0000 7f49f9dd8700 1 --2- 172.21.15.112:0/81372833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f4159840 0x7f49f41548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.832+0000 7f49f9dd8700 1 --2- 172.21.15.112:0/81372833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49f406b450 0x7f49f41518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.832+0000 7f49f9dd8700 1 --2- 172.21.15.112:0/81372833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f406cee0 0x7f49f41543b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.832+0000 7f49f9dd8700 1 -- 172.21.15.112:0/81372833 >> 172.21.15.112:0/81372833 conn(0x7f49f406d8e0 msgr2=0x7f49f40cd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:33.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.832+0000 7f49f9dd8700 1 -- 172.21.15.112:0/81372833 shutdown_connections 2023-10-06T04:39:33.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.832+0000 7f49f9dd8700 1 -- 172.21.15.112:0/81372833 wait complete. 2023-10-06T04:39:33.845 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:39:33.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.960+0000 7f033186b700 1 Processor -- start 2023-10-06T04:39:33.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.960+0000 7f033186b700 1 -- start start 2023-10-06T04:39:33.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.961+0000 7f033186b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f032c0cbf00 0x7f032c15b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.961+0000 7f033186b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f032c06d3b0 0x7f032c15bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.961+0000 7f033186b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f032c15af50 con 0x7f032c159a20 2023-10-06T04:39:33.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.961+0000 7f033186b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f032c0cca70 con 0x7f032c06d3b0 2023-10-06T04:39:33.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.961+0000 7f033186b700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f032c08a080 con 0x7f032c0cbf00 2023-10-06T04:39:33.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.961+0000 7f032b7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f032c06d3b0 0x7f032c15bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.961+0000 7f032affd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f032c159a20 0x7f032c0cb7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60292/0 (socket says 172.21.15.112:60292) 2023-10-06T04:39:33.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.961+0000 7f032affd700 1 -- 172.21.15.112:0/1056285560 learned_addr learned my addr 172.21.15.112:0/1056285560 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:33.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.961+0000 7f032a7fc700 1 --2- 172.21.15.112:0/1056285560 >> v2:172.21.15.179:3300/0 conn(0x7f032c0cbf00 0x7f032c15b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.961+0000 7f032b7fe700 1 -- 172.21.15.112:0/1056285560 >> v2:172.21.15.179:3300/0 conn(0x7f032c0cbf00 msgr2=0x7f032c15b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:33.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.961+0000 7f032b7fe700 1 --2- 172.21.15.112:0/1056285560 >> v2:172.21.15.179:3300/0 conn(0x7f032c0cbf00 0x7f032c15b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.961+0000 7f032b7fe700 1 -- 172.21.15.112:0/1056285560 >> v1:172.21.15.112:6789/0 conn(0x7f032c159a20 legacy=0x7f032c0cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.961+0000 7f032b7fe700 1 -- 172.21.15.112:0/1056285560 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032c0cae50 con 0x7f032c06d3b0 2023-10-06T04:39:33.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.961+0000 7f0329ffb700 1 -- 172.21.15.112:0/1056285560 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504927181 0 0) 0x7f032c15af50 con 0x7f032c159a20 2023-10-06T04:39:33.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.962+0000 7f032b7fe700 1 --2- 172.21.15.112:0/1056285560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f032c06d3b0 0x7f032c15bc50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f032c08ac00 tx=0x7f03240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe68d4f2af7035a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:33.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.962+0000 7f0329ffb700 1 -- 172.21.15.112:0/1056285560 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032400b6b0 con 0x7f032c06d3b0 2023-10-06T04:39:33.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.962+0000 7f0329ffb700 1 -- 172.21.15.112:0/1056285560 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032400b810 con 0x7f032c06d3b0 2023-10-06T04:39:33.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.962+0000 7f0329ffb700 1 -- 172.21.15.112:0/1056285560 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032400bbb0 con 0x7f032c06d3b0 2023-10-06T04:39:33.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.962+0000 7f033186b700 1 -- 172.21.15.112:0/1056285560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f032c06d3b0 msgr2=0x7f032c15bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.962+0000 7f033186b700 1 --2- 172.21.15.112:0/1056285560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f032c06d3b0 0x7f032c15bc50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f032c08ac00 tx=0x7f03240091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.962+0000 7f033186b700 1 -- 172.21.15.112:0/1056285560 shutdown_connections 2023-10-06T04:39:33.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.962+0000 7f033186b700 1 --2- 172.21.15.112:0/1056285560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f032c06d3b0 0x7f032c15bc50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.962+0000 7f033186b700 1 --2- 172.21.15.112:0/1056285560 >> v2:172.21.15.179:3300/0 conn(0x7f032c0cbf00 0x7f032c15b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.962+0000 7f033186b700 1 -- 172.21.15.112:0/1056285560 >> 172.21.15.112:0/1056285560 conn(0x7f032c06cfb0 msgr2=0x7f032c0d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:33.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.962+0000 7f033186b700 1 -- 172.21.15.112:0/1056285560 shutdown_connections 2023-10-06T04:39:33.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.962+0000 7f033186b700 1 -- 172.21.15.112:0/1056285560 wait complete. 2023-10-06T04:39:33.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.964+0000 7f033186b700 1 Processor -- start 2023-10-06T04:39:33.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.964+0000 7f033186b700 1 -- start start 2023-10-06T04:39:33.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.964+0000 7f033186b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f032c06d3b0 0x7f032c0b2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.964+0000 7f033186b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f032c0cbf00 0x7f032c0b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.964+0000 7f033186b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f032c159a20 0x7f032c14d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.964+0000 7f033186b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032c151470 con 0x7f032c159a20 2023-10-06T04:39:33.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.964+0000 7f033186b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032c151600 con 0x7f032c0cbf00 2023-10-06T04:39:33.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.964+0000 7f033186b700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f032c0b0b10 con 0x7f032c06d3b0 2023-10-06T04:39:33.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.964+0000 7f032b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f032c159a20 0x7f032c14d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.964+0000 7f032b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f032c159a20 0x7f032c14d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58494/0 (socket says 172.21.15.112:58494) 2023-10-06T04:39:33.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.964+0000 7f032b7fe700 1 -- 172.21.15.112:0/296687278 learned_addr learned my addr 172.21.15.112:0/296687278 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:33.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.964+0000 7f032a7fc700 1 --2- 172.21.15.112:0/296687278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f032c0cbf00 0x7f032c0b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.964+0000 7f032affd700 1 --2- 172.21.15.112:0/296687278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f032c06d3b0 0x7f032c0b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.965+0000 7f032b7fe700 1 -- 172.21.15.112:0/296687278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f032c06d3b0 msgr2=0x7f032c0b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.965+0000 7f032b7fe700 1 --2- 172.21.15.112:0/296687278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f032c06d3b0 0x7f032c0b2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.965+0000 7f032b7fe700 1 -- 172.21.15.112:0/296687278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f032c0cbf00 msgr2=0x7f032c0b05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.965+0000 7f032b7fe700 1 --2- 172.21.15.112:0/296687278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f032c0cbf00 0x7f032c0b05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.965+0000 7f032b7fe700 1 -- 172.21.15.112:0/296687278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0324009420 con 0x7f032c159a20 2023-10-06T04:39:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.965+0000 7f032b7fe700 1 --2- 172.21.15.112:0/296687278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f032c159a20 0x7f032c14d620 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0324013000 tx=0x7f0324017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.965+0000 7f0312ffd700 1 -- 172.21.15.112:0/296687278 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324011630 con 0x7f032c159a20 2023-10-06T04:39:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.965+0000 7f0312ffd700 1 -- 172.21.15.112:0/296687278 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0324011790 con 0x7f032c159a20 2023-10-06T04:39:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.965+0000 7f033186b700 1 -- 172.21.15.112:0/296687278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f032c0b0da0 con 0x7f032c159a20 2023-10-06T04:39:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.965+0000 7f0312ffd700 1 -- 172.21.15.112:0/296687278 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324011b50 con 0x7f032c159a20 2023-10-06T04:39:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.965+0000 7f033186b700 1 -- 172.21.15.112:0/296687278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f032c0b1360 con 0x7f032c159a20 2023-10-06T04:39:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.966+0000 7f033186b700 1 -- 172.21.15.112:0/296687278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f032c151770 con 0x7f032c159a20 2023-10-06T04:39:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.966+0000 7f0312ffd700 1 -- 172.21.15.112:0/296687278 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f032402e440 con 0x7f032c159a20 2023-10-06T04:39:33.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.966+0000 7f0312ffd700 1 --2- 172.21.15.112:0/296687278 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0318066f30 0x7f03180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:33.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.967+0000 7f0312ffd700 1 -- 172.21.15.112:0/296687278 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f03240862a0 con 0x7f032c159a20 2023-10-06T04:39:33.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.967+0000 7f032affd700 1 --2- 172.21.15.112:0/296687278 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0318066f30 0x7f03180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:33.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.967+0000 7f032affd700 1 --2- 172.21.15.112:0/296687278 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0318066f30 0x7f03180693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f031c002230 tx=0x7f031c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:33.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:33.971+0000 7f0312ffd700 1 -- 172.21.15.112:0/296687278 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f032c151770 con 0x7f032c159a20 2023-10-06T04:39:34.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.154+0000 7f033186b700 1 -- 172.21.15.112:0/296687278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f032c151770 con 0x7f032c159a20 2023-10-06T04:39:34.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.154+0000 7f0312ffd700 1 -- 172.21.15.112:0/296687278 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f032c151770 con 0x7f032c159a20 2023-10-06T04:39:34.156 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-10-06T04:39:34.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.156+0000 7f033186b700 1 -- 172.21.15.112:0/296687278 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0318066f30 msgr2=0x7f03180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.156+0000 7f033186b700 1 --2- 172.21.15.112:0/296687278 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0318066f30 0x7f03180693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f031c002230 tx=0x7f031c009040 comp rx=0 tx=0).stop 2023-10-06T04:39:34.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.156+0000 7f033186b700 1 -- 172.21.15.112:0/296687278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f032c159a20 msgr2=0x7f032c14d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.156+0000 7f033186b700 1 --2- 172.21.15.112:0/296687278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f032c159a20 0x7f032c14d620 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0324013000 tx=0x7f0324017000 comp rx=0 tx=0).stop 2023-10-06T04:39:34.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.156+0000 7f033186b700 1 -- 172.21.15.112:0/296687278 shutdown_connections 2023-10-06T04:39:34.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.156+0000 7f033186b700 1 --2- 172.21.15.112:0/296687278 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0318066f30 0x7f03180693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.156+0000 7f033186b700 1 --2- 172.21.15.112:0/296687278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f032c159a20 0x7f032c14d620 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.156+0000 7f033186b700 1 --2- 172.21.15.112:0/296687278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f032c06d3b0 0x7f032c0b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.156+0000 7f033186b700 1 --2- 172.21.15.112:0/296687278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f032c0cbf00 0x7f032c0b05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.156+0000 7f033186b700 1 -- 172.21.15.112:0/296687278 >> 172.21.15.112:0/296687278 conn(0x7f032c06cfb0 msgr2=0x7f032c0af040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.156+0000 7f033186b700 1 -- 172.21.15.112:0/296687278 shutdown_connections 2023-10-06T04:39:34.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.156+0000 7f033186b700 1 -- 172.21.15.112:0/296687278 wait complete. 2023-10-06T04:39:34.169 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:39:34.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.285+0000 7f15711b0700 1 Processor -- start 2023-10-06T04:39:34.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.285+0000 7f15711b0700 1 -- start start 2023-10-06T04:39:34.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.286+0000 7f15711b0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f156c159a20 0x7f156c0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.286+0000 7f15711b0700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f156c15c720 0x7f156c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.286+0000 7f15711b0700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156c15af50 con 0x7f156c06d3b0 2023-10-06T04:39:34.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.286+0000 7f15711b0700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156c0cca70 con 0x7f156c159a20 2023-10-06T04:39:34.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.286+0000 7f15711b0700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156c08a080 con 0x7f156c15c720 2023-10-06T04:39:34.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.286+0000 7f156ad9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f156c159a20 0x7f156c0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.286+0000 7f156ad9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f156c159a20 0x7f156c0cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58500/0 (socket says 172.21.15.112:58500) 2023-10-06T04:39:34.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.286+0000 7f156ad9d700 1 -- 172.21.15.112:0/1341748503 learned_addr learned my addr 172.21.15.112:0/1341748503 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:34.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.286+0000 7f156b59e700 1 --2- 172.21.15.112:0/1341748503 >> v2:172.21.15.179:3300/0 conn(0x7f156c15c720 0x7f156c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.287+0000 7f156ad9d700 1 -- 172.21.15.112:0/1341748503 >> v2:172.21.15.179:3300/0 conn(0x7f156c15c720 msgr2=0x7f156c0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:34.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.287+0000 7f156ad9d700 1 --2- 172.21.15.112:0/1341748503 >> v2:172.21.15.179:3300/0 conn(0x7f156c15c720 0x7f156c0cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.287+0000 7f156ad9d700 1 -- 172.21.15.112:0/1341748503 >> v1:172.21.15.179:6789/0 conn(0x7f156c06d3b0 legacy=0x7f156c15d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.287+0000 7f156ad9d700 1 -- 172.21.15.112:0/1341748503 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c0cae50 con 0x7f156c159a20 2023-10-06T04:39:34.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.287+0000 7f156ad9d700 1 --2- 172.21.15.112:0/1341748503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f156c159a20 0x7f156c0cb7f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f156c088a30 tx=0x7f155c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf284446dcb10af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.287+0000 7f156a59c700 1 -- 172.21.15.112:0/1341748503 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c00b820 con 0x7f156c159a20 2023-10-06T04:39:34.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.287+0000 7f156a59c700 1 -- 172.21.15.112:0/1341748503 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c00b980 con 0x7f156c159a20 2023-10-06T04:39:34.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.287+0000 7f156a59c700 1 -- 172.21.15.112:0/1341748503 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c00bd20 con 0x7f156c159a20 2023-10-06T04:39:34.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.287+0000 7f15711b0700 1 -- 172.21.15.112:0/1341748503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f156c159a20 msgr2=0x7f156c0cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.287+0000 7f15711b0700 1 --2- 172.21.15.112:0/1341748503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f156c159a20 0x7f156c0cb7f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f156c088a30 tx=0x7f155c009250 comp rx=0 tx=0).stop 2023-10-06T04:39:34.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.287+0000 7f15711b0700 1 -- 172.21.15.112:0/1341748503 shutdown_connections 2023-10-06T04:39:34.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.287+0000 7f15711b0700 1 --2- 172.21.15.112:0/1341748503 >> v2:172.21.15.179:3300/0 conn(0x7f156c15c720 0x7f156c0cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.287+0000 7f15711b0700 1 --2- 172.21.15.112:0/1341748503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f156c159a20 0x7f156c0cb7f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.287+0000 7f15711b0700 1 -- 172.21.15.112:0/1341748503 >> 172.21.15.112:0/1341748503 conn(0x7f156c06cfb0 msgr2=0x7f156c0d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.287+0000 7f15711b0700 1 -- 172.21.15.112:0/1341748503 shutdown_connections 2023-10-06T04:39:34.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.287+0000 7f15711b0700 1 -- 172.21.15.112:0/1341748503 wait complete. 2023-10-06T04:39:34.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.289+0000 7f15711b0700 1 Processor -- start 2023-10-06T04:39:34.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.289+0000 7f15711b0700 1 -- start start 2023-10-06T04:39:34.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.289+0000 7f15711b0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f156c06d3b0 0x7f156c150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.289+0000 7f15711b0700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f156c159a20 0x7f156c15cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.289+0000 7f15711b0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f156c15c720 0x7f156c15f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.289+0000 7f15711b0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c156e50 con 0x7f156c15c720 2023-10-06T04:39:34.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.289+0000 7f15711b0700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c15d4b0 con 0x7f156c06d3b0 2023-10-06T04:39:34.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.289+0000 7f15711b0700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156c15d790 con 0x7f156c159a20 2023-10-06T04:39:34.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.289+0000 7f156b59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f156c15c720 0x7f156c15f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.289+0000 7f156b59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f156c15c720 0x7f156c15f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58508/0 (socket says 172.21.15.112:58508) 2023-10-06T04:39:34.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.289+0000 7f156b59e700 1 -- 172.21.15.112:0/3537340520 learned_addr learned my addr 172.21.15.112:0/3537340520 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:34.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.290+0000 7f156ad9d700 1 --2- 172.21.15.112:0/3537340520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f156c06d3b0 0x7f156c150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.290+0000 7f156259c700 1 --2- 172.21.15.112:0/3537340520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f156c159a20 0x7f156c15cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.290+0000 7f156b59e700 1 -- 172.21.15.112:0/3537340520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f156c159a20 msgr2=0x7f156c15cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.290+0000 7f156b59e700 1 --2- 172.21.15.112:0/3537340520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f156c159a20 0x7f156c15cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.290+0000 7f156b59e700 1 -- 172.21.15.112:0/3537340520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f156c06d3b0 msgr2=0x7f156c150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.290+0000 7f156b59e700 1 --2- 172.21.15.112:0/3537340520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f156c06d3b0 0x7f156c150390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.290+0000 7f156b59e700 1 -- 172.21.15.112:0/3537340520 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c0094f0 con 0x7f156c15c720 2023-10-06T04:39:34.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.290+0000 7f156259c700 1 --2- 172.21.15.112:0/3537340520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f156c159a20 0x7f156c15cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:34.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.290+0000 7f156b59e700 1 --2- 172.21.15.112:0/3537340520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f156c15c720 0x7f156c15f400 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1564007f20 tx=0x7f1564009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.290+0000 7f15637fe700 1 -- 172.21.15.112:0/3537340520 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156400ed30 con 0x7f156c15c720 2023-10-06T04:39:34.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.290+0000 7f15637fe700 1 -- 172.21.15.112:0/3537340520 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1564014420 con 0x7f156c15c720 2023-10-06T04:39:34.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.290+0000 7f15711b0700 1 -- 172.21.15.112:0/3537340520 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156c15da70 con 0x7f156c15c720 2023-10-06T04:39:34.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.290+0000 7f15637fe700 1 -- 172.21.15.112:0/3537340520 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15640147e0 con 0x7f156c15c720 2023-10-06T04:39:34.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.290+0000 7f15711b0700 1 -- 172.21.15.112:0/3537340520 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156c15d0f0 con 0x7f156c15c720 2023-10-06T04:39:34.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.291+0000 7f15711b0700 1 -- 172.21.15.112:0/3537340520 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156c157000 con 0x7f156c15c720 2023-10-06T04:39:34.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.291+0000 7f15637fe700 1 -- 172.21.15.112:0/3537340520 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1564014b50 con 0x7f156c15c720 2023-10-06T04:39:34.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.292+0000 7f15637fe700 1 --2- 172.21.15.112:0/3537340520 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f154c066f30 0x7f154c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.292+0000 7f15637fe700 1 -- 172.21.15.112:0/3537340520 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1564084e50 con 0x7f156c15c720 2023-10-06T04:39:34.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.292+0000 7f156ad9d700 1 --2- 172.21.15.112:0/3537340520 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f154c066f30 0x7f154c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.292+0000 7f156ad9d700 1 --2- 172.21.15.112:0/3537340520 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f154c066f30 0x7f154c0693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f156c088a30 tx=0x7f155c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.296+0000 7f15637fe700 1 -- 172.21.15.112:0/3537340520 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f156c157000 con 0x7f156c15c720 2023-10-06T04:39:34.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.480+0000 7f15711b0700 1 -- 172.21.15.112:0/3537340520 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f156c05f230 con 0x7f156c15c720 2023-10-06T04:39:34.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.480+0000 7f15637fe700 1 -- 172.21.15.112:0/3537340520 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1564051ec0 con 0x7f156c15c720 2023-10-06T04:39:34.482 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-10-06T04:39:34.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.482+0000 7f15711b0700 1 -- 172.21.15.112:0/3537340520 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f154c066f30 msgr2=0x7f154c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.482+0000 7f15711b0700 1 --2- 172.21.15.112:0/3537340520 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f154c066f30 0x7f154c0693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f156c088a30 tx=0x7f155c017000 comp rx=0 tx=0).stop 2023-10-06T04:39:34.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.482+0000 7f15711b0700 1 -- 172.21.15.112:0/3537340520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f156c15c720 msgr2=0x7f156c15f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.482+0000 7f15711b0700 1 --2- 172.21.15.112:0/3537340520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f156c15c720 0x7f156c15f400 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1564007f20 tx=0x7f1564009860 comp rx=0 tx=0).stop 2023-10-06T04:39:34.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.482+0000 7f15711b0700 1 -- 172.21.15.112:0/3537340520 shutdown_connections 2023-10-06T04:39:34.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.482+0000 7f15711b0700 1 --2- 172.21.15.112:0/3537340520 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f154c066f30 0x7f154c0693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.482+0000 7f15711b0700 1 --2- 172.21.15.112:0/3537340520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f156c15c720 0x7f156c15f400 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.482+0000 7f15711b0700 1 --2- 172.21.15.112:0/3537340520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f156c06d3b0 0x7f156c150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.482+0000 7f15711b0700 1 --2- 172.21.15.112:0/3537340520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f156c159a20 0x7f156c15cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.482+0000 7f15711b0700 1 -- 172.21.15.112:0/3537340520 >> 172.21.15.112:0/3537340520 conn(0x7f156c06cfb0 msgr2=0x7f156c0af080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.482+0000 7f15711b0700 1 -- 172.21.15.112:0/3537340520 shutdown_connections 2023-10-06T04:39:34.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.482+0000 7f15711b0700 1 -- 172.21.15.112:0/3537340520 wait complete. 2023-10-06T04:39:34.496 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:39:34.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.611+0000 7f8582b06700 1 Processor -- start 2023-10-06T04:39:34.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.611+0000 7f8582b06700 1 -- start start 2023-10-06T04:39:34.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.612+0000 7f8582b06700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f857c1575b0 0x7f857c15be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.612+0000 7f8582b06700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f857c0b18b0 0x7f857c0b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.612+0000 7f8582b06700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857c0cd6d0 con 0x7f857c157980 2023-10-06T04:39:34.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.612+0000 7f8582b06700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857c0ccac0 con 0x7f857c1575b0 2023-10-06T04:39:34.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.612+0000 7f8582b06700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857c0ccda0 con 0x7f857c0b18b0 2023-10-06T04:39:34.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.612+0000 7f85808a2700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f857c1575b0 0x7f857c15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.613+0000 7f85810a3700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f857c0b18b0 0x7f857c0b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.613+0000 7f85808a2700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f857c1575b0 0x7f857c15be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.112:60060/0 (socket says 172.21.15.112:60060) 2023-10-06T04:39:34.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.613+0000 7f8573fff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f857c157980 0x7f857c0cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.112:56350/0 (socket says 172.21.15.112:56350) 2023-10-06T04:39:34.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.613+0000 7f85808a2700 1 -- 172.21.15.112:0/493270561 learned_addr learned my addr 172.21.15.112:0/493270561 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:34.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.613+0000 7f85810a3700 1 -- 172.21.15.112:0/493270561 >> v2:172.21.15.179:3300/0 conn(0x7f857c1575b0 msgr2=0x7f857c15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:34.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.613+0000 7f85810a3700 1 --2- 172.21.15.112:0/493270561 >> v2:172.21.15.179:3300/0 conn(0x7f857c1575b0 0x7f857c15be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.613+0000 7f85810a3700 1 -- 172.21.15.112:0/493270561 >> v1:172.21.15.179:6789/0 conn(0x7f857c157980 legacy=0x7f857c0cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.613+0000 7f85737fe700 1 -- 172.21.15.112:0/493270561 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2968489078 0 0) 0x7f857c0cd6d0 con 0x7f857c157980 2023-10-06T04:39:34.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.613+0000 7f85810a3700 1 -- 172.21.15.112:0/493270561 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c0cd080 con 0x7f857c0b18b0 2023-10-06T04:39:34.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.613+0000 7f85808a2700 1 --2- 172.21.15.112:0/493270561 >> v2:172.21.15.179:3300/0 conn(0x7f857c1575b0 0x7f857c15be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:34.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.613+0000 7f85810a3700 1 --2- 172.21.15.112:0/493270561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f857c0b18b0 0x7f857c0b1d10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8574009e60 tx=0x7f8574009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dca04d10cdc96cb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.613+0000 7f85737fe700 1 -- 172.21.15.112:0/493270561 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857400e070 con 0x7f857c0b18b0 2023-10-06T04:39:34.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.613+0000 7f85737fe700 1 -- 172.21.15.112:0/493270561 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857400bb60 con 0x7f857c0b18b0 2023-10-06T04:39:34.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.613+0000 7f85737fe700 1 -- 172.21.15.112:0/493270561 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8574012430 con 0x7f857c0b18b0 2023-10-06T04:39:34.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.614+0000 7f8582b06700 1 -- 172.21.15.112:0/493270561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f857c0b18b0 msgr2=0x7f857c0b1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.614+0000 7f8582b06700 1 --2- 172.21.15.112:0/493270561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f857c0b18b0 0x7f857c0b1d10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8574009e60 tx=0x7f8574009780 comp rx=0 tx=0).stop 2023-10-06T04:39:34.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.614+0000 7f8582b06700 1 -- 172.21.15.112:0/493270561 shutdown_connections 2023-10-06T04:39:34.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.614+0000 7f8582b06700 1 --2- 172.21.15.112:0/493270561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f857c0b18b0 0x7f857c0b1d10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.614+0000 7f8582b06700 1 --2- 172.21.15.112:0/493270561 >> v2:172.21.15.179:3300/0 conn(0x7f857c1575b0 0x7f857c15be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.614+0000 7f8582b06700 1 -- 172.21.15.112:0/493270561 >> 172.21.15.112:0/493270561 conn(0x7f857c0631f0 msgr2=0x7f857c0635f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.614+0000 7f8582b06700 1 -- 172.21.15.112:0/493270561 shutdown_connections 2023-10-06T04:39:34.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.614+0000 7f8582b06700 1 -- 172.21.15.112:0/493270561 wait complete. 2023-10-06T04:39:34.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.615+0000 7f8582b06700 1 Processor -- start 2023-10-06T04:39:34.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.615+0000 7f8582b06700 1 -- start start 2023-10-06T04:39:34.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.616+0000 7f8582b06700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f857c0b18b0 0x7f857c0c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.616+0000 7f8582b06700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f857c1575b0 0x7f857c1538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.616+0000 7f8582b06700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f857c157980 0x7f857c167b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.616+0000 7f8582b06700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c0c4d40 con 0x7f857c1575b0 2023-10-06T04:39:34.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.616+0000 7f8582b06700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c1683d0 con 0x7f857c157980 2023-10-06T04:39:34.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.616+0000 7f8582b06700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857c1686b0 con 0x7f857c0b18b0 2023-10-06T04:39:34.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.616+0000 7f8573fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f857c1575b0 0x7f857c1538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.616+0000 7f8573fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f857c1575b0 0x7f857c1538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58512/0 (socket says 172.21.15.112:58512) 2023-10-06T04:39:34.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.616+0000 7f8573fff700 1 -- 172.21.15.112:0/1278300984 learned_addr learned my addr 172.21.15.112:0/1278300984 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:34.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.616+0000 7f85810a3700 1 --2- 172.21.15.112:0/1278300984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f857c157980 0x7f857c167b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.616+0000 7f85808a2700 1 --2- 172.21.15.112:0/1278300984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f857c0b18b0 0x7f857c0c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.616+0000 7f8573fff700 1 -- 172.21.15.112:0/1278300984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f857c0b18b0 msgr2=0x7f857c0c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.616+0000 7f8573fff700 1 --2- 172.21.15.112:0/1278300984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f857c0b18b0 0x7f857c0c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.616+0000 7f8573fff700 1 -- 172.21.15.112:0/1278300984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f857c157980 msgr2=0x7f857c167b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.616+0000 7f8573fff700 1 --2- 172.21.15.112:0/1278300984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f857c157980 0x7f857c167b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.616+0000 7f8573fff700 1 -- 172.21.15.112:0/1278300984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85780094f0 con 0x7f857c1575b0 2023-10-06T04:39:34.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.616+0000 7f8573fff700 1 --2- 172.21.15.112:0/1278300984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f857c1575b0 0x7f857c1538d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f856c00c5b0 tx=0x7f856c001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.617+0000 7f8570ff9700 1 -- 172.21.15.112:0/1278300984 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c005a70 con 0x7f857c1575b0 2023-10-06T04:39:34.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.617+0000 7f8570ff9700 1 -- 172.21.15.112:0/1278300984 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856c005bd0 con 0x7f857c1575b0 2023-10-06T04:39:34.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.617+0000 7f8570ff9700 1 -- 172.21.15.112:0/1278300984 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c0070d0 con 0x7f857c1575b0 2023-10-06T04:39:34.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.617+0000 7f8582b06700 1 -- 172.21.15.112:0/1278300984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8574009a20 con 0x7f857c1575b0 2023-10-06T04:39:34.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.617+0000 7f8582b06700 1 -- 172.21.15.112:0/1278300984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857c0c4f90 con 0x7f857c1575b0 2023-10-06T04:39:34.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.618+0000 7f8582b06700 1 -- 172.21.15.112:0/1278300984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857c0c51b0 con 0x7f857c1575b0 2023-10-06T04:39:34.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.618+0000 7f8570ff9700 1 -- 172.21.15.112:0/1278300984 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f856c007480 con 0x7f857c1575b0 2023-10-06T04:39:34.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.618+0000 7f8570ff9700 1 --2- 172.21.15.112:0/1278300984 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8568066f30 0x7f85680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.618+0000 7f8570ff9700 1 -- 172.21.15.112:0/1278300984 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f856c083ae0 con 0x7f857c1575b0 2023-10-06T04:39:34.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.618+0000 7f85808a2700 1 --2- 172.21.15.112:0/1278300984 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8568066f30 0x7f85680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.619+0000 7f85808a2700 1 --2- 172.21.15.112:0/1278300984 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8568066f30 0x7f85680693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f857c0b2f60 tx=0x7f8578009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.622+0000 7f8570ff9700 1 -- 172.21.15.112:0/1278300984 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f856c050bf0 con 0x7f857c1575b0 2023-10-06T04:39:34.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.807+0000 7f8582b06700 1 -- 172.21.15.112:0/1278300984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f857c05f230 con 0x7f857c1575b0 2023-10-06T04:39:34.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.808+0000 7f8570ff9700 1 -- 172.21.15.112:0/1278300984 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f856c017070 con 0x7f857c1575b0 2023-10-06T04:39:34.809 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-10-06T04:39:34.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.809+0000 7f8582b06700 1 -- 172.21.15.112:0/1278300984 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8568066f30 msgr2=0x7f85680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.809+0000 7f8582b06700 1 --2- 172.21.15.112:0/1278300984 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8568066f30 0x7f85680693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f857c0b2f60 tx=0x7f8578009250 comp rx=0 tx=0).stop 2023-10-06T04:39:34.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.809+0000 7f8582b06700 1 -- 172.21.15.112:0/1278300984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f857c1575b0 msgr2=0x7f857c1538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.809+0000 7f8582b06700 1 --2- 172.21.15.112:0/1278300984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f857c1575b0 0x7f857c1538d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f856c00c5b0 tx=0x7f856c001040 comp rx=0 tx=0).stop 2023-10-06T04:39:34.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.809+0000 7f8582b06700 1 -- 172.21.15.112:0/1278300984 shutdown_connections 2023-10-06T04:39:34.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.809+0000 7f8582b06700 1 --2- 172.21.15.112:0/1278300984 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8568066f30 0x7f85680693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.809+0000 7f8582b06700 1 --2- 172.21.15.112:0/1278300984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f857c157980 0x7f857c167b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.810+0000 7f8582b06700 1 --2- 172.21.15.112:0/1278300984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f857c0b18b0 0x7f857c0c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.810+0000 7f8582b06700 1 --2- 172.21.15.112:0/1278300984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f857c1575b0 0x7f857c1538d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.810+0000 7f8582b06700 1 -- 172.21.15.112:0/1278300984 >> 172.21.15.112:0/1278300984 conn(0x7f857c0631f0 msgr2=0x7f857c0cdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.810+0000 7f8582b06700 1 -- 172.21.15.112:0/1278300984 shutdown_connections 2023-10-06T04:39:34.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.810+0000 7f8582b06700 1 -- 172.21.15.112:0/1278300984 wait complete. 2023-10-06T04:39:34.823 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:39:34.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.935+0000 7f6441843700 1 Processor -- start 2023-10-06T04:39:34.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.935+0000 7f6441843700 1 -- start start 2023-10-06T04:39:34.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.936+0000 7f6441843700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f643c159730 0x7f643c15deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.936+0000 7f6441843700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f643c06b6a0 0x7f643c06c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.936+0000 7f6441843700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f643c06cd10 0x7f643c067b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.936+0000 7f6441843700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f643c06d190 con 0x7f643c159730 2023-10-06T04:39:34.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.936+0000 7f6441843700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f643c06bdf0 con 0x7f643c06b6a0 2023-10-06T04:39:34.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.936+0000 7f6441843700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643c0c67f0 con 0x7f643c06cd10 2023-10-06T04:39:34.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.936+0000 7f643affd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f643c159730 0x7f643c15deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.936+0000 7f643affd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f643c159730 0x7f643c15deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58522/0 (socket says 172.21.15.112:58522) 2023-10-06T04:39:34.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.936+0000 7f643affd700 1 -- 172.21.15.112:0/1349234103 learned_addr learned my addr 172.21.15.112:0/1349234103 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:34.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.937+0000 7f64327fc700 1 --2- 172.21.15.112:0/1349234103 >> v2:172.21.15.179:3300/0 conn(0x7f643c06b6a0 0x7f643c06c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.937+0000 7f643b7fe700 1 --2- 172.21.15.112:0/1349234103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f643c06cd10 0x7f643c067b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.937+0000 7f643affd700 1 -- 172.21.15.112:0/1349234103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f643c06cd10 msgr2=0x7f643c067b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:34.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.937+0000 7f643affd700 1 --2- 172.21.15.112:0/1349234103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f643c06cd10 0x7f643c067b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.937+0000 7f643affd700 1 -- 172.21.15.112:0/1349234103 >> v2:172.21.15.179:3300/0 conn(0x7f643c06b6a0 msgr2=0x7f643c06c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:34.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.937+0000 7f643affd700 1 --2- 172.21.15.112:0/1349234103 >> v2:172.21.15.179:3300/0 conn(0x7f643c06b6a0 0x7f643c06c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.937+0000 7f643affd700 1 -- 172.21.15.112:0/1349234103 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c0c7370 con 0x7f643c159730 2023-10-06T04:39:34.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.937+0000 7f64327fc700 1 --2- 172.21.15.112:0/1349234103 >> v2:172.21.15.179:3300/0 conn(0x7f643c06b6a0 0x7f643c06c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:34.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.937+0000 7f643b7fe700 1 --2- 172.21.15.112:0/1349234103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f643c06cd10 0x7f643c067b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:34.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.937+0000 7f643affd700 1 --2- 172.21.15.112:0/1349234103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f643c159730 0x7f643c15deb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f643c0c9f30 tx=0x7f642c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7470b9a1d7954e83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.937+0000 7f643a7fc700 1 -- 172.21.15.112:0/1349234103 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c00b820 con 0x7f643c159730 2023-10-06T04:39:34.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.937+0000 7f643a7fc700 1 -- 172.21.15.112:0/1349234103 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c00b980 con 0x7f643c159730 2023-10-06T04:39:34.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.937+0000 7f643a7fc700 1 -- 172.21.15.112:0/1349234103 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c00bd20 con 0x7f643c159730 2023-10-06T04:39:34.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.937+0000 7f6441843700 1 -- 172.21.15.112:0/1349234103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f643c159730 msgr2=0x7f643c15deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.937+0000 7f6441843700 1 --2- 172.21.15.112:0/1349234103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f643c159730 0x7f643c15deb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f643c0c9f30 tx=0x7f642c009250 comp rx=0 tx=0).stop 2023-10-06T04:39:34.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.938+0000 7f6441843700 1 -- 172.21.15.112:0/1349234103 shutdown_connections 2023-10-06T04:39:34.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.938+0000 7f6441843700 1 --2- 172.21.15.112:0/1349234103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f643c06cd10 0x7f643c067b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.938+0000 7f6441843700 1 --2- 172.21.15.112:0/1349234103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f643c159730 0x7f643c15deb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.938+0000 7f6441843700 1 --2- 172.21.15.112:0/1349234103 >> v2:172.21.15.179:3300/0 conn(0x7f643c06b6a0 0x7f643c06c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.938+0000 7f6441843700 1 -- 172.21.15.112:0/1349234103 >> 172.21.15.112:0/1349234103 conn(0x7f643c06e350 msgr2=0x7f643c0cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:34.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.938+0000 7f6441843700 1 -- 172.21.15.112:0/1349234103 shutdown_connections 2023-10-06T04:39:34.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.938+0000 7f6441843700 1 -- 172.21.15.112:0/1349234103 wait complete. 2023-10-06T04:39:34.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.939+0000 7f6441843700 1 Processor -- start 2023-10-06T04:39:34.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.939+0000 7f6441843700 1 -- start start 2023-10-06T04:39:34.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.939+0000 7f6441843700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f643c06b6a0 0x7f643c15a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.939+0000 7f6441843700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f643c06cd10 0x7f643c147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.939+0000 7f6441843700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f643c159730 0x7f643c169c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.939+0000 7f6441843700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c15b700 con 0x7f643c06b6a0 2023-10-06T04:39:34.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.939+0000 7f6441843700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c148500 con 0x7f643c159730 2023-10-06T04:39:34.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.939+0000 7f6441843700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643c15aaf0 con 0x7f643c06cd10 2023-10-06T04:39:34.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.940+0000 7f643affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f643c06b6a0 0x7f643c15a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.940+0000 7f643affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f643c06b6a0 0x7f643c15a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58524/0 (socket says 172.21.15.112:58524) 2023-10-06T04:39:34.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.940+0000 7f643affd700 1 -- 172.21.15.112:0/1245990879 learned_addr learned my addr 172.21.15.112:0/1245990879 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:34.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.940+0000 7f643b7fe700 1 --2- 172.21.15.112:0/1245990879 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f643c159730 0x7f643c169c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.940+0000 7f64327fc700 1 --2- 172.21.15.112:0/1245990879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f643c06cd10 0x7f643c147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.940+0000 7f643affd700 1 -- 172.21.15.112:0/1245990879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f643c06cd10 msgr2=0x7f643c147fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.940+0000 7f643affd700 1 --2- 172.21.15.112:0/1245990879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f643c06cd10 0x7f643c147fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.940+0000 7f643affd700 1 -- 172.21.15.112:0/1245990879 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f643c159730 msgr2=0x7f643c169c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:34.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.940+0000 7f643affd700 1 --2- 172.21.15.112:0/1245990879 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f643c159730 0x7f643c169c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:34.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.940+0000 7f643affd700 1 -- 172.21.15.112:0/1245990879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c0094f0 con 0x7f643c06b6a0 2023-10-06T04:39:34.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.940+0000 7f643affd700 1 --2- 172.21.15.112:0/1245990879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f643c06b6a0 0x7f643c15a510 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f642c0094c0 tx=0x7f642c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.940+0000 7f64337fe700 1 -- 172.21.15.112:0/1245990879 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c01a420 con 0x7f643c06b6a0 2023-10-06T04:39:34.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.940+0000 7f64337fe700 1 -- 172.21.15.112:0/1245990879 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c01a580 con 0x7f643c06b6a0 2023-10-06T04:39:34.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.940+0000 7f6441843700 1 -- 172.21.15.112:0/1245990879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643c15add0 con 0x7f643c06b6a0 2023-10-06T04:39:34.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.940+0000 7f64337fe700 1 -- 172.21.15.112:0/1245990879 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c01a940 con 0x7f643c06b6a0 2023-10-06T04:39:34.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.940+0000 7f6441843700 1 -- 172.21.15.112:0/1245990879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643c15b390 con 0x7f643c06b6a0 2023-10-06T04:39:34.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.941+0000 7f6441843700 1 -- 172.21.15.112:0/1245990879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f643c05f230 con 0x7f643c06b6a0 2023-10-06T04:39:34.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.941+0000 7f64337fe700 1 -- 172.21.15.112:0/1245990879 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f642c02e450 con 0x7f643c06b6a0 2023-10-06T04:39:34.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.942+0000 7f64337fe700 1 --2- 172.21.15.112:0/1245990879 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f641c066fb0 0x7f641c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:34.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.942+0000 7f64327fc700 1 --2- 172.21.15.112:0/1245990879 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f641c066fb0 0x7f641c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:34.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.942+0000 7f64337fe700 1 -- 172.21.15.112:0/1245990879 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f642c086080 con 0x7f643c06b6a0 2023-10-06T04:39:34.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.942+0000 7f64327fc700 1 --2- 172.21.15.112:0/1245990879 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f641c066fb0 0x7f641c069460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f643c15cf70 tx=0x7f6424008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:34.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:34.946+0000 7f64337fe700 1 -- 172.21.15.112:0/1245990879 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f642c0b75a0 con 0x7f643c06b6a0 2023-10-06T04:39:35.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.173+0000 7f6441843700 1 -- 172.21.15.112:0/1245990879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f643c0c6a40 con 0x7f643c06b6a0 2023-10-06T04:39:35.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.173+0000 7f64337fe700 1 -- 172.21.15.112:0/1245990879 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f642c015090 con 0x7f643c06b6a0 2023-10-06T04:39:35.175 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:35.175 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1694304040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1694304040},{"type":"v1","addr":"172.21.15.112:6837","nonce":1694304040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3750383657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3750383657},{"type":"v1","addr":"172.21.15.112:6835","nonce":3750383657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2217480877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2217480877},{"type":"v1","addr":"172.21.15.179:6834","nonce":2217480877}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:39:21.015278+0000","modified":"2023-10-06T04:39:24.651029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/140836226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":140836226},{"type":"v1","addr":"172.21.15.179:6835","nonce":140836226}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:39:35.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.175+0000 7f6441843700 1 -- 172.21.15.112:0/1245990879 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f641c066fb0 msgr2=0x7f641c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.175+0000 7f6441843700 1 --2- 172.21.15.112:0/1245990879 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f641c066fb0 0x7f641c069460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f643c15cf70 tx=0x7f6424008040 comp rx=0 tx=0).stop 2023-10-06T04:39:35.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.175+0000 7f6441843700 1 -- 172.21.15.112:0/1245990879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f643c06b6a0 msgr2=0x7f643c15a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.175+0000 7f6441843700 1 --2- 172.21.15.112:0/1245990879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f643c06b6a0 0x7f643c15a510 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f642c0094c0 tx=0x7f642c017000 comp rx=0 tx=0).stop 2023-10-06T04:39:35.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.175+0000 7f6441843700 1 -- 172.21.15.112:0/1245990879 shutdown_connections 2023-10-06T04:39:35.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.175+0000 7f6441843700 1 --2- 172.21.15.112:0/1245990879 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f641c066fb0 0x7f641c069460 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.175+0000 7f6441843700 1 --2- 172.21.15.112:0/1245990879 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f643c159730 0x7f643c169c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.175+0000 7f6441843700 1 --2- 172.21.15.112:0/1245990879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f643c06b6a0 0x7f643c15a510 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.175+0000 7f6441843700 1 --2- 172.21.15.112:0/1245990879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f643c06cd10 0x7f643c147fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.175+0000 7f6441843700 1 -- 172.21.15.112:0/1245990879 >> 172.21.15.112:0/1245990879 conn(0x7f643c06e350 msgr2=0x7f643c0b2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:35.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.176+0000 7f6441843700 1 -- 172.21.15.112:0/1245990879 shutdown_connections 2023-10-06T04:39:35.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.176+0000 7f6441843700 1 -- 172.21.15.112:0/1245990879 wait complete. 2023-10-06T04:39:35.178 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 7 2023-10-06T04:39:35.189 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:35.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.301+0000 7fe4d759e700 1 Processor -- start 2023-10-06T04:39:35.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.301+0000 7fe4d759e700 1 -- start start 2023-10-06T04:39:35.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.302+0000 7fe4d759e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe4d80cb050 0x7fe4d8154b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.302+0000 7fe4d759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4d80cb420 0x7fe4d81550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.302+0000 7fe4d759e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d8158ae0 con 0x7fe4d80cbfd0 2023-10-06T04:39:35.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.302+0000 7fe4d759e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d815c020 con 0x7fe4d80cb050 2023-10-06T04:39:35.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.302+0000 7fe4d759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d815bb90 con 0x7fe4d80cb420 2023-10-06T04:39:35.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.302+0000 7fe4d659c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe4d80cb050 0x7fe4d8154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.302+0000 7fe4d6d9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe4d80cbfd0 0x7fe4d80cc430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60294/0 (socket says 172.21.15.112:60294) 2023-10-06T04:39:35.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.303+0000 7fe4d6d9d700 1 -- 172.21.15.112:0/884319367 learned_addr learned my addr 172.21.15.112:0/884319367 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:35.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.303+0000 7fe4d5d9b700 1 --2- 172.21.15.112:0/884319367 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4d80cb420 0x7fe4d81550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.303+0000 7fe4d659c700 1 -- 172.21.15.112:0/884319367 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4d80cb420 msgr2=0x7fe4d81550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:35.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.303+0000 7fe4d659c700 1 --2- 172.21.15.112:0/884319367 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4d80cb420 0x7fe4d81550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.303+0000 7fe4d659c700 1 -- 172.21.15.112:0/884319367 >> v1:172.21.15.112:6789/0 conn(0x7fe4d80cbfd0 legacy=0x7fe4d80cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.303+0000 7fe4d559a700 1 -- 172.21.15.112:0/884319367 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106913281 0 0) 0x7fe4d8158ae0 con 0x7fe4d80cbfd0 2023-10-06T04:39:35.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.303+0000 7fe4d659c700 1 -- 172.21.15.112:0/884319367 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d815b260 con 0x7fe4d80cb050 2023-10-06T04:39:35.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.303+0000 7fe4d659c700 1 --2- 172.21.15.112:0/884319367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d80cb050 0x7fe4d8154b80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009e60 tx=0x7fe4c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c0d064c06303d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:35.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.303+0000 7fe4d559a700 1 -- 172.21.15.112:0/884319367 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c800e070 con 0x7fe4d80cb050 2023-10-06T04:39:35.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.303+0000 7fe4d559a700 1 -- 172.21.15.112:0/884319367 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c800bc30 con 0x7fe4d80cb050 2023-10-06T04:39:35.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.303+0000 7fe4d559a700 1 -- 172.21.15.112:0/884319367 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8012430 con 0x7fe4d80cb050 2023-10-06T04:39:35.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.304+0000 7fe4d759e700 1 -- 172.21.15.112:0/884319367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d80cb050 msgr2=0x7fe4d8154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.304+0000 7fe4d759e700 1 --2- 172.21.15.112:0/884319367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d80cb050 0x7fe4d8154b80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009e60 tx=0x7fe4c8009780 comp rx=0 tx=0).stop 2023-10-06T04:39:35.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.304+0000 7fe4d759e700 1 -- 172.21.15.112:0/884319367 shutdown_connections 2023-10-06T04:39:35.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.304+0000 7fe4d759e700 1 --2- 172.21.15.112:0/884319367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d80cb050 0x7fe4d8154b80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.304+0000 7fe4d759e700 1 --2- 172.21.15.112:0/884319367 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4d80cb420 0x7fe4d81550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.304+0000 7fe4d759e700 1 -- 172.21.15.112:0/884319367 >> 172.21.15.112:0/884319367 conn(0x7fe4d8068050 msgr2=0x7fe4d8068450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:35.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.304+0000 7fe4d759e700 1 -- 172.21.15.112:0/884319367 shutdown_connections 2023-10-06T04:39:35.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.304+0000 7fe4d759e700 1 -- 172.21.15.112:0/884319367 wait complete. 2023-10-06T04:39:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.305+0000 7fe4d759e700 1 Processor -- start 2023-10-06T04:39:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.305+0000 7fe4d759e700 1 -- start start 2023-10-06T04:39:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.305+0000 7fe4d759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4d80cb050 0x7fe4d80694d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.306+0000 7fe4d759e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d80cb420 0x7fe4d80c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.306+0000 7fe4d759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4d80cbfd0 0x7fe4d8150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.306+0000 7fe4d759e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d80ca6a0 con 0x7fe4d80cb420 2023-10-06T04:39:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.306+0000 7fe4d759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d8156e50 con 0x7fe4d80cbfd0 2023-10-06T04:39:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.306+0000 7fe4d759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d80ca3c0 con 0x7fe4d80cb050 2023-10-06T04:39:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.306+0000 7fe4d5d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d80cb420 0x7fe4d80c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.306+0000 7fe4d5d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d80cb420 0x7fe4d80c99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58542/0 (socket says 172.21.15.112:58542) 2023-10-06T04:39:35.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.306+0000 7fe4d5d9b700 1 -- 172.21.15.112:0/864305575 learned_addr learned my addr 172.21.15.112:0/864305575 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:35.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.306+0000 7fe4d5d9b700 1 -- 172.21.15.112:0/864305575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4d80cb050 msgr2=0x7fe4d80694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.306+0000 7fe4d5d9b700 1 --2- 172.21.15.112:0/864305575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4d80cb050 0x7fe4d80694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.306+0000 7fe4d5d9b700 1 -- 172.21.15.112:0/864305575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4d80cbfd0 msgr2=0x7fe4d8150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.306+0000 7fe4d5d9b700 1 --2- 172.21.15.112:0/864305575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4d80cbfd0 0x7fe4d8150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.306+0000 7fe4d5d9b700 1 -- 172.21.15.112:0/864305575 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c8009a20 con 0x7fe4d80cb420 2023-10-06T04:39:35.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.306+0000 7fe4d5d9b700 1 --2- 172.21.15.112:0/864305575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d80cb420 0x7fe4d80c99e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00d890 tx=0x7fe4cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:35.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.306+0000 7fe4c67fc700 1 -- 172.21.15.112:0/864305575 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc0125f0 con 0x7fe4d80cb420 2023-10-06T04:39:35.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.306+0000 7fe4c67fc700 1 -- 172.21.15.112:0/864305575 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4cc012770 con 0x7fe4d80cb420 2023-10-06T04:39:35.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.306+0000 7fe4d759e700 1 -- 172.21.15.112:0/864305575 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d8156800 con 0x7fe4d80cb420 2023-10-06T04:39:35.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.306+0000 7fe4c67fc700 1 -- 172.21.15.112:0/864305575 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc012b30 con 0x7fe4d80cb420 2023-10-06T04:39:35.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.306+0000 7fe4d759e700 1 -- 172.21.15.112:0/864305575 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d806f140 con 0x7fe4d80cb420 2023-10-06T04:39:35.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.307+0000 7fe4d759e700 1 -- 172.21.15.112:0/864305575 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d8156660 con 0x7fe4d80cb420 2023-10-06T04:39:35.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.307+0000 7fe4c67fc700 1 -- 172.21.15.112:0/864305575 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe4cc01e460 con 0x7fe4d80cb420 2023-10-06T04:39:35.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.308+0000 7fe4c67fc700 1 --2- 172.21.15.112:0/864305575 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe4b8066f30 0x7fe4b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.308+0000 7fe4c67fc700 1 -- 172.21.15.112:0/864305575 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe4cc084dd0 con 0x7fe4d80cb420 2023-10-06T04:39:35.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.308+0000 7fe4d659c700 1 --2- 172.21.15.112:0/864305575 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe4b8066f30 0x7fe4b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.308+0000 7fe4d659c700 1 --2- 172.21.15.112:0/864305575 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe4b8066f30 0x7fe4b80693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009e60 tx=0x7fe4c8019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:35.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.312+0000 7fe4c67fc700 1 -- 172.21.15.112:0/864305575 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4d8156660 con 0x7fe4d80cb420 2023-10-06T04:39:35.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.495+0000 7fe4d759e700 1 -- 172.21.15.112:0/864305575 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4d8156660 con 0x7fe4d80cb420 2023-10-06T04:39:35.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.496+0000 7fe4c67fc700 1 -- 172.21.15.112:0/864305575 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7fe4d8156660 con 0x7fe4d80cb420 2023-10-06T04:39:35.497 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:35.498 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:39:22.637355+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:18.657040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:19.972295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:35.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.498+0000 7fe4d759e700 1 -- 172.21.15.112:0/864305575 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe4b8066f30 msgr2=0x7fe4b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.498+0000 7fe4d759e700 1 --2- 172.21.15.112:0/864305575 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe4b8066f30 0x7fe4b80693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009e60 tx=0x7fe4c8019000 comp rx=0 tx=0).stop 2023-10-06T04:39:35.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.498+0000 7fe4d759e700 1 -- 172.21.15.112:0/864305575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d80cb420 msgr2=0x7fe4d80c99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.498+0000 7fe4d759e700 1 --2- 172.21.15.112:0/864305575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d80cb420 0x7fe4d80c99e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00d890 tx=0x7fe4cc008040 comp rx=0 tx=0).stop 2023-10-06T04:39:35.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.498+0000 7fe4d759e700 1 -- 172.21.15.112:0/864305575 shutdown_connections 2023-10-06T04:39:35.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.498+0000 7fe4d759e700 1 --2- 172.21.15.112:0/864305575 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe4b8066f30 0x7fe4b80693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.498+0000 7fe4d759e700 1 --2- 172.21.15.112:0/864305575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4d80cbfd0 0x7fe4d8150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.498+0000 7fe4d759e700 1 --2- 172.21.15.112:0/864305575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4d80cb050 0x7fe4d80694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.498+0000 7fe4d759e700 1 --2- 172.21.15.112:0/864305575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d80cb420 0x7fe4d80c99e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.498+0000 7fe4d759e700 1 -- 172.21.15.112:0/864305575 >> 172.21.15.112:0/864305575 conn(0x7fe4d8068050 msgr2=0x7fe4d80af600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:35.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.498+0000 7fe4d759e700 1 -- 172.21.15.112:0/864305575 shutdown_connections 2023-10-06T04:39:35.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.498+0000 7fe4d759e700 1 -- 172.21.15.112:0/864305575 wait complete. 2023-10-06T04:39:35.512 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:39:35.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.624+0000 7efddc0b5700 1 Processor -- start 2023-10-06T04:39:35.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.624+0000 7efddc0b5700 1 -- start start 2023-10-06T04:39:35.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.625+0000 7efddc0b5700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdd4159d50 0x7efdd40b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.625+0000 7efddc0b5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd40cd740 con 0x7efdd40b0e70 2023-10-06T04:39:35.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.625+0000 7efddc0b5700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd40ccb30 con 0x7efdd415a120 2023-10-06T04:39:35.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.625+0000 7efddc0b5700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd40cce10 con 0x7efdd4159d50 2023-10-06T04:39:35.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.625+0000 7efdda652700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7efdd40b0e70 0x7efdd406db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60310/0 (socket says 172.21.15.112:60310) 2023-10-06T04:39:35.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.625+0000 7efdda652700 1 -- 172.21.15.112:0/3933618114 learned_addr learned my addr 172.21.15.112:0/3933618114 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:35.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.625+0000 7efdd9e51700 1 --2- 172.21.15.112:0/3933618114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdd4159d50 0x7efdd40b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.625+0000 7efdd8e4f700 1 -- 172.21.15.112:0/3933618114 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678528251 0 0) 0x7efdd40cd740 con 0x7efdd40b0e70 2023-10-06T04:39:35.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.625+0000 7efdd8e4f700 1 -- 172.21.15.112:0/3933618114 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdc0003570 con 0x7efdd40b0e70 2023-10-06T04:39:35.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd8e4f700 1 -- 172.21.15.112:0/3933618114 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2327285252 0 0) 0x7efdc0003570 con 0x7efdd40b0e70 2023-10-06T04:39:35.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd8e4f700 1 -- 172.21.15.112:0/3933618114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdd4159d50 msgr2=0x7efdd40b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:35.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd8e4f700 1 --2- 172.21.15.112:0/3933618114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdd4159d50 0x7efdd40b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd8e4f700 1 -- 172.21.15.112:0/3933618114 >> v1:172.21.15.179:6789/0 conn(0x7efdd415a120 legacy=0x7efdd40cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd8e4f700 1 -- 172.21.15.112:0/3933618114 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd40cd0f0 con 0x7efdd40b0e70 2023-10-06T04:39:35.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd8e4f700 1 -- 172.21.15.112:0/3933618114 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7efdcc0017f0 con 0x7efdd40b0e70 2023-10-06T04:39:35.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd8e4f700 1 -- 172.21.15.112:0/3933618114 >> v1:172.21.15.112:6789/0 conn(0x7efdd40b0e70 legacy=0x7efdd406db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd8e4f700 1 --2- 172.21.15.112:0/3933618114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdd4159d50 0x7efdc0003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd8e4f700 1 --2- 172.21.15.112:0/3933618114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdc0004010 0x7efdc0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd8e4f700 1 --2- 172.21.15.112:0/3933618114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc0004d50 0x7efdc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd8e4f700 1 -- 172.21.15.112:0/3933618114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd40cce10 con 0x7efdc0004010 2023-10-06T04:39:35.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd8e4f700 1 -- 172.21.15.112:0/3933618114 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc000bbf0 con 0x7efdc0004d50 2023-10-06T04:39:35.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd8e4f700 1 -- 172.21.15.112:0/3933618114 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc000bdb0 con 0x7efdd4159d50 2023-10-06T04:39:35.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd9650700 1 --2- 172.21.15.112:0/3933618114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdc0004010 0x7efdc0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd9e51700 1 --2- 172.21.15.112:0/3933618114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdd4159d50 0x7efdc0003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdda652700 1 --2- 172.21.15.112:0/3933618114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc0004d50 0x7efdc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd9650700 1 -- 172.21.15.112:0/3933618114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdd4159d50 msgr2=0x7efdc0003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:35.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd9650700 1 --2- 172.21.15.112:0/3933618114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdd4159d50 0x7efdc0003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd9650700 1 -- 172.21.15.112:0/3933618114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc0004d50 msgr2=0x7efdc00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:35.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd9650700 1 --2- 172.21.15.112:0/3933618114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc0004d50 0x7efdc00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd9650700 1 -- 172.21.15.112:0/3933618114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc0003570 con 0x7efdc0004010 2023-10-06T04:39:35.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd9e51700 1 --2- 172.21.15.112:0/3933618114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdd4159d50 0x7efdc0003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:35.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd9650700 1 --2- 172.21.15.112:0/3933618114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdc0004010 0x7efdc0004810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efdc4001880 tx=0x7efdc4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29b9a2640df0707 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:35.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd8e4f700 1 -- 172.21.15.112:0/3933618114 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc4012420 con 0x7efdc0004010 2023-10-06T04:39:35.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd8e4f700 1 -- 172.21.15.112:0/3933618114 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc4012580 con 0x7efdc0004010 2023-10-06T04:39:35.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.626+0000 7efdd8e4f700 1 -- 172.21.15.112:0/3933618114 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc4012920 con 0x7efdc0004010 2023-10-06T04:39:35.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.627+0000 7efddc0b5700 1 -- 172.21.15.112:0/3933618114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdc0004010 msgr2=0x7efdc0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.627+0000 7efddc0b5700 1 --2- 172.21.15.112:0/3933618114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdc0004010 0x7efdc0004810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efdc4001880 tx=0x7efdc4007d30 comp rx=0 tx=0).stop 2023-10-06T04:39:35.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.627+0000 7efdda652700 1 -- 172.21.15.112:0/3933618114 reap_dead start 2023-10-06T04:39:35.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.627+0000 7efddc0b5700 1 -- 172.21.15.112:0/3933618114 shutdown_connections 2023-10-06T04:39:35.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.627+0000 7efddc0b5700 1 -- 172.21.15.112:0/3933618114 >> 172.21.15.112:0/3933618114 conn(0x7efdd4099b60 msgr2=0x7efdd406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:35.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.627+0000 7efddc0b5700 1 -- 172.21.15.112:0/3933618114 shutdown_connections 2023-10-06T04:39:35.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.627+0000 7efddc0b5700 1 -- 172.21.15.112:0/3933618114 wait complete. 2023-10-06T04:39:35.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.628+0000 7efddc0b5700 1 Processor -- start 2023-10-06T04:39:35.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.628+0000 7efddc0b5700 1 -- start start 2023-10-06T04:39:35.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.629+0000 7efddc0b5700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc0004010 0x7efdd409f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.629+0000 7efddc0b5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdd40a11a0 0x7efdd4146060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.629+0000 7efddc0b5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdd4169ee0 0x7efdd416a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.629+0000 7efddc0b5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd409f8c0 con 0x7efdd4169ee0 2023-10-06T04:39:35.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.629+0000 7efddc0b5700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd409fba0 con 0x7efdd40a11a0 2023-10-06T04:39:35.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.629+0000 7efddc0b5700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd409fe80 con 0x7efdc0004010 2023-10-06T04:39:35.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.629+0000 7efdda652700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdd4169ee0 0x7efdd416a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.629+0000 7efdda652700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdd4169ee0 0x7efdd416a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58548/0 (socket says 172.21.15.112:58548) 2023-10-06T04:39:35.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.629+0000 7efdda652700 1 -- 172.21.15.112:0/2216086349 learned_addr learned my addr 172.21.15.112:0/2216086349 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:35.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.629+0000 7efdd9e51700 1 --2- 172.21.15.112:0/2216086349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc0004010 0x7efdd409f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.629+0000 7efdd9650700 1 --2- 172.21.15.112:0/2216086349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdd40a11a0 0x7efdd4146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.629+0000 7efdda652700 1 -- 172.21.15.112:0/2216086349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc0004010 msgr2=0x7efdd409f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.629+0000 7efdda652700 1 --2- 172.21.15.112:0/2216086349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc0004010 0x7efdd409f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.629+0000 7efdda652700 1 -- 172.21.15.112:0/2216086349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdd40a11a0 msgr2=0x7efdd4146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.629+0000 7efdda652700 1 --2- 172.21.15.112:0/2216086349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdd40a11a0 0x7efdd4146060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.629+0000 7efdda652700 1 -- 172.21.15.112:0/2216086349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd40a0160 con 0x7efdd4169ee0 2023-10-06T04:39:35.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.629+0000 7efdda652700 1 --2- 172.21.15.112:0/2216086349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdd4169ee0 0x7efdd416a350 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efdd40a1b20 tx=0x7efdcc0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:35.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.630+0000 7efdc9ffb700 1 -- 172.21.15.112:0/2216086349 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc007b60 con 0x7efdd4169ee0 2023-10-06T04:39:35.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.630+0000 7efdc9ffb700 1 -- 172.21.15.112:0/2216086349 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdcc00ac30 con 0x7efdd4169ee0 2023-10-06T04:39:35.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.630+0000 7efddc0b5700 1 -- 172.21.15.112:0/2216086349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd40a0440 con 0x7efdd4169ee0 2023-10-06T04:39:35.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.630+0000 7efdc9ffb700 1 -- 172.21.15.112:0/2216086349 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc0133f0 con 0x7efdd4169ee0 2023-10-06T04:39:35.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.630+0000 7efddc0b5700 1 -- 172.21.15.112:0/2216086349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd41465a0 con 0x7efdd4169ee0 2023-10-06T04:39:35.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.631+0000 7efddc0b5700 1 -- 172.21.15.112:0/2216086349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd40a0630 con 0x7efdd4169ee0 2023-10-06T04:39:35.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.631+0000 7efdc9ffb700 1 -- 172.21.15.112:0/2216086349 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efdcc013760 con 0x7efdd4169ee0 2023-10-06T04:39:35.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.631+0000 7efdc9ffb700 1 --2- 172.21.15.112:0/2216086349 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7efdb8066f30 0x7efdb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:35.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.631+0000 7efdc9ffb700 1 -- 172.21.15.112:0/2216086349 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efdcc084e90 con 0x7efdd4169ee0 2023-10-06T04:39:35.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.631+0000 7efdd9e51700 1 --2- 172.21.15.112:0/2216086349 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7efdb8066f30 0x7efdb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:35.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.632+0000 7efdd9e51700 1 --2- 172.21.15.112:0/2216086349 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7efdb8066f30 0x7efdb80693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efdd0006f00 tx=0x7efdd00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:35.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.636+0000 7efdc9ffb700 1 -- 172.21.15.112:0/2216086349 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdcc051fa0 con 0x7efdd4169ee0 2023-10-06T04:39:35.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.861+0000 7efddc0b5700 1 -- 172.21.15.112:0/2216086349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdd405f230 con 0x7efdd4169ee0 2023-10-06T04:39:35.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.861+0000 7efdc9ffb700 1 -- 172.21.15.112:0/2216086349 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4600 (secure 0 0 0) 0x7efdcc0555c0 con 0x7efdd4169ee0 2023-10-06T04:39:35.863 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:35.863 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1694304040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1694304040},{"type":"v1","addr":"172.21.15.112:6837","nonce":1694304040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3750383657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3750383657},{"type":"v1","addr":"172.21.15.112:6835","nonce":3750383657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2217480877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2217480877},{"type":"v1","addr":"172.21.15.179:6834","nonce":2217480877}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:39:21.015278+0000","modified":"2023-10-06T04:39:24.651029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/140836226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":140836226},{"type":"v1","addr":"172.21.15.179:6835","nonce":140836226}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:39:35.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.864+0000 7efddc0b5700 1 -- 172.21.15.112:0/2216086349 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7efdb8066f30 msgr2=0x7efdb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.864+0000 7efddc0b5700 1 --2- 172.21.15.112:0/2216086349 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7efdb8066f30 0x7efdb80693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efdd0006f00 tx=0x7efdd00091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.864+0000 7efddc0b5700 1 -- 172.21.15.112:0/2216086349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdd4169ee0 msgr2=0x7efdd416a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:35.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.864+0000 7efddc0b5700 1 --2- 172.21.15.112:0/2216086349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdd4169ee0 0x7efdd416a350 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efdd40a1b20 tx=0x7efdcc0021d0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.864+0000 7efddc0b5700 1 -- 172.21.15.112:0/2216086349 shutdown_connections 2023-10-06T04:39:35.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.864+0000 7efddc0b5700 1 --2- 172.21.15.112:0/2216086349 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7efdb8066f30 0x7efdb80693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.864+0000 7efddc0b5700 1 --2- 172.21.15.112:0/2216086349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdd4169ee0 0x7efdd416a350 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.864+0000 7efddc0b5700 1 --2- 172.21.15.112:0/2216086349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc0004010 0x7efdd409f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.864+0000 7efddc0b5700 1 --2- 172.21.15.112:0/2216086349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdd40a11a0 0x7efdd4146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:35.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.864+0000 7efddc0b5700 1 -- 172.21.15.112:0/2216086349 >> 172.21.15.112:0/2216086349 conn(0x7efdd4099b60 msgr2=0x7efdd406f230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:35.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.864+0000 7efddc0b5700 1 -- 172.21.15.112:0/2216086349 shutdown_connections 2023-10-06T04:39:35.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:35.864+0000 7efddc0b5700 1 -- 172.21.15.112:0/2216086349 wait complete. 2023-10-06T04:39:35.866 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 7 2023-10-06T04:39:36.279 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:39:21.015278+0000', 'modified': '2023-10-06T04:39:24.651029+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6835/140836226', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6833', 'nonce': 140836226}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 140836226}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:39:36.280 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:39:36.280 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T04:39:36.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.395+0000 7f308e702700 1 Processor -- start 2023-10-06T04:39:36.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.395+0000 7f308e702700 1 -- start start 2023-10-06T04:39:36.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.396+0000 7f308e702700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f308815cd20 0x7f30880ad870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.396+0000 7f308e702700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30880cf2c0 con 0x7f30880d1410 2023-10-06T04:39:36.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.396+0000 7f308e702700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30880cbd70 con 0x7f30880d0350 2023-10-06T04:39:36.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.396+0000 7f308e702700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30880cecb0 con 0x7f308815cd20 2023-10-06T04:39:36.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.396+0000 7f30877fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f30880d1410 0x7f30880cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60324/0 (socket says 172.21.15.112:60324) 2023-10-06T04:39:36.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.396+0000 7f30877fe700 1 -- 172.21.15.112:0/4018500866 learned_addr learned my addr 172.21.15.112:0/4018500866 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:36.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.396+0000 7f3087fff700 1 --2- 172.21.15.112:0/4018500866 >> v2:172.21.15.179:3300/0 conn(0x7f308815cd20 0x7f30880ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.396+0000 7f3086ffd700 1 -- 172.21.15.112:0/4018500866 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917591944 0 0) 0x7f30880cf2c0 con 0x7f30880d1410 2023-10-06T04:39:36.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.396+0000 7f3086ffd700 1 -- 172.21.15.112:0/4018500866 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3070003570 con 0x7f30880d1410 2023-10-06T04:39:36.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.396+0000 7f3086ffd700 1 -- 172.21.15.112:0/4018500866 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 283465488 0 0) 0x7f3070003570 con 0x7f30880d1410 2023-10-06T04:39:36.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.396+0000 7f3086ffd700 1 -- 172.21.15.112:0/4018500866 >> v2:172.21.15.179:3300/0 conn(0x7f308815cd20 msgr2=0x7f30880ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:36.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.396+0000 7f3086ffd700 1 --2- 172.21.15.112:0/4018500866 >> v2:172.21.15.179:3300/0 conn(0x7f308815cd20 0x7f30880ad870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.396+0000 7f3086ffd700 1 -- 172.21.15.112:0/4018500866 >> v1:172.21.15.179:6789/0 conn(0x7f30880d0350 legacy=0x7f308815d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.396+0000 7f3086ffd700 1 -- 172.21.15.112:0/4018500866 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30880cbfc0 con 0x7f30880d1410 2023-10-06T04:39:36.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.396+0000 7f3086ffd700 1 -- 172.21.15.112:0/4018500866 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f307c001470 con 0x7f30880d1410 2023-10-06T04:39:36.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.397+0000 7f3086ffd700 1 -- 172.21.15.112:0/4018500866 >> v1:172.21.15.112:6789/0 conn(0x7f30880d1410 legacy=0x7f30880cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.397+0000 7f3086ffd700 1 --2- 172.21.15.112:0/4018500866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3070003a60 0x7f3070003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.397+0000 7f3086ffd700 1 --2- 172.21.15.112:0/4018500866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3070004810 0x7f3070004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.397+0000 7f3086ffd700 1 --2- 172.21.15.112:0/4018500866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30700052e0 0x7f307000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.397+0000 7f3086ffd700 1 -- 172.21.15.112:0/4018500866 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30880cecb0 con 0x7f30700052e0 2023-10-06T04:39:36.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.397+0000 7f3086ffd700 1 -- 172.21.15.112:0/4018500866 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307000c2a0 con 0x7f3070004810 2023-10-06T04:39:36.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.397+0000 7f3086ffd700 1 -- 172.21.15.112:0/4018500866 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307000c460 con 0x7f3070003a60 2023-10-06T04:39:36.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.397+0000 7f308cc9f700 1 --2- 172.21.15.112:0/4018500866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30700052e0 0x7f307000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.397+0000 7f3087fff700 1 --2- 172.21.15.112:0/4018500866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3070003a60 0x7f3070003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.397+0000 7f30877fe700 1 --2- 172.21.15.112:0/4018500866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3070004810 0x7f3070004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.397+0000 7f308cc9f700 1 -- 172.21.15.112:0/4018500866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3070003a60 msgr2=0x7f3070003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:36.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.397+0000 7f308cc9f700 1 --2- 172.21.15.112:0/4018500866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3070003a60 0x7f3070003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.397+0000 7f308cc9f700 1 -- 172.21.15.112:0/4018500866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3070004810 msgr2=0x7f3070004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:36.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.397+0000 7f308cc9f700 1 --2- 172.21.15.112:0/4018500866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3070004810 0x7f3070004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.397+0000 7f308cc9f700 1 -- 172.21.15.112:0/4018500866 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3070003570 con 0x7f30700052e0 2023-10-06T04:39:36.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.397+0000 7f308cc9f700 1 -- 172.21.15.112:0/4018500866 reap_dead start 2023-10-06T04:39:36.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.397+0000 7f308cc9f700 1 --2- 172.21.15.112:0/4018500866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30700052e0 0x7f307000ba60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3080001f90 tx=0x7f3080001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b0efce39dc6688 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:36.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.397+0000 7f3086ffd700 1 -- 172.21.15.112:0/4018500866 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3080001950 con 0x7f30700052e0 2023-10-06T04:39:36.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.397+0000 7f3086ffd700 1 -- 172.21.15.112:0/4018500866 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308000c8b0 con 0x7f30700052e0 2023-10-06T04:39:36.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.397+0000 7f3086ffd700 1 -- 172.21.15.112:0/4018500866 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308000cc50 con 0x7f30700052e0 2023-10-06T04:39:36.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.398+0000 7f308e702700 1 -- 172.21.15.112:0/4018500866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30700052e0 msgr2=0x7f307000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.398+0000 7f308e702700 1 --2- 172.21.15.112:0/4018500866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30700052e0 0x7f307000ba60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3080001f90 tx=0x7f3080001640 comp rx=0 tx=0).stop 2023-10-06T04:39:36.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.398+0000 7f308e702700 1 -- 172.21.15.112:0/4018500866 shutdown_connections 2023-10-06T04:39:36.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.398+0000 7f308e702700 1 --2- 172.21.15.112:0/4018500866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30700052e0 0x7f307000ba60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.398+0000 7f308e702700 1 -- 172.21.15.112:0/4018500866 >> 172.21.15.112:0/4018500866 conn(0x7f308806cfb0 msgr2=0x7f30880d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:36.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.398+0000 7f308e702700 1 -- 172.21.15.112:0/4018500866 shutdown_connections 2023-10-06T04:39:36.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.398+0000 7f308e702700 1 -- 172.21.15.112:0/4018500866 wait complete. 2023-10-06T04:39:36.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.399+0000 7f308e702700 1 Processor -- start 2023-10-06T04:39:36.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.399+0000 7f308e702700 1 -- start start 2023-10-06T04:39:36.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f308e702700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30700052e0 0x7f30880b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f308e702700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30880b6500 0x7f3088143630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f308e702700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f308816da50 0x7f3088159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f308e702700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30880b6070 con 0x7f308816da50 2023-10-06T04:39:36.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f308e702700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30880b51e0 con 0x7f30700052e0 2023-10-06T04:39:36.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f308e702700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30880b3d50 con 0x7f30880b6500 2023-10-06T04:39:36.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f308cc9f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f308816da50 0x7f3088159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f308cc9f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f308816da50 0x7f3088159530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58576/0 (socket says 172.21.15.112:58576) 2023-10-06T04:39:36.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f308cc9f700 1 -- 172.21.15.112:0/3376979790 learned_addr learned my addr 172.21.15.112:0/3376979790 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:36.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f3087fff700 1 --2- 172.21.15.112:0/3376979790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30700052e0 0x7f30880b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f30877fe700 1 --2- 172.21.15.112:0/3376979790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30880b6500 0x7f3088143630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f308cc9f700 1 -- 172.21.15.112:0/3376979790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30880b6500 msgr2=0x7f3088143630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f308cc9f700 1 --2- 172.21.15.112:0/3376979790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30880b6500 0x7f3088143630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f308cc9f700 1 -- 172.21.15.112:0/3376979790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30700052e0 msgr2=0x7f30880b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f308cc9f700 1 --2- 172.21.15.112:0/3376979790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30700052e0 0x7f30880b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f308cc9f700 1 -- 172.21.15.112:0/3376979790 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30880b5460 con 0x7f308816da50 2023-10-06T04:39:36.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f308cc9f700 1 --2- 172.21.15.112:0/3376979790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f308816da50 0x7f3088159530 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3080001f90 tx=0x7f3080015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:36.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f306ffff700 1 -- 172.21.15.112:0/3376979790 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3080001950 con 0x7f308816da50 2023-10-06T04:39:36.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f306ffff700 1 -- 172.21.15.112:0/3376979790 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308000c6d0 con 0x7f308816da50 2023-10-06T04:39:36.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f306ffff700 1 -- 172.21.15.112:0/3376979790 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308001e890 con 0x7f308816da50 2023-10-06T04:39:36.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f308e702700 1 -- 172.21.15.112:0/3376979790 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30880b5740 con 0x7f308816da50 2023-10-06T04:39:36.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.400+0000 7f308e702700 1 -- 172.21.15.112:0/3376979790 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30880b5d00 con 0x7f308816da50 2023-10-06T04:39:36.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.402+0000 7f306ffff700 1 -- 172.21.15.112:0/3376979790 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f308001ec80 con 0x7f308816da50 2023-10-06T04:39:36.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.402+0000 7f306ffff700 1 --2- 172.21.15.112:0/3376979790 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3074066f30 0x7f30740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.402+0000 7f3087fff700 1 --2- 172.21.15.112:0/3376979790 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3074066f30 0x7f30740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.402+0000 7f306ffff700 1 -- 172.21.15.112:0/3376979790 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3080085e20 con 0x7f308816da50 2023-10-06T04:39:36.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.403+0000 7f3087fff700 1 --2- 172.21.15.112:0/3376979790 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3074066f30 0x7f30740693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3078006f00 tx=0x7f30780091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:36.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.404+0000 7f30979fab80 1 Processor -- start 2023-10-06T04:39:36.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.404+0000 7f30979fab80 1 -- start start 2023-10-06T04:39:36.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.405+0000 7f30979fab80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f680fa90 0x5618f680fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.405+0000 7f30979fab80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5618f67cb9a0 0x5618f67c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.405+0000 7f30979fab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67c9bd0 0x5618f67c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.405+0000 7f30979fab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618f6748c80 con 0x5618f67c9bd0 2023-10-06T04:39:36.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.405+0000 7f30979fab80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618f671fa70 con 0x5618f680fa90 2023-10-06T04:39:36.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.405+0000 7f30979fab80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5618f671d270 con 0x5618f67cb9a0 2023-10-06T04:39:36.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.405+0000 7f308cc9f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67c9bd0 0x5618f67c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.405+0000 7f308cc9f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67c9bd0 0x5618f67c8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58582/0 (socket says 172.21.15.112:58582) 2023-10-06T04:39:36.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.405+0000 7f308cc9f700 1 -- 172.21.15.112:0/3353605393 learned_addr learned my addr 172.21.15.112:0/3353605393 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:36.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.405+0000 7f30877fe700 1 --2- 172.21.15.112:0/3353605393 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5618f67cb9a0 0x5618f67c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.405+0000 7f3087fff700 1 --2- 172.21.15.112:0/3353605393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f680fa90 0x5618f680fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.405+0000 7f308cc9f700 1 -- 172.21.15.112:0/3353605393 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5618f67cb9a0 msgr2=0x5618f67c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:36.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.405+0000 7f308cc9f700 1 --2- 172.21.15.112:0/3353605393 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5618f67cb9a0 0x5618f67c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.405+0000 7f308cc9f700 1 -- 172.21.15.112:0/3353605393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f680fa90 msgr2=0x5618f680fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:36.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.405+0000 7f308cc9f700 1 --2- 172.21.15.112:0/3353605393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f680fa90 0x5618f680fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.405+0000 7f308cc9f700 1 -- 172.21.15.112:0/3353605393 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5618f65b3270 con 0x5618f67c9bd0 2023-10-06T04:39:36.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.405+0000 7f3087fff700 1 --2- 172.21.15.112:0/3353605393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f680fa90 0x5618f680fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:36.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.405+0000 7f308cc9f700 1 --2- 172.21.15.112:0/3353605393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67c9bd0 0x5618f67c8ac0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3080084290 tx=0x7f3080084140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221b277bc10e427b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:36.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.406+0000 7f306d7fa700 1 -- 172.21.15.112:0/3353605393 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30800567f0 con 0x5618f67c9bd0 2023-10-06T04:39:36.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.406+0000 7f306d7fa700 1 -- 172.21.15.112:0/3353605393 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3080056610 con 0x5618f67c9bd0 2023-10-06T04:39:36.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.406+0000 7f306d7fa700 1 -- 172.21.15.112:0/3353605393 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30800573b0 con 0x5618f67c9bd0 2023-10-06T04:39:36.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.406+0000 7f30979fab80 1 -- 172.21.15.112:0/3353605393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67c9bd0 msgr2=0x5618f67c8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.406+0000 7f30979fab80 1 --2- 172.21.15.112:0/3353605393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67c9bd0 0x5618f67c8ac0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3080084290 tx=0x7f3080084140 comp rx=0 tx=0).stop 2023-10-06T04:39:36.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.406+0000 7f30979fab80 1 -- 172.21.15.112:0/3353605393 shutdown_connections 2023-10-06T04:39:36.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.406+0000 7f30979fab80 1 --2- 172.21.15.112:0/3353605393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67c9bd0 0x5618f67c8ac0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.406+0000 7f30979fab80 1 --2- 172.21.15.112:0/3353605393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f680fa90 0x5618f680fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.406+0000 7f30979fab80 1 --2- 172.21.15.112:0/3353605393 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5618f67cb9a0 0x5618f67c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.406+0000 7f30979fab80 1 -- 172.21.15.112:0/3353605393 >> 172.21.15.112:0/3353605393 conn(0x5618f67ca070 msgr2=0x5618f67ca440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:36.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.406+0000 7f30979fab80 1 -- 172.21.15.112:0/3353605393 shutdown_connections 2023-10-06T04:39:36.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.406+0000 7f30979fab80 1 -- 172.21.15.112:0/3353605393 wait complete. 2023-10-06T04:39:36.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.407+0000 7f30979fab80 1 -- start start 2023-10-06T04:39:36.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.407+0000 7f30979fab80 1 Processor -- start 2023-10-06T04:39:36.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f30979fab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67c9bd0 0x5618f67ed280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f30979fab80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5618f67cb9a0 0x5618f680b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f30979fab80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f680fa90 0x5618f67f2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f30979fab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618f6719060 con 0x5618f67c9bd0 2023-10-06T04:39:36.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f30979fab80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618f66c4890 con 0x5618f680fa90 2023-10-06T04:39:36.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f30979fab80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5618f66dfea0 con 0x5618f67cb9a0 2023-10-06T04:39:36.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f30979fab80 10 client.0 _ll_register_callbacks cb 0x5618f65b5f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:39:36.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f3087fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67c9bd0 0x5618f67ed280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f3087fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67c9bd0 0x5618f67ed280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58590/0 (socket says 172.21.15.112:58590) 2023-10-06T04:39:36.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f3087fff700 1 -- 172.21.15.112:0/583019679 learned_addr learned my addr 172.21.15.112:0/583019679 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:36.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f30877fe700 1 --2- 172.21.15.112:0/583019679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5618f67cb9a0 0x5618f680b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f308cc9f700 1 --2- 172.21.15.112:0/583019679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f680fa90 0x5618f67f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f3087fff700 1 -- 172.21.15.112:0/583019679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5618f67cb9a0 msgr2=0x5618f680b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:36.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f3087fff700 1 --2- 172.21.15.112:0/583019679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5618f67cb9a0 0x5618f680b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f3087fff700 1 -- 172.21.15.112:0/583019679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f680fa90 msgr2=0x5618f67f2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:36.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f3087fff700 1 --2- 172.21.15.112:0/583019679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f680fa90 0x5618f67f2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f3087fff700 1 -- 172.21.15.112:0/583019679 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30880b5d00 con 0x5618f67c9bd0 2023-10-06T04:39:36.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f308cc9f700 1 --2- 172.21.15.112:0/583019679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f680fa90 0x5618f67f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:36.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f3087fff700 1 --2- 172.21.15.112:0/583019679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67c9bd0 0x5618f67ed280 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3078015b20 tx=0x7f307801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d783ef25cf87008a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:36.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f30667fc700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-06T04:39:36.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f30667fc700 1 -- 172.21.15.112:0/583019679 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078023440 con 0x5618f67c9bd0 2023-10-06T04:39:36.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f30667fc700 1 -- 172.21.15.112:0/583019679 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f307802dc50 con 0x5618f67c9bd0 2023-10-06T04:39:36.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.408+0000 7f30979fab80 1 -- 172.21.15.112:0/583019679 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5618f67bd690 con 0x5618f67c9bd0 2023-10-06T04:39:36.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.409+0000 7f30667fc700 1 -- 172.21.15.112:0/583019679 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30780235a0 con 0x5618f67c9bd0 2023-10-06T04:39:36.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.409+0000 7f30979fab80 10 client.4689 fetch_fsmap learned FSMap version 7 2023-10-06T04:39:36.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.409+0000 7f30979fab80 1 -- 172.21.15.112:0/583019679 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5618f6555fe0 con 0x5618f67c9bd0 2023-10-06T04:39:36.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.409+0000 7f30667fc700 1 -- 172.21.15.112:0/583019679 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5618f67bd690 con 0x5618f67c9bd0 2023-10-06T04:39:36.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.409+0000 7f30667fc700 1 -- 172.21.15.112:0/583019679 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3078023700 con 0x5618f67c9bd0 2023-10-06T04:39:36.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.409+0000 7f30979fab80 10 client.4689 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T04:39:36.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.409+0000 7f30979fab80 10 client.4689 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T04:39:36.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.409+0000 7f30979fab80 20 client.4689 populate_metadata read hostname 'smithi112' 2023-10-06T04:39:36.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.409+0000 7f30979fab80 1 --2- 172.21.15.112:0/583019679 >> [v2:172.21.15.179:6833/140836226,v1:172.21.15.179:6835/140836226] conn(0x5618f67c5bd0 0x5618f6809ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.409+0000 7f30979fab80 4 client.4689 mds_command: new command op to 4273 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:39:36.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.409+0000 7f30979fab80 1 -- 172.21.15.112:0/583019679 --> [v2:172.21.15.179:6833/140836226,v1:172.21.15.179:6835/140836226] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5618f679a5c0 con 0x5618f67c5bd0 2023-10-06T04:39:36.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.409+0000 7f30877fe700 1 --2- 172.21.15.112:0/583019679 >> [v2:172.21.15.179:6833/140836226,v1:172.21.15.179:6835/140836226] conn(0x5618f67c5bd0 0x5618f6809ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.409+0000 7f30667fc700 10 client.4689 ms_handle_connect on v2:172.21.15.179:6833/140836226 2023-10-06T04:39:36.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.409+0000 7f30877fe700 1 --2- 172.21.15.112:0/583019679 >> [v2:172.21.15.179:6833/140836226,v1:172.21.15.179:6835/140836226] conn(0x5618f67c5bd0 0x5618f6809ed0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaa88cb114b9fa68 server_cookie=b0f9f48f1068a10f in_seq=0 out_seq=0 2023-10-06T04:39:36.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.410+0000 7f30667fc700 1 -- 172.21.15.112:0/583019679 <== mds.0 v2:172.21.15.179:6833/140836226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5618f679a5c0 con 0x5618f67c5bd0 2023-10-06T04:39:36.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.410+0000 7f30667fc700 10 client.4689 handle_command_reply: tid=0 2023-10-06T04:39:36.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.410+0000 7f30979fab80 1 client.4689 shutdown 2023-10-06T04:39:36.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.410+0000 7f30979fab80 1 -- 172.21.15.112:0/583019679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67c9bd0 msgr2=0x5618f67ed280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.410+0000 7f30979fab80 1 --2- 172.21.15.112:0/583019679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67c9bd0 0x5618f67ed280 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3078015b20 tx=0x7f307801c000 comp rx=0 tx=0).stop 2023-10-06T04:39:36.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.410+0000 7f30979fab80 1 -- 172.21.15.112:0/583019679 shutdown_connections 2023-10-06T04:39:36.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.410+0000 7f30979fab80 1 --2- 172.21.15.112:0/583019679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f680fa90 0x5618f67f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.410+0000 7f30979fab80 1 --2- 172.21.15.112:0/583019679 >> [v2:172.21.15.179:6833/140836226,v1:172.21.15.179:6835/140836226] conn(0x5618f67c5bd0 0x5618f6809ed0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.410+0000 7f30979fab80 1 --2- 172.21.15.112:0/583019679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67c9bd0 0x5618f67ed280 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.410+0000 7f30667fc700 0 client.4689 ms_handle_reset on v2:172.21.15.179:6833/140836226 2023-10-06T04:39:36.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.410+0000 7f30979fab80 1 --2- 172.21.15.112:0/583019679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5618f67cb9a0 0x5618f680b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.410+0000 7f30979fab80 1 -- 172.21.15.112:0/583019679 >> 172.21.15.112:0/583019679 conn(0x5618f67ca070 msgr2=0x5618f680ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:36.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.410+0000 7f30979fab80 1 -- 172.21.15.112:0/583019679 shutdown_connections 2023-10-06T04:39:36.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.410+0000 7f30979fab80 1 -- 172.21.15.112:0/583019679 wait complete. 2023-10-06T04:39:36.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.410+0000 7f30979fab80 20 client.4689 trim_cache size 0 max 16384 2023-10-06T04:39:36.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.427+0000 7f30979fab80 1 Processor -- start 2023-10-06T04:39:36.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.427+0000 7f30979fab80 1 -- start start 2023-10-06T04:39:36.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.428+0000 7f30979fab80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f67c9bd0 0x5618f680e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.428+0000 7f30979fab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67cb9a0 0x5618f680aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.428+0000 7f30979fab80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5618f680fa90 0x5618f680b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.428+0000 7f30979fab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618f659be30 con 0x5618f67cb9a0 2023-10-06T04:39:36.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.428+0000 7f30979fab80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618f67cb7e0 con 0x5618f67c9bd0 2023-10-06T04:39:36.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.428+0000 7f30979fab80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5618f67cc0f0 con 0x5618f680fa90 2023-10-06T04:39:36.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.428+0000 7f30877fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67cb9a0 0x5618f680aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.428+0000 7f30877fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67cb9a0 0x5618f680aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58598/0 (socket says 172.21.15.112:58598) 2023-10-06T04:39:36.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.428+0000 7f30877fe700 1 -- 172.21.15.112:0/1757426180 learned_addr learned my addr 172.21.15.112:0/1757426180 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:36.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.428+0000 7f30877fe700 1 -- 172.21.15.112:0/1757426180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5618f680fa90 msgr2=0x5618f680b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:36.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.428+0000 7f30877fe700 1 --2- 172.21.15.112:0/1757426180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5618f680fa90 0x5618f680b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.428+0000 7f3087fff700 1 --2- 172.21.15.112:0/1757426180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f67c9bd0 0x5618f680e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.428+0000 7f30877fe700 1 -- 172.21.15.112:0/1757426180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f67c9bd0 msgr2=0x5618f680e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:36.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.428+0000 7f30877fe700 1 --2- 172.21.15.112:0/1757426180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f67c9bd0 0x5618f680e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.428+0000 7f30877fe700 1 -- 172.21.15.112:0/1757426180 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5618f66e7780 con 0x5618f67cb9a0 2023-10-06T04:39:36.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.428+0000 7f30877fe700 1 --2- 172.21.15.112:0/1757426180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67cb9a0 0x5618f680aee0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x5618f67f5a10 tx=0x7f307c006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191c11c71f369594 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:36.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.429+0000 7f306dffb700 1 -- 172.21.15.112:0/1757426180 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307c025070 con 0x5618f67cb9a0 2023-10-06T04:39:36.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.429+0000 7f306dffb700 1 -- 172.21.15.112:0/1757426180 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307c01c040 con 0x5618f67cb9a0 2023-10-06T04:39:36.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.429+0000 7f306dffb700 1 -- 172.21.15.112:0/1757426180 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307c01b030 con 0x5618f67cb9a0 2023-10-06T04:39:36.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.429+0000 7f30979fab80 1 -- 172.21.15.112:0/1757426180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67cb9a0 msgr2=0x5618f680aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.429+0000 7f30979fab80 1 --2- 172.21.15.112:0/1757426180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67cb9a0 0x5618f680aee0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x5618f67f5a10 tx=0x7f307c006040 comp rx=0 tx=0).stop 2023-10-06T04:39:36.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.429+0000 7f30979fab80 1 -- 172.21.15.112:0/1757426180 shutdown_connections 2023-10-06T04:39:36.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.429+0000 7f30979fab80 1 --2- 172.21.15.112:0/1757426180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5618f680fa90 0x5618f680b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.429+0000 7f30979fab80 1 --2- 172.21.15.112:0/1757426180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f67c9bd0 0x5618f680e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.429+0000 7f30979fab80 1 --2- 172.21.15.112:0/1757426180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67cb9a0 0x5618f680aee0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.429+0000 7f30979fab80 1 -- 172.21.15.112:0/1757426180 >> 172.21.15.112:0/1757426180 conn(0x5618f67ca070 msgr2=0x5618f67ec570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:36.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.429+0000 7f30979fab80 1 -- 172.21.15.112:0/1757426180 shutdown_connections 2023-10-06T04:39:36.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.429+0000 7f30979fab80 1 -- 172.21.15.112:0/1757426180 wait complete. 2023-10-06T04:39:36.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.430+0000 7f30979fab80 1 -- start start 2023-10-06T04:39:36.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.430+0000 7f30979fab80 1 Processor -- start 2023-10-06T04:39:36.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30979fab80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f67c9bd0 0x5618f6805b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30979fab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67cb9a0 0x5618f68060c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30979fab80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5618f680fa90 0x5618f67f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30979fab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618f680c2d0 con 0x5618f67cb9a0 2023-10-06T04:39:36.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30979fab80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618f67f1220 con 0x5618f67c9bd0 2023-10-06T04:39:36.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30979fab80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5618f67f1470 con 0x5618f680fa90 2023-10-06T04:39:36.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30979fab80 10 client.0 _ll_register_callbacks cb 0x5618f65b5f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:39:36.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30877fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67cb9a0 0x5618f68060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30877fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67cb9a0 0x5618f68060c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58604/0 (socket says 172.21.15.112:58604) 2023-10-06T04:39:36.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30877fe700 1 -- 172.21.15.112:0/3138924921 learned_addr learned my addr 172.21.15.112:0/3138924921 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:36.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f308cc9f700 1 --2- 172.21.15.112:0/3138924921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5618f680fa90 0x5618f67f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f3087fff700 1 --2- 172.21.15.112:0/3138924921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f67c9bd0 0x5618f6805b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30877fe700 1 -- 172.21.15.112:0/3138924921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5618f680fa90 msgr2=0x5618f67f30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:36.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30877fe700 1 --2- 172.21.15.112:0/3138924921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5618f680fa90 0x5618f67f30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30877fe700 1 -- 172.21.15.112:0/3138924921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f67c9bd0 msgr2=0x5618f6805b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:36.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30877fe700 1 --2- 172.21.15.112:0/3138924921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f67c9bd0 0x5618f6805b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30877fe700 1 -- 172.21.15.112:0/3138924921 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30880cbfc0 con 0x5618f67cb9a0 2023-10-06T04:39:36.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f3087fff700 1 --2- 172.21.15.112:0/3138924921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f67c9bd0 0x5618f6805b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:36.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30877fe700 1 --2- 172.21.15.112:0/3138924921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67cb9a0 0x5618f68060c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f307c000e50 tx=0x7f307c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9541b05ac23deff3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:36.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30667fc700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-06T04:39:36.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30667fc700 1 -- 172.21.15.112:0/3138924921 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307c025050 con 0x5618f67cb9a0 2023-10-06T04:39:36.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30667fc700 1 -- 172.21.15.112:0/3138924921 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f307c02bc60 con 0x5618f67cb9a0 2023-10-06T04:39:36.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30979fab80 1 -- 172.21.15.112:0/3138924921 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3080056610 con 0x5618f67cb9a0 2023-10-06T04:39:36.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30667fc700 1 -- 172.21.15.112:0/3138924921 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f307c020960 con 0x5618f67cb9a0 2023-10-06T04:39:36.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30979fab80 10 client.4695 fetch_fsmap learned FSMap version 7 2023-10-06T04:39:36.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.431+0000 7f30979fab80 1 -- 172.21.15.112:0/3138924921 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5618f66ce470 con 0x5618f67cb9a0 2023-10-06T04:39:36.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.432+0000 7f30667fc700 1 -- 172.21.15.112:0/3138924921 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3080056610 con 0x5618f67cb9a0 2023-10-06T04:39:36.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.432+0000 7f30667fc700 1 -- 172.21.15.112:0/3138924921 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f307c012070 con 0x5618f67cb9a0 2023-10-06T04:39:36.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.432+0000 7f30979fab80 10 client.4695 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T04:39:36.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.432+0000 7f30979fab80 10 client.4695 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T04:39:36.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.432+0000 7f30979fab80 20 client.4695 populate_metadata read hostname 'smithi112' 2023-10-06T04:39:36.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.432+0000 7f30979fab80 1 --2- 172.21.15.112:0/3138924921 >> [v2:172.21.15.179:6833/140836226,v1:172.21.15.179:6835/140836226] conn(0x5618f67f35f0 0x5618f67f39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:36.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.432+0000 7f30979fab80 4 client.4695 mds_command: new command op to 4273 tid=0[{"prefix": "status"}] 2023-10-06T04:39:36.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.432+0000 7f30979fab80 1 -- 172.21.15.112:0/3138924921 --> [v2:172.21.15.179:6833/140836226,v1:172.21.15.179:6835/140836226] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5618f66bbe00 con 0x5618f67f35f0 2023-10-06T04:39:36.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.432+0000 7f3087fff700 1 --2- 172.21.15.112:0/3138924921 >> [v2:172.21.15.179:6833/140836226,v1:172.21.15.179:6835/140836226] conn(0x5618f67f35f0 0x5618f67f39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:36.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.432+0000 7f30667fc700 10 client.4695 ms_handle_connect on v2:172.21.15.179:6833/140836226 2023-10-06T04:39:36.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.432+0000 7f3087fff700 1 --2- 172.21.15.112:0/3138924921 >> [v2:172.21.15.179:6833/140836226,v1:172.21.15.179:6835/140836226] conn(0x5618f67f35f0 0x5618f67f39c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1bd47a51c66b09 server_cookie=72fcefd0abd9528 in_seq=0 out_seq=0 2023-10-06T04:39:36.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.432+0000 7f30667fc700 1 -- 172.21.15.112:0/3138924921 <== mds.0 v2:172.21.15.179:6833/140836226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5618f66bbe00 con 0x5618f67f35f0 2023-10-06T04:39:36.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.432+0000 7f30667fc700 10 client.4695 handle_command_reply: tid=0 2023-10-06T04:39:36.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.432+0000 7f30979fab80 1 client.4695 shutdown 2023-10-06T04:39:36.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.432+0000 7f30979fab80 1 -- 172.21.15.112:0/3138924921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67cb9a0 msgr2=0x5618f68060c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.432+0000 7f30979fab80 1 --2- 172.21.15.112:0/3138924921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67cb9a0 0x5618f68060c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f307c000e50 tx=0x7f307c021000 comp rx=0 tx=0).stop 2023-10-06T04:39:36.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f30979fab80 1 -- 172.21.15.112:0/3138924921 shutdown_connections 2023-10-06T04:39:36.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f30979fab80 1 --2- 172.21.15.112:0/3138924921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5618f680fa90 0x5618f67f30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f30979fab80 1 --2- 172.21.15.112:0/3138924921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f67c9bd0 0x5618f6805b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f30979fab80 1 --2- 172.21.15.112:0/3138924921 >> [v2:172.21.15.179:6833/140836226,v1:172.21.15.179:6835/140836226] conn(0x5618f67f35f0 0x5618f67f39c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f30979fab80 1 --2- 172.21.15.112:0/3138924921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618f67cb9a0 0x5618f68060c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f30667fc700 0 client.4695 ms_handle_reset on v2:172.21.15.179:6833/140836226 2023-10-06T04:39:36.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f30979fab80 1 -- 172.21.15.112:0/3138924921 >> 172.21.15.112:0/3138924921 conn(0x5618f67ca070 msgr2=0x5618f67c47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:36.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f30979fab80 1 -- 172.21.15.112:0/3138924921 shutdown_connections 2023-10-06T04:39:36.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f30979fab80 1 -- 172.21.15.112:0/3138924921 wait complete. 2023-10-06T04:39:36.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f30979fab80 20 client.4695 trim_cache size 0 max 16384 2023-10-06T04:39:36.445 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-10-06T04:39:36.445 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "3e2b8a43-6e3c-475a-8b31-8dbcc20d6445", 2023-10-06T04:39:36.445 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2023-10-06T04:39:36.445 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 4273, 2023-10-06T04:39:36.445 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2023-10-06T04:39:36.445 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2023-10-06T04:39:36.445 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2023-10-06T04:39:36.445 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 14.806207707, 2023-10-06T04:39:36.445 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 7, 2023-10-06T04:39:36.445 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 20, 2023-10-06T04:39:36.446 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 20, 2023-10-06T04:39:36.446 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 20.738539764999999 2023-10-06T04:39:36.446 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-10-06T04:39:36.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f308e702700 1 -- 172.21.15.112:0/3376979790 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3074066f30 msgr2=0x7f30740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f308e702700 1 --2- 172.21.15.112:0/3376979790 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3074066f30 0x7f30740693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3078006f00 tx=0x7f30780091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f308e702700 1 -- 172.21.15.112:0/3376979790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f308816da50 msgr2=0x7f3088159530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:36.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f308e702700 1 --2- 172.21.15.112:0/3376979790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f308816da50 0x7f3088159530 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3080001f90 tx=0x7f3080015000 comp rx=0 tx=0).stop 2023-10-06T04:39:36.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f308e702700 1 -- 172.21.15.112:0/3376979790 shutdown_connections 2023-10-06T04:39:36.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f308e702700 1 --2- 172.21.15.112:0/3376979790 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3074066f30 0x7f30740693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f308e702700 1 --2- 172.21.15.112:0/3376979790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f308816da50 0x7f3088159530 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f308e702700 1 --2- 172.21.15.112:0/3376979790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30700052e0 0x7f30880b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f308e702700 1 --2- 172.21.15.112:0/3376979790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30880b6500 0x7f3088143630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:36.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f308e702700 1 -- 172.21.15.112:0/3376979790 >> 172.21.15.112:0/3376979790 conn(0x7f308806cfb0 msgr2=0x7f308815dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:36.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f308e702700 1 -- 172.21.15.112:0/3376979790 shutdown_connections 2023-10-06T04:39:36.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:36.433+0000 7f308e702700 1 -- 172.21.15.112:0/3376979790 wait complete. 2023-10-06T04:39:36.448 INFO:teuthology.run_tasks:Running task kclient... 2023-10-06T04:39:36.470 INFO:tasks.kclient:Mounting kernel clients... 2023-10-06T04:39:36.470 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T04:39:36.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:36.470 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-10-06T04:39:36.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:36.486 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2023-10-06T04:39:36.552 INFO:teuthology.orchestra.run.smithi112.stderr:Cannot find device "ceph-brx" 2023-10-06T04:39:36.552 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:39:36.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:36.553 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-10-06T04:39:36.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:36.609 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2023-10-06T04:39:36.674 INFO:teuthology.orchestra.run.smithi112.stderr:Cannot find device "ceph-brx" 2023-10-06T04:39:36.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:39:36.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:36.675 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-10-06T04:39:36.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:36.695 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2023-10-06T04:39:36.767 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2023-10-06T04:39:36.768 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:39:36.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:36.769 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-10-06T04:39:36.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:36.827 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2023-10-06T04:39:36.894 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2023-10-06T04:39:36.895 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:39:36.896 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-10-06T04:39:36.896 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:39:37.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.008+0000 7f489a4ff700 1 Processor -- start 2023-10-06T04:39:37.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.008+0000 7f489a4ff700 1 -- start start 2023-10-06T04:39:37.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.009+0000 7f489a4ff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f489406e400 0x7f48940ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.009+0000 7f489a4ff700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4894159b20 con 0x7f489406e030 2023-10-06T04:39:37.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.009+0000 7f489a4ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48940aca40 con 0x7f489406b510 2023-10-06T04:39:37.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.009+0000 7f489a4ff700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489406bf80 con 0x7f489406e400 2023-10-06T04:39:37.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.009+0000 7f4898a9c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f489406e400 0x7f48940ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.009+0000 7f4893fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f489406e030 0x7f489406ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60338/0 (socket says 172.21.15.112:60338) 2023-10-06T04:39:37.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.009+0000 7f4893fff700 1 -- 172.21.15.112:0/182773848 learned_addr learned my addr 172.21.15.112:0/182773848 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:37.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.010+0000 7f4898a9c700 1 -- 172.21.15.112:0/182773848 >> v1:172.21.15.179:6789/0 conn(0x7f489406b510 legacy=0x7f48940aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:37.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.010+0000 7f4898a9c700 1 -- 172.21.15.112:0/182773848 >> v1:172.21.15.112:6789/0 conn(0x7f489406e030 legacy=0x7f489406ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.010+0000 7f4898a9c700 1 -- 172.21.15.112:0/182773848 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489406b9c0 con 0x7f489406e400 2023-10-06T04:39:37.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.010+0000 7f4892ffd700 1 -- 172.21.15.112:0/182773848 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148139102 0 0) 0x7f4894159b20 con 0x7f489406e030 2023-10-06T04:39:37.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.010+0000 7f4898a9c700 1 --2- 172.21.15.112:0/182773848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f489406e400 0x7f48940ad5e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f488c009e60 tx=0x7f488c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5e48075221d66 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:37.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.010+0000 7f4892ffd700 1 -- 172.21.15.112:0/182773848 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c00bbf0 con 0x7f489406e400 2023-10-06T04:39:37.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.010+0000 7f4892ffd700 1 -- 172.21.15.112:0/182773848 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488c00bd50 con 0x7f489406e400 2023-10-06T04:39:37.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.010+0000 7f4892ffd700 1 -- 172.21.15.112:0/182773848 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c0106d0 con 0x7f489406e400 2023-10-06T04:39:37.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.010+0000 7f489a4ff700 1 -- 172.21.15.112:0/182773848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f489406e400 msgr2=0x7f48940ad5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.010+0000 7f489a4ff700 1 --2- 172.21.15.112:0/182773848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f489406e400 0x7f48940ad5e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f488c009e60 tx=0x7f488c009780 comp rx=0 tx=0).stop 2023-10-06T04:39:37.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.010+0000 7f489a4ff700 1 -- 172.21.15.112:0/182773848 shutdown_connections 2023-10-06T04:39:37.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.010+0000 7f489a4ff700 1 --2- 172.21.15.112:0/182773848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f489406e400 0x7f48940ad5e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.010+0000 7f489a4ff700 1 -- 172.21.15.112:0/182773848 >> 172.21.15.112:0/182773848 conn(0x7f489406d230 msgr2=0x7f48940af580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:37.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.010+0000 7f489a4ff700 1 -- 172.21.15.112:0/182773848 shutdown_connections 2023-10-06T04:39:37.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.010+0000 7f489a4ff700 1 -- 172.21.15.112:0/182773848 wait complete. 2023-10-06T04:39:37.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.011+0000 7f489a4ff700 1 Processor -- start 2023-10-06T04:39:37.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.012+0000 7f489a4ff700 1 -- start start 2023-10-06T04:39:37.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.012+0000 7f489a4ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f489406b510 0x7f4894165b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.012+0000 7f489a4ff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f489406e030 0x7f48940ab920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.012+0000 7f489a4ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f489406e400 0x7f48940abe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.012+0000 7f489a4ff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48940a9110 con 0x7f489406e030 2023-10-06T04:39:37.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.012+0000 7f489a4ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4894166d20 con 0x7f489406b510 2023-10-06T04:39:37.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.012+0000 7f489a4ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48941664a0 con 0x7f489406e400 2023-10-06T04:39:37.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.012+0000 7f48937fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f489406e030 0x7f48940ab920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.013+0000 7f48937fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f489406e030 0x7f48940ab920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58612/0 (socket says 172.21.15.112:58612) 2023-10-06T04:39:37.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.013+0000 7f48937fe700 1 -- 172.21.15.112:0/1312993864 learned_addr learned my addr 172.21.15.112:0/1312993864 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:37.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.013+0000 7f4893fff700 1 --2- 172.21.15.112:0/1312993864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f489406b510 0x7f4894165b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.013+0000 7f4898a9c700 1 --2- 172.21.15.112:0/1312993864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f489406e400 0x7f48940abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.013+0000 7f48937fe700 1 -- 172.21.15.112:0/1312993864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f489406e400 msgr2=0x7f48940abe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.013+0000 7f48937fe700 1 --2- 172.21.15.112:0/1312993864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f489406e400 0x7f48940abe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.013+0000 7f48937fe700 1 -- 172.21.15.112:0/1312993864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f489406b510 msgr2=0x7f4894165b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.013+0000 7f48937fe700 1 --2- 172.21.15.112:0/1312993864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f489406b510 0x7f4894165b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.013+0000 7f48937fe700 1 -- 172.21.15.112:0/1312993864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c009a20 con 0x7f489406e030 2023-10-06T04:39:37.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.013+0000 7f4898a9c700 1 --2- 172.21.15.112:0/1312993864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f489406e400 0x7f48940abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:37.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.013+0000 7f48937fe700 1 --2- 172.21.15.112:0/1312993864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f489406e030 0x7f48940ab920 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f488800c5d0 tx=0x7f4888007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:37.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.013+0000 7f487bfff700 1 -- 172.21.15.112:0/1312993864 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4888011590 con 0x7f489406e030 2023-10-06T04:39:37.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.013+0000 7f487bfff700 1 -- 172.21.15.112:0/1312993864 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4888011710 con 0x7f489406e030 2023-10-06T04:39:37.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.013+0000 7f489a4ff700 1 -- 172.21.15.112:0/1312993864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4894166780 con 0x7f489406e030 2023-10-06T04:39:37.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.013+0000 7f487bfff700 1 -- 172.21.15.112:0/1312993864 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4888011ad0 con 0x7f489406e030 2023-10-06T04:39:37.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.013+0000 7f489a4ff700 1 -- 172.21.15.112:0/1312993864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4894166a60 con 0x7f489406e030 2023-10-06T04:39:37.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.014+0000 7f489a4ff700 1 -- 172.21.15.112:0/1312993864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48940646e0 con 0x7f489406e030 2023-10-06T04:39:37.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.014+0000 7f487bfff700 1 -- 172.21.15.112:0/1312993864 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f488801c460 con 0x7f489406e030 2023-10-06T04:39:37.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.015+0000 7f487bfff700 1 --2- 172.21.15.112:0/1312993864 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4880066f30 0x7f48800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:37.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.015+0000 7f4893fff700 1 --2- 172.21.15.112:0/1312993864 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4880066f30 0x7f48800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:37.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.015+0000 7f487bfff700 1 -- 172.21.15.112:0/1312993864 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4888084490 con 0x7f489406e030 2023-10-06T04:39:37.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.015+0000 7f4893fff700 1 --2- 172.21.15.112:0/1312993864 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4880066f30 0x7f48800693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f48940cc890 tx=0x7f4884009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:37.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.019+0000 7f487bfff700 1 -- 172.21.15.112:0/1312993864 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48940646e0 con 0x7f489406e030 2023-10-06T04:39:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.244+0000 7f489a4ff700 1 -- 172.21.15.112:0/1312993864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f48940646e0 con 0x7f489406e030 2023-10-06T04:39:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.244+0000 7f487bfff700 1 -- 172.21.15.112:0/1312993864 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f48940646e0 con 0x7f489406e030 2023-10-06T04:39:37.246 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:39:37.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.246+0000 7f489a4ff700 1 -- 172.21.15.112:0/1312993864 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4880066f30 msgr2=0x7f48800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.246+0000 7f489a4ff700 1 --2- 172.21.15.112:0/1312993864 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4880066f30 0x7f48800693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f48940cc890 tx=0x7f4884009040 comp rx=0 tx=0).stop 2023-10-06T04:39:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.246+0000 7f489a4ff700 1 -- 172.21.15.112:0/1312993864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f489406e030 msgr2=0x7f48940ab920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.246+0000 7f489a4ff700 1 --2- 172.21.15.112:0/1312993864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f489406e030 0x7f48940ab920 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f488800c5d0 tx=0x7f4888007f60 comp rx=0 tx=0).stop 2023-10-06T04:39:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.246+0000 7f489a4ff700 1 -- 172.21.15.112:0/1312993864 shutdown_connections 2023-10-06T04:39:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.246+0000 7f489a4ff700 1 --2- 172.21.15.112:0/1312993864 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4880066f30 0x7f48800693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.246+0000 7f489a4ff700 1 --2- 172.21.15.112:0/1312993864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f489406e400 0x7f48940abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.246+0000 7f489a4ff700 1 --2- 172.21.15.112:0/1312993864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f489406b510 0x7f4894165b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.246+0000 7f489a4ff700 1 --2- 172.21.15.112:0/1312993864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f489406e030 0x7f48940ab920 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.246+0000 7f489a4ff700 1 -- 172.21.15.112:0/1312993864 >> 172.21.15.112:0/1312993864 conn(0x7f489406d230 msgr2=0x7f489406ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.246+0000 7f489a4ff700 1 -- 172.21.15.112:0/1312993864 shutdown_connections 2023-10-06T04:39:37.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:37.246+0000 7f489a4ff700 1 -- 172.21.15.112:0/1312993864 wait complete. 2023-10-06T04:39:37.259 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:39:37.259 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:39:37.260 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-10-06T04:39:37.260 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T04:39:37.260 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T04:39:37.260 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:39:37.260 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:39:37.260 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:39:37.260 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:39:37.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:37.260 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-10-06T04:39:37.275 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:39:37.275 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:39:37.275 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:39:37.275 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:37.275 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-10-06T04:39:37.275 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:37.275 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:39:37.276 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:37.276 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2023-10-06T04:39:37.276 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:39:37.276 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:37.276 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2023-10-06T04:39:37.276 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:39:37.276 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:37.276 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:39:37.276 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:37.276 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T04:39:37.276 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42497sec preferred_lft 42497sec 2023-10-06T04:39:37.277 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2023-10-06T04:39:37.277 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:37.277 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T04:39:37.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:37.277 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-06T04:39:37.277 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-06T04:39:37.278 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add name ceph-brx type bridge 2023-10-06T04:39:37.278 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr flush dev ceph-brx 2023-10-06T04:39:37.278 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set ceph-brx up 2023-10-06T04:39:37.278 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T04:39:37.278 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-06T04:39:37.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:37.427 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:39:37.468 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-10-06T04:39:37.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:37.469 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-10-06T04:39:37.538 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-10-06T04:39:37.539 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:39:37.539 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:39:37.539 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T04:39:37.539 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:39:37.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:37.540 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-06T04:39:37.540 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-06T04:39:37.540 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:39:37.540 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:39:37.541 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:39:37.541 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-06T04:39:37.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:37.789 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-10-06T04:39:37.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:37.805 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2023-10-06T04:39:37.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:37.859 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-06T04:39:37.859 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-06T04:39:37.859 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:39:37.859 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T04:39:37.859 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-06T04:39:37.948 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T04:39:37.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:37.949 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-06T04:39:37.949 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-06T04:39:37.949 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T04:39:37.950 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T04:39:37.950 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T04:39:37.950 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T04:39:37.950 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T04:39:37.950 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-06T04:39:38.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:38.145 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-06T04:39:38.145 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-06T04:39:38.145 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2023-10-06T04:39:38.145 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T04:39:38.145 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-06T04:39:38.236 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:39:38.236 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T04:39:38.252 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:39:38.252 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:39:38.252 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:39:38.307 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T04:39:38.307 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:39:38.307 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:39:38.392 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:39:38.392 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:39:38.392 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2023-10-06T04:39:38.475 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:39:38.476 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:39:38.476 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2023-10-06T04:39:38.476 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-06T04:39:38.476 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:39:38.499 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:39:38.499 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:39:38.499 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2023-10-06T04:39:38.499 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-06T04:39:38.499 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:39:38.499 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:6789,172.21.15.179:6789,172.21.15.179:6790" 2023-10-06T04:39:38.499 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.112:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2023-10-06T04:39:38.500 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3e2b8a43-6e3c-475a-8b31-8dbcc20d6445" will pass to kernel 2023-10-06T04:39:38.501 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:39:38.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:38.502 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:39:38.526 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-10-06T04:39:38.527 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:39:38.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.679+0000 7f375f54d700 1 Processor -- start 2023-10-06T04:39:38.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.679+0000 7f375f54d700 1 -- start start 2023-10-06T04:39:38.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.680+0000 7f375f54d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f37580b3040 0x7f37580cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.680+0000 7f375f54d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f37580b0e70 0x7f37580b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.680+0000 7f375f54d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37580cd740 con 0x7f3758159d50 2023-10-06T04:39:38.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.680+0000 7f375f54d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37580b3490 con 0x7f37580b0e70 2023-10-06T04:39:38.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.680+0000 7f375f54d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37580b17d0 con 0x7f37580b3040 2023-10-06T04:39:38.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.680+0000 7f375daea700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f37580b0e70 0x7f37580b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:38.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.680+0000 7f375d2e9700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3758159d50 0x7f375815a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46580/0 (socket says 172.21.15.112:46580) 2023-10-06T04:39:38.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.680+0000 7f375d2e9700 1 -- 172.21.15.112:0/3176141270 learned_addr learned my addr 172.21.15.112:0/3176141270 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:38.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.680+0000 7f375daea700 1 -- 172.21.15.112:0/3176141270 >> v2:172.21.15.179:3300/0 conn(0x7f37580b3040 msgr2=0x7f37580cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:38.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.680+0000 7f375daea700 1 --2- 172.21.15.112:0/3176141270 >> v2:172.21.15.179:3300/0 conn(0x7f37580b3040 0x7f37580cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.680+0000 7f375daea700 1 -- 172.21.15.112:0/3176141270 >> v1:172.21.15.112:6789/0 conn(0x7f3758159d50 legacy=0x7f375815a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.680+0000 7f375daea700 1 -- 172.21.15.112:0/3176141270 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37580ccb30 con 0x7f37580b0e70 2023-10-06T04:39:38.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.680+0000 7f374ffff700 1 -- 172.21.15.112:0/3176141270 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369111824 0 0) 0x7f37580cd740 con 0x7f3758159d50 2023-10-06T04:39:38.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.681+0000 7f375daea700 1 --2- 172.21.15.112:0/3176141270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37580b0e70 0x7f37580b1290 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3758088c80 tx=0x7f3750009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164eba333c0a85ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:38.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.681+0000 7f374ffff700 1 -- 172.21.15.112:0/3176141270 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375000e070 con 0x7f37580b0e70 2023-10-06T04:39:38.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.681+0000 7f374ffff700 1 -- 172.21.15.112:0/3176141270 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375000bc30 con 0x7f37580b0e70 2023-10-06T04:39:38.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.681+0000 7f374ffff700 1 -- 172.21.15.112:0/3176141270 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3750012430 con 0x7f37580b0e70 2023-10-06T04:39:38.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.681+0000 7f375f54d700 1 -- 172.21.15.112:0/3176141270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37580b0e70 msgr2=0x7f37580b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.681+0000 7f375f54d700 1 --2- 172.21.15.112:0/3176141270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37580b0e70 0x7f37580b1290 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3758088c80 tx=0x7f3750009780 comp rx=0 tx=0).stop 2023-10-06T04:39:38.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.681+0000 7f375f54d700 1 -- 172.21.15.112:0/3176141270 shutdown_connections 2023-10-06T04:39:38.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.681+0000 7f375f54d700 1 --2- 172.21.15.112:0/3176141270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37580b0e70 0x7f37580b1290 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.681+0000 7f375f54d700 1 --2- 172.21.15.112:0/3176141270 >> v2:172.21.15.179:3300/0 conn(0x7f37580b3040 0x7f37580cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.681+0000 7f375f54d700 1 -- 172.21.15.112:0/3176141270 >> 172.21.15.112:0/3176141270 conn(0x7f3758099b60 msgr2=0x7f375806cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:38.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.681+0000 7f375f54d700 1 -- 172.21.15.112:0/3176141270 shutdown_connections 2023-10-06T04:39:38.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.681+0000 7f375f54d700 1 -- 172.21.15.112:0/3176141270 wait complete. 2023-10-06T04:39:38.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.682+0000 7f375f54d700 1 Processor -- start 2023-10-06T04:39:38.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.682+0000 7f375f54d700 1 -- start start 2023-10-06T04:39:38.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.683+0000 7f375f54d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37580b0e70 0x7f375816e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.683+0000 7f375f54d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37580b3040 0x7f37581525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.683+0000 7f375f54d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3758159d50 0x7f375809faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.683+0000 7f375f54d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375809f610 con 0x7f3758159d50 2023-10-06T04:39:38.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.683+0000 7f375f54d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375816e980 con 0x7f37580b0e70 2023-10-06T04:39:38.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.683+0000 7f375f54d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375809ea00 con 0x7f37580b3040 2023-10-06T04:39:38.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.683+0000 7f375daea700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3758159d50 0x7f375809faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:38.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.683+0000 7f375daea700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3758159d50 0x7f375809faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34136/0 (socket says 172.21.15.112:34136) 2023-10-06T04:39:38.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.683+0000 7f375daea700 1 -- 172.21.15.112:0/3410264497 learned_addr learned my addr 172.21.15.112:0/3410264497 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:38.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.684+0000 7f375daea700 1 -- 172.21.15.112:0/3410264497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37580b3040 msgr2=0x7f37581525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.684+0000 7f375daea700 1 --2- 172.21.15.112:0/3410264497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37580b3040 0x7f37581525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.684+0000 7f375daea700 1 -- 172.21.15.112:0/3410264497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37580b0e70 msgr2=0x7f375816e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.684+0000 7f375daea700 1 --2- 172.21.15.112:0/3410264497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37580b0e70 0x7f375816e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.684+0000 7f375daea700 1 -- 172.21.15.112:0/3410264497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3750009a20 con 0x7f3758159d50 2023-10-06T04:39:38.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.684+0000 7f375daea700 1 --2- 172.21.15.112:0/3410264497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3758159d50 0x7f375809faa0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3750013000 tx=0x7f3750019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:38.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.684+0000 7f374d7fa700 1 -- 172.21.15.112:0/3410264497 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375001d630 con 0x7f3758159d50 2023-10-06T04:39:38.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.684+0000 7f374d7fa700 1 -- 172.21.15.112:0/3410264497 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375001d790 con 0x7f3758159d50 2023-10-06T04:39:38.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.684+0000 7f374d7fa700 1 -- 172.21.15.112:0/3410264497 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375001db10 con 0x7f3758159d50 2023-10-06T04:39:38.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.684+0000 7f375f54d700 1 -- 172.21.15.112:0/3410264497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375809ece0 con 0x7f3758159d50 2023-10-06T04:39:38.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.684+0000 7f375f54d700 1 -- 172.21.15.112:0/3410264497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375809f2a0 con 0x7f3758159d50 2023-10-06T04:39:38.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.685+0000 7f375f54d700 1 -- 172.21.15.112:0/3410264497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375805f230 con 0x7f3758159d50 2023-10-06T04:39:38.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.685+0000 7f374d7fa700 1 -- 172.21.15.112:0/3410264497 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3750024070 con 0x7f3758159d50 2023-10-06T04:39:38.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.686+0000 7f374d7fa700 1 --2- 172.21.15.112:0/3410264497 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f373c066f30 0x7f373c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:38.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.686+0000 7f374d7fa700 1 -- 172.21.15.112:0/3410264497 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3750086f30 con 0x7f3758159d50 2023-10-06T04:39:38.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.686+0000 7f375d2e9700 1 --2- 172.21.15.112:0/3410264497 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f373c066f30 0x7f373c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:38.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.686+0000 7f375d2e9700 1 --2- 172.21.15.112:0/3410264497 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f373c066f30 0x7f373c0693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f37540011e0 tx=0x7f37540079d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:38.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.690+0000 7f374d7fa700 1 -- 172.21.15.112:0/3410264497 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3750054040 con 0x7f3758159d50 2023-10-06T04:39:38.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.918+0000 7f375f54d700 1 -- 172.21.15.112:0/3410264497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f375809f750 con 0x7f3758159d50 2023-10-06T04:39:38.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.918+0000 7f374d7fa700 1 -- 172.21.15.112:0/3410264497 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f375002c060 con 0x7f3758159d50 2023-10-06T04:39:38.920 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:39:38.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.920+0000 7f375f54d700 1 -- 172.21.15.112:0/3410264497 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f373c066f30 msgr2=0x7f373c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.920+0000 7f375f54d700 1 --2- 172.21.15.112:0/3410264497 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f373c066f30 0x7f373c0693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f37540011e0 tx=0x7f37540079d0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.920+0000 7f375f54d700 1 -- 172.21.15.112:0/3410264497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3758159d50 msgr2=0x7f375809faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:38.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.920+0000 7f375f54d700 1 --2- 172.21.15.112:0/3410264497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3758159d50 0x7f375809faa0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3750013000 tx=0x7f3750019000 comp rx=0 tx=0).stop 2023-10-06T04:39:38.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.920+0000 7f375f54d700 1 -- 172.21.15.112:0/3410264497 shutdown_connections 2023-10-06T04:39:38.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.920+0000 7f375f54d700 1 --2- 172.21.15.112:0/3410264497 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f373c066f30 0x7f373c0693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.920+0000 7f375f54d700 1 --2- 172.21.15.112:0/3410264497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3758159d50 0x7f375809faa0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.920+0000 7f375f54d700 1 --2- 172.21.15.112:0/3410264497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37580b0e70 0x7f375816e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.920+0000 7f375f54d700 1 --2- 172.21.15.112:0/3410264497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37580b3040 0x7f37581525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:38.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.920+0000 7f375f54d700 1 -- 172.21.15.112:0/3410264497 >> 172.21.15.112:0/3410264497 conn(0x7f3758099b60 msgr2=0x7f37580cdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:38.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.920+0000 7f375f54d700 1 -- 172.21.15.112:0/3410264497 shutdown_connections 2023-10-06T04:39:38.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:38.920+0000 7f375f54d700 1 -- 172.21.15.112:0/3410264497 wait complete. 2023-10-06T04:39:38.933 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:39:38.933 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:39:38.934 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-10-06T04:39:38.934 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T04:39:38.934 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T04:39:38.934 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:39:38.934 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:39:38.934 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:39:38.934 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T04:39:38.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:38.934 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-10-06T04:39:38.950 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:39:38.950 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:39:38.950 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:39:38.950 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:38.950 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-10-06T04:39:38.951 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:38.951 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:39:38.951 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:38.951 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2023-10-06T04:39:38.951 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:39:38.951 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:38.951 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2023-10-06T04:39:38.952 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:39:38.952 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:38.952 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:39:38.952 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:38.952 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T04:39:38.952 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42496sec preferred_lft 42496sec 2023-10-06T04:39:38.953 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2023-10-06T04:39:38.953 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:38.953 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:39:38.953 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether ca:d2:a2:df:0f:a2 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:38.953 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:39:38.953 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:38.954 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c08a:26ff:fea3:da8e/64 scope link 2023-10-06T04:39:38.954 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:38.954 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:39:38.954 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether ca:d2:a2:df:0f:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:39:38.954 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c8d2:a2ff:fedf:fa2/64 scope link tentative 2023-10-06T04:39:38.954 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:38.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:38.955 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:39:39.013 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-10-06T04:39:39.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:39.014 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-10-06T04:39:39.071 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-10-06T04:39:39.071 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:39:39.072 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:39:39.072 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T04:39:39.072 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:39:39.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:39.072 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-06T04:39:39.072 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-06T04:39:39.072 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:39:39.072 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:39:39.072 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:39:39.073 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-06T04:39:39.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:39.173 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-10-06T04:39:39.188 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:39:39.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:39.188 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2023-10-06T04:39:39.242 INFO:teuthology.orchestra.run.smithi112.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T04:39:39.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:39.242 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-06T04:39:39.243 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-06T04:39:39.243 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:39:39.243 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T04:39:39.243 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-06T04:39:39.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:39.331 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T04:39:39.372 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:39:39.372 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:39:39.372 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:39:39.373 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:39.373 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-10-06T04:39:39.373 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:39.373 INFO:teuthology.orchestra.run.smithi112.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:39:39.373 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 3e:e0:7f:51:25:6e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:39:39.373 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:39:39.374 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:39.374 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::3ce0:7fff:fe51:256e/64 scope link tentative 2023-10-06T04:39:39.374 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:39.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:39.382 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T04:39:39.462 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:39:39.462 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:39:39.462 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:39:39.463 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:39.463 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-10-06T04:39:39.463 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:39.463 INFO:teuthology.orchestra.run.smithi112.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:39:39.463 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 3e:e0:7f:51:25:6e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:39:39.463 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:39:39.463 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:39.463 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::3ce0:7fff:fe51:256e/64 scope link tentative 2023-10-06T04:39:39.463 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:39.473 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T04:39:39.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:39.474 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-06T04:39:39.474 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-06T04:39:39.474 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T04:39:39.474 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T04:39:39.474 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T04:39:39.474 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T04:39:39.474 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T04:39:39.474 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-06T04:39:39.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:39.700 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-06T04:39:39.700 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-06T04:39:39.700 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.1 up 2023-10-06T04:39:39.700 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T04:39:39.700 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-06T04:39:39.779 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:39:39.779 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T04:39:39.793 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T04:39:39.794 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:39:39.794 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T04:39:39.848 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T04:39:39.848 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:39:39.848 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T04:39:39.927 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T04:39:39.928 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T04:39:39.928 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2023-10-06T04:39:39.936 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T04:39:39.936 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T04:39:39.936 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2023-10-06T04:39:39.936 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-06T04:39:39.936 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:39:39.958 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T04:39:39.958 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T04:39:39.958 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2023-10-06T04:39:39.958 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-06T04:39:39.958 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:39:39.959 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:6789,172.21.15.179:6789,172.21.15.179:6790" 2023-10-06T04:39:39.959 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.112:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2023-10-06T04:39:39.959 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=3e2b8a43-6e3c-475a-8b31-8dbcc20d6445" will pass to kernel 2023-10-06T04:39:39.960 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:39:39.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:39.960 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T04:39:40.026 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-10-06T04:39:40.026 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:39:40.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.177+0000 7f0f9edbf700 1 Processor -- start 2023-10-06T04:39:40.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.178+0000 7f0f9edbf700 1 -- start start 2023-10-06T04:39:40.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.178+0000 7f0f9edbf700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f98067eb0 0x7f0f98068320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.178+0000 7f0f9edbf700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0f98159010 0x7f0f98159430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.178+0000 7f0f9edbf700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f98068860 con 0x7f0f9815aa00 2023-10-06T04:39:40.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.178+0000 7f0f9edbf700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9815b500 con 0x7f0f98159010 2023-10-06T04:39:40.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.178+0000 7f0f9edbf700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9815b7e0 con 0x7f0f98067eb0 2023-10-06T04:39:40.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.178+0000 7f0f9d35c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0f98159010 0x7f0f98159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.178+0000 7f0f9d35c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0f98159010 0x7f0f98159430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34142/0 (socket says 172.21.15.112:34142) 2023-10-06T04:39:40.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.178+0000 7f0f9d35c700 1 -- 172.21.15.112:0/2314386471 learned_addr learned my addr 172.21.15.112:0/2314386471 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:40.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.179+0000 7f0f8ffff700 1 --2- 172.21.15.112:0/2314386471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f98067eb0 0x7f0f98068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.179+0000 7f0f9d35c700 1 -- 172.21.15.112:0/2314386471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f98067eb0 msgr2=0x7f0f98068320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:40.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.179+0000 7f0f9d35c700 1 --2- 172.21.15.112:0/2314386471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f98067eb0 0x7f0f98068320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.179+0000 7f0f9d35c700 1 -- 172.21.15.112:0/2314386471 >> v1:172.21.15.179:6789/0 conn(0x7f0f9815aa00 legacy=0x7f0f981585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:40.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.179+0000 7f0f9d35c700 1 -- 172.21.15.112:0/2314386471 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9815bac0 con 0x7f0f98159010 2023-10-06T04:39:40.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.179+0000 7f0f9d35c700 1 --2- 172.21.15.112:0/2314386471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f98159010 0x7f0f98159430 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0f900099b0 tx=0x7f0f90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31042ba34d8bc8f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:40.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.179+0000 7f0f8f7fe700 1 -- 172.21.15.112:0/2314386471 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9000b860 con 0x7f0f98159010 2023-10-06T04:39:40.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.179+0000 7f0f8f7fe700 1 -- 172.21.15.112:0/2314386471 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9000b9c0 con 0x7f0f98159010 2023-10-06T04:39:40.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.179+0000 7f0f8f7fe700 1 -- 172.21.15.112:0/2314386471 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9000bd60 con 0x7f0f98159010 2023-10-06T04:39:40.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.180+0000 7f0f9edbf700 1 -- 172.21.15.112:0/2314386471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f98159010 msgr2=0x7f0f98159430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:40.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.180+0000 7f0f9edbf700 1 --2- 172.21.15.112:0/2314386471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f98159010 0x7f0f98159430 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0f900099b0 tx=0x7f0f90009250 comp rx=0 tx=0).stop 2023-10-06T04:39:40.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.180+0000 7f0f9edbf700 1 -- 172.21.15.112:0/2314386471 shutdown_connections 2023-10-06T04:39:40.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.180+0000 7f0f9edbf700 1 --2- 172.21.15.112:0/2314386471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f98159010 0x7f0f98159430 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.180+0000 7f0f9edbf700 1 --2- 172.21.15.112:0/2314386471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f98067eb0 0x7f0f98068320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.180+0000 7f0f9edbf700 1 -- 172.21.15.112:0/2314386471 >> 172.21.15.112:0/2314386471 conn(0x7f0f980ce5e0 msgr2=0x7f0f980ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:40.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.180+0000 7f0f9edbf700 1 -- 172.21.15.112:0/2314386471 shutdown_connections 2023-10-06T04:39:40.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.180+0000 7f0f9edbf700 1 -- 172.21.15.112:0/2314386471 wait complete. 2023-10-06T04:39:40.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.181+0000 7f0f9edbf700 1 Processor -- start 2023-10-06T04:39:40.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.181+0000 7f0f9edbf700 1 -- start start 2023-10-06T04:39:40.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f9edbf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f98067eb0 0x7f0f981684d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f9edbf700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f98159010 0x7f0f980b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f9edbf700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f9815aa00 0x7f0f980cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f9edbf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f980b05b0 con 0x7f0f98067eb0 2023-10-06T04:39:40.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f9edbf700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f98168a10 con 0x7f0f98159010 2023-10-06T04:39:40.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f9edbf700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9816b1b0 con 0x7f0f9815aa00 2023-10-06T04:39:40.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f9cb5b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f98067eb0 0x7f0f981684d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f9cb5b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f98067eb0 0x7f0f981684d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34158/0 (socket says 172.21.15.112:34158) 2023-10-06T04:39:40.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f9cb5b700 1 -- 172.21.15.112:0/1224385638 learned_addr learned my addr 172.21.15.112:0/1224385638 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:40.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f9d35c700 1 --2- 172.21.15.112:0/1224385638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f9815aa00 0x7f0f980cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f8ffff700 1 --2- 172.21.15.112:0/1224385638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f98159010 0x7f0f980b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f9cb5b700 1 -- 172.21.15.112:0/1224385638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f9815aa00 msgr2=0x7f0f980cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:40.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f9cb5b700 1 --2- 172.21.15.112:0/1224385638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f9815aa00 0x7f0f980cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f9cb5b700 1 -- 172.21.15.112:0/1224385638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f98159010 msgr2=0x7f0f980b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:40.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f9cb5b700 1 --2- 172.21.15.112:0/1224385638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f98159010 0x7f0f980b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f9cb5b700 1 -- 172.21.15.112:0/1224385638 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f900094f0 con 0x7f0f98067eb0 2023-10-06T04:39:40.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f9cb5b700 1 --2- 172.21.15.112:0/1224385638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f98067eb0 0x7f0f981684d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400c8e0 tx=0x7f0f94001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:40.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f8cff9700 1 -- 172.21.15.112:0/1224385638 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94012630 con 0x7f0f98067eb0 2023-10-06T04:39:40.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f8cff9700 1 -- 172.21.15.112:0/1224385638 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f940127b0 con 0x7f0f98067eb0 2023-10-06T04:39:40.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f8cff9700 1 -- 172.21.15.112:0/1224385638 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94012b70 con 0x7f0f98067eb0 2023-10-06T04:39:40.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f9edbf700 1 -- 172.21.15.112:0/1224385638 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f980b07c0 con 0x7f0f98067eb0 2023-10-06T04:39:40.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.182+0000 7f0f9edbf700 1 -- 172.21.15.112:0/1224385638 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f980b0d80 con 0x7f0f98067eb0 2023-10-06T04:39:40.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.183+0000 7f0f9edbf700 1 -- 172.21.15.112:0/1224385638 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f9816b690 con 0x7f0f98067eb0 2023-10-06T04:39:40.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.184+0000 7f0f8cff9700 1 -- 172.21.15.112:0/1224385638 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0f94003030 con 0x7f0f98067eb0 2023-10-06T04:39:40.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.184+0000 7f0f8cff9700 1 --2- 172.21.15.112:0/1224385638 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0f84066f30 0x7f0f840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:40.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.184+0000 7f0f8cff9700 1 -- 172.21.15.112:0/1224385638 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0f940845e0 con 0x7f0f98067eb0 2023-10-06T04:39:40.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.184+0000 7f0f8ffff700 1 --2- 172.21.15.112:0/1224385638 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0f84066f30 0x7f0f840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:40.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.185+0000 7f0f8ffff700 1 --2- 172.21.15.112:0/1224385638 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0f84066f30 0x7f0f840693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0f98157090 tx=0x7f0f88008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:40.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.188+0000 7f0f8cff9700 1 -- 172.21.15.112:0/1224385638 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f9816b690 con 0x7f0f98067eb0 2023-10-06T04:39:40.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.412+0000 7f0f9edbf700 1 -- 172.21.15.112:0/1224385638 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0f980b0bc0 con 0x7f0f98067eb0 2023-10-06T04:39:40.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.413+0000 7f0f8cff9700 1 -- 172.21.15.112:0/1224385638 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0f94055180 con 0x7f0f98067eb0 2023-10-06T04:39:40.415 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:39:40.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.414+0000 7f0f9edbf700 1 -- 172.21.15.112:0/1224385638 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0f84066f30 msgr2=0x7f0f840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:40.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.414+0000 7f0f9edbf700 1 --2- 172.21.15.112:0/1224385638 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0f84066f30 0x7f0f840693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0f98157090 tx=0x7f0f88008040 comp rx=0 tx=0).stop 2023-10-06T04:39:40.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.414+0000 7f0f9edbf700 1 -- 172.21.15.112:0/1224385638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f98067eb0 msgr2=0x7f0f981684d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:40.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.414+0000 7f0f9edbf700 1 --2- 172.21.15.112:0/1224385638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f98067eb0 0x7f0f981684d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400c8e0 tx=0x7f0f94001710 comp rx=0 tx=0).stop 2023-10-06T04:39:40.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.415+0000 7f0f9edbf700 1 -- 172.21.15.112:0/1224385638 shutdown_connections 2023-10-06T04:39:40.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.415+0000 7f0f9edbf700 1 --2- 172.21.15.112:0/1224385638 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0f84066f30 0x7f0f840693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.415+0000 7f0f9edbf700 1 --2- 172.21.15.112:0/1224385638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f9815aa00 0x7f0f980cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.415+0000 7f0f9edbf700 1 --2- 172.21.15.112:0/1224385638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f98067eb0 0x7f0f981684d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.415+0000 7f0f9edbf700 1 --2- 172.21.15.112:0/1224385638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f98159010 0x7f0f980b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:40.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.415+0000 7f0f9edbf700 1 -- 172.21.15.112:0/1224385638 >> 172.21.15.112:0/1224385638 conn(0x7f0f980ce5e0 msgr2=0x7f0f980cd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:40.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.415+0000 7f0f9edbf700 1 -- 172.21.15.112:0/1224385638 shutdown_connections 2023-10-06T04:39:40.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:40.415+0000 7f0f9edbf700 1 -- 172.21.15.112:0/1224385638 wait complete. 2023-10-06T04:39:40.429 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:39:40.429 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:39:40.429 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-10-06T04:39:40.429 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T04:39:40.429 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T04:39:40.429 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:39:40.429 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:39:40.429 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:39:40.430 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T04:39:40.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:40.430 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-10-06T04:39:40.448 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:39:40.448 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:39:40.448 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:39:40.448 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:40.448 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-10-06T04:39:40.449 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:40.449 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:39:40.449 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:40.449 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-10-06T04:39:40.449 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:39:40.449 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:40.449 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-10-06T04:39:40.449 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:39:40.449 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:40.449 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:39:40.449 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:40.449 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T04:39:40.450 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42494sec preferred_lft 42494sec 2023-10-06T04:39:40.450 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link noprefixroute 2023-10-06T04:39:40.450 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:40.450 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T04:39:40.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:40.450 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-06T04:39:40.450 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-06T04:39:40.450 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add name ceph-brx type bridge 2023-10-06T04:39:40.450 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr flush dev ceph-brx 2023-10-06T04:39:40.451 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set ceph-brx up 2023-10-06T04:39:40.451 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T04:39:40.451 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-06T04:39:40.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:40.621 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:39:40.664 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-10-06T04:39:40.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:40.665 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-10-06T04:39:40.732 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-10-06T04:39:40.733 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:39:40.733 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:39:40.733 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T04:39:40.733 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:39:40.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:40.734 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-06T04:39:40.734 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-06T04:39:40.734 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:39:40.734 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:39:40.734 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:39:40.734 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-06T04:39:40.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:40.971 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-10-06T04:39:40.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:40.985 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list-id 2023-10-06T04:39:41.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:41.040 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-06T04:39:41.040 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-06T04:39:41.040 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:39:41.040 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T04:39:41.040 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-06T04:39:41.129 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T04:39:41.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:41.130 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-06T04:39:41.130 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-06T04:39:41.130 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T04:39:41.130 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T04:39:41.130 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T04:39:41.130 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T04:39:41.130 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T04:39:41.130 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-06T04:39:41.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:41.346 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-06T04:39:41.346 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-06T04:39:41.346 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-10-06T04:39:41.346 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T04:39:41.346 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-06T04:39:41.438 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:39:41.438 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T04:39:41.452 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T04:39:41.452 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:39:41.452 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T04:39:41.506 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T04:39:41.507 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:39:41.507 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T04:39:41.600 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T04:39:41.600 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T04:39:41.600 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2023-10-06T04:39:41.671 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T04:39:41.671 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T04:39:41.671 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2023-10-06T04:39:41.671 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-06T04:39:41.671 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:39:41.692 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T04:39:41.692 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T04:39:41.692 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2023-10-06T04:39:41.692 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-06T04:39:41.692 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:39:41.692 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.112:6789,172.21.15.179:6789,172.21.15.179:6790" 2023-10-06T04:39:41.692 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.112:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2023-10-06T04:39:41.693 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=3e2b8a43-6e3c-475a-8b31-8dbcc20d6445" will pass to kernel 2023-10-06T04:39:41.694 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:39:41.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:41.695 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T04:39:41.718 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-10-06T04:39:41.719 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:39:41.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.835+0000 7feb4bae0700 1 Processor -- start 2023-10-06T04:39:41.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.835+0000 7feb4bae0700 1 -- start start 2023-10-06T04:39:41.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.836+0000 7feb4bae0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feb44159940 0x7feb4406ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:41.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.836+0000 7feb4bae0700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feb440af6f0 0x7feb4406dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:41.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.836+0000 7feb4bae0700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb4406b240 con 0x7feb440afb60 2023-10-06T04:39:41.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.836+0000 7feb4bae0700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb4415d890 con 0x7feb44159940 2023-10-06T04:39:41.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.836+0000 7feb4bae0700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb4415db70 con 0x7feb440af6f0 2023-10-06T04:39:41.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.836+0000 7feb4987c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feb44159940 0x7feb4406ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:41.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.836+0000 7feb4987c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feb44159940 0x7feb4406ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34164/0 (socket says 172.21.15.112:34164) 2023-10-06T04:39:41.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.836+0000 7feb4987c700 1 -- 172.21.15.112:0/3649165068 learned_addr learned my addr 172.21.15.112:0/3649165068 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:41.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.837+0000 7feb4907b700 1 --2- 172.21.15.112:0/3649165068 >> v2:172.21.15.179:3300/0 conn(0x7feb440af6f0 0x7feb4406dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:41.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.837+0000 7feb4987c700 1 -- 172.21.15.112:0/3649165068 >> v2:172.21.15.179:3300/0 conn(0x7feb440af6f0 msgr2=0x7feb4406dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:41.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.837+0000 7feb4987c700 1 --2- 172.21.15.112:0/3649165068 >> v2:172.21.15.179:3300/0 conn(0x7feb440af6f0 0x7feb4406dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.837+0000 7feb4987c700 1 -- 172.21.15.112:0/3649165068 >> v1:172.21.15.179:6789/0 conn(0x7feb440afb60 legacy=0x7feb4415a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:41.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.837+0000 7feb4987c700 1 -- 172.21.15.112:0/3649165068 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4415de50 con 0x7feb44159940 2023-10-06T04:39:41.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.837+0000 7feb4987c700 1 --2- 172.21.15.112:0/3649165068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb44159940 0x7feb4406ad00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feb4404bcf0 tx=0x7feb40009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b002acec3f55eb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:41.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.837+0000 7feb4887a700 1 -- 172.21.15.112:0/3649165068 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4000e070 con 0x7feb44159940 2023-10-06T04:39:41.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.837+0000 7feb4887a700 1 -- 172.21.15.112:0/3649165068 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4000ba50 con 0x7feb44159940 2023-10-06T04:39:41.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.837+0000 7feb4887a700 1 -- 172.21.15.112:0/3649165068 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb400092e0 con 0x7feb44159940 2023-10-06T04:39:41.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.837+0000 7feb4bae0700 1 -- 172.21.15.112:0/3649165068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb44159940 msgr2=0x7feb4406ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:41.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.837+0000 7feb4bae0700 1 --2- 172.21.15.112:0/3649165068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb44159940 0x7feb4406ad00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feb4404bcf0 tx=0x7feb40009840 comp rx=0 tx=0).stop 2023-10-06T04:39:41.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.837+0000 7feb4bae0700 1 -- 172.21.15.112:0/3649165068 shutdown_connections 2023-10-06T04:39:41.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.837+0000 7feb4bae0700 1 --2- 172.21.15.112:0/3649165068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb44159940 0x7feb4406ad00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.837+0000 7feb4bae0700 1 --2- 172.21.15.112:0/3649165068 >> v2:172.21.15.179:3300/0 conn(0x7feb440af6f0 0x7feb4406dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.837+0000 7feb4bae0700 1 -- 172.21.15.112:0/3649165068 >> 172.21.15.112:0/3649165068 conn(0x7feb4406d8e0 msgr2=0x7feb440b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:41.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.838+0000 7feb4bae0700 1 -- 172.21.15.112:0/3649165068 shutdown_connections 2023-10-06T04:39:41.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.838+0000 7feb4bae0700 1 -- 172.21.15.112:0/3649165068 wait complete. 2023-10-06T04:39:41.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.839+0000 7feb4bae0700 1 Processor -- start 2023-10-06T04:39:41.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.839+0000 7feb4bae0700 1 -- start start 2023-10-06T04:39:41.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.839+0000 7feb4bae0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb440af6f0 0x7feb44156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:41.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.839+0000 7feb4bae0700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb440afb60 0x7feb440c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:41.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.839+0000 7feb4bae0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb44159940 0x7feb44169f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:41.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.839+0000 7feb4bae0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb441569c0 con 0x7feb44159940 2023-10-06T04:39:41.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.839+0000 7feb4bae0700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb440c50f0 con 0x7feb440af6f0 2023-10-06T04:39:41.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.839+0000 7feb4bae0700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4416adc0 con 0x7feb440afb60 2023-10-06T04:39:41.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.840+0000 7feb4a07d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb44159940 0x7feb44169f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:41.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.840+0000 7feb4a07d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb44159940 0x7feb44169f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34180/0 (socket says 172.21.15.112:34180) 2023-10-06T04:39:41.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.840+0000 7feb4a07d700 1 -- 172.21.15.112:0/3309377378 learned_addr learned my addr 172.21.15.112:0/3309377378 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:41.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.840+0000 7feb4907b700 1 --2- 172.21.15.112:0/3309377378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb440afb60 0x7feb440c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:41.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.840+0000 7feb4987c700 1 --2- 172.21.15.112:0/3309377378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb440af6f0 0x7feb44156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:41.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.840+0000 7feb4a07d700 1 -- 172.21.15.112:0/3309377378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb440afb60 msgr2=0x7feb440c31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:41.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.840+0000 7feb4a07d700 1 --2- 172.21.15.112:0/3309377378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb440afb60 0x7feb440c31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.840+0000 7feb4a07d700 1 -- 172.21.15.112:0/3309377378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb440af6f0 msgr2=0x7feb44156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:41.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.840+0000 7feb4a07d700 1 --2- 172.21.15.112:0/3309377378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb440af6f0 0x7feb44156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:41.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.840+0000 7feb4a07d700 1 -- 172.21.15.112:0/3309377378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb40009ae0 con 0x7feb44159940 2023-10-06T04:39:41.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.840+0000 7feb4a07d700 1 --2- 172.21.15.112:0/3309377378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb44159940 0x7feb44169f20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feb3c00c590 tx=0x7feb3c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:41.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.840+0000 7feb39ffb700 1 -- 172.21.15.112:0/3309377378 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c011590 con 0x7feb44159940 2023-10-06T04:39:41.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.840+0000 7feb39ffb700 1 -- 172.21.15.112:0/3309377378 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3c0116f0 con 0x7feb44159940 2023-10-06T04:39:41.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.840+0000 7feb4bae0700 1 -- 172.21.15.112:0/3309377378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb440c44e0 con 0x7feb44159940 2023-10-06T04:39:41.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.840+0000 7feb39ffb700 1 -- 172.21.15.112:0/3309377378 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c011ab0 con 0x7feb44159940 2023-10-06T04:39:41.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.840+0000 7feb4bae0700 1 -- 172.21.15.112:0/3309377378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb440c4aa0 con 0x7feb44159940 2023-10-06T04:39:41.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.841+0000 7feb4bae0700 1 -- 172.21.15.112:0/3309377378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb440c52a0 con 0x7feb44159940 2023-10-06T04:39:41.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.842+0000 7feb39ffb700 1 -- 172.21.15.112:0/3309377378 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb3c01b3b0 con 0x7feb44159940 2023-10-06T04:39:41.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.842+0000 7feb39ffb700 1 --2- 172.21.15.112:0/3309377378 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7feb28066f30 0x7feb280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:41.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.842+0000 7feb39ffb700 1 -- 172.21.15.112:0/3309377378 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7feb3c083a00 con 0x7feb44159940 2023-10-06T04:39:41.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.842+0000 7feb4987c700 1 --2- 172.21.15.112:0/3309377378 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7feb28066f30 0x7feb280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:41.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.843+0000 7feb4987c700 1 --2- 172.21.15.112:0/3309377378 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7feb28066f30 0x7feb280693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feb40009880 tx=0x7feb40018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:41.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:41.846+0000 7feb39ffb700 1 -- 172.21.15.112:0/3309377378 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb440c52a0 con 0x7feb44159940 2023-10-06T04:39:42.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:42.070+0000 7feb4bae0700 1 -- 172.21.15.112:0/3309377378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feb440c5480 con 0x7feb44159940 2023-10-06T04:39:42.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:42.070+0000 7feb39ffb700 1 -- 172.21.15.112:0/3309377378 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7feb440c5480 con 0x7feb44159940 2023-10-06T04:39:42.073 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:39:42.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:42.072+0000 7feb4bae0700 1 -- 172.21.15.112:0/3309377378 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7feb28066f30 msgr2=0x7feb280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:42.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:42.072+0000 7feb4bae0700 1 --2- 172.21.15.112:0/3309377378 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7feb28066f30 0x7feb280693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feb40009880 tx=0x7feb40018000 comp rx=0 tx=0).stop 2023-10-06T04:39:42.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:42.072+0000 7feb4bae0700 1 -- 172.21.15.112:0/3309377378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb44159940 msgr2=0x7feb44169f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:42.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:42.072+0000 7feb4bae0700 1 --2- 172.21.15.112:0/3309377378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb44159940 0x7feb44169f20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feb3c00c590 tx=0x7feb3c007ef0 comp rx=0 tx=0).stop 2023-10-06T04:39:42.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:42.072+0000 7feb4bae0700 1 -- 172.21.15.112:0/3309377378 shutdown_connections 2023-10-06T04:39:42.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:42.072+0000 7feb4bae0700 1 --2- 172.21.15.112:0/3309377378 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7feb28066f30 0x7feb280693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:42.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:42.072+0000 7feb4bae0700 1 --2- 172.21.15.112:0/3309377378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb44159940 0x7feb44169f20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:42.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:42.072+0000 7feb4bae0700 1 --2- 172.21.15.112:0/3309377378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb440af6f0 0x7feb44156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:42.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:42.072+0000 7feb4bae0700 1 --2- 172.21.15.112:0/3309377378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb440afb60 0x7feb440c31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:42.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:42.072+0000 7feb4bae0700 1 -- 172.21.15.112:0/3309377378 >> 172.21.15.112:0/3309377378 conn(0x7feb4406d8e0 msgr2=0x7feb44156d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:42.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:42.073+0000 7feb4bae0700 1 -- 172.21.15.112:0/3309377378 shutdown_connections 2023-10-06T04:39:42.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:42.073+0000 7feb4bae0700 1 -- 172.21.15.112:0/3309377378 wait complete. 2023-10-06T04:39:42.087 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:39:42.087 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:39:42.087 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-10-06T04:39:42.087 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T04:39:42.088 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T04:39:42.088 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:39:42.088 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:39:42.088 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:39:42.088 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T04:39:42.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:42.088 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-10-06T04:39:42.104 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:39:42.104 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:39:42.104 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:39:42.104 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:42.104 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-10-06T04:39:42.104 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:42.104 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:39:42.105 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:42.105 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-10-06T04:39:42.105 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:39:42.105 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:42.105 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-10-06T04:39:42.105 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:39:42.105 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:42.105 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:39:42.105 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:42.105 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T04:39:42.105 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42493sec preferred_lft 42493sec 2023-10-06T04:39:42.106 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link noprefixroute 2023-10-06T04:39:42.106 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:42.106 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:39:42.106 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether d2:1e:51:ad:08:00 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:39:42.106 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:39:42.106 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:42.106 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::9cdd:62ff:fe2b:d5d6/64 scope link tentative 2023-10-06T04:39:42.106 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:42.106 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:39:42.106 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether d2:1e:51:ad:08:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:39:42.106 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::d01e:51ff:fead:800/64 scope link tentative 2023-10-06T04:39:42.107 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:42.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:42.107 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:39:42.168 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-10-06T04:39:42.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:42.170 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-10-06T04:39:42.225 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-10-06T04:39:42.226 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:39:42.226 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:39:42.226 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T04:39:42.226 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:39:42.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:42.226 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-06T04:39:42.227 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-06T04:39:42.227 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:39:42.227 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:39:42.227 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:39:42.227 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-06T04:39:42.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:42.327 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-10-06T04:39:42.341 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T04:39:42.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:42.341 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list-id 2023-10-06T04:39:42.396 INFO:teuthology.orchestra.run.smithi179.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T04:39:42.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:42.396 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-06T04:39:42.396 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-06T04:39:42.397 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T04:39:42.397 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T04:39:42.397 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-06T04:39:42.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:42.485 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T04:39:42.516 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:39:42.516 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:39:42.516 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:39:42.516 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:42.517 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-10-06T04:39:42.517 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:42.517 INFO:teuthology.orchestra.run.smithi179.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:39:42.517 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether ce:50:ee:e8:0b:c1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:39:42.517 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:39:42.517 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:42.517 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::cc50:eeff:fee8:bc1/64 scope link tentative 2023-10-06T04:39:42.517 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:42.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:42.533 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T04:39:42.603 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:39:42.603 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:39:42.603 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:39:42.603 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:42.603 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-10-06T04:39:42.604 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:42.604 INFO:teuthology.orchestra.run.smithi179.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:39:42.604 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether ce:50:ee:e8:0b:c1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:39:42.604 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:39:42.604 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:42.604 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::cc50:eeff:fee8:bc1/64 scope link tentative 2023-10-06T04:39:42.604 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:39:42.615 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T04:39:42.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:42.616 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-06T04:39:42.616 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-06T04:39:42.616 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T04:39:42.616 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T04:39:42.616 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T04:39:42.616 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T04:39:42.616 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T04:39:42.616 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-06T04:39:42.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:42.845 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-06T04:39:42.845 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-06T04:39:42.845 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.1 up 2023-10-06T04:39:42.845 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T04:39:42.845 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-06T04:39:42.924 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:39:42.925 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T04:39:42.939 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T04:39:42.939 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:39:42.939 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T04:39:42.993 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T04:39:42.994 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:39:42.994 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T04:39:43.073 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T04:39:43.073 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T04:39:43.073 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2023-10-06T04:39:43.081 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T04:39:43.081 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T04:39:43.081 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2023-10-06T04:39:43.081 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-06T04:39:43.081 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:39:43.103 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T04:39:43.104 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T04:39:43.104 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2023-10-06T04:39:43.104 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-06T04:39:43.104 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:39:43.104 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.112:6789,172.21.15.179:6789,172.21.15.179:6790" 2023-10-06T04:39:43.104 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.112:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2023-10-06T04:39:43.104 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=3e2b8a43-6e3c-475a-8b31-8dbcc20d6445" will pass to kernel 2023-10-06T04:39:43.106 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:39:43.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:43.106 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T04:39:43.171 INFO:teuthology.run_tasks:Running task check-counter... 2023-10-06T04:39:43.182 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T04:39:43.198 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:43.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.324+0000 7ff155b80700 1 Processor -- start 2023-10-06T04:39:43.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.324+0000 7ff155b80700 1 -- start start 2023-10-06T04:39:43.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.325+0000 7ff155b80700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1500d0250 0x7ff1500b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.325+0000 7ff155b80700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1500afed0 con 0x7ff15006d3b0 2023-10-06T04:39:43.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.325+0000 7ff155b80700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1500b6170 con 0x7ff1500b11a0 2023-10-06T04:39:43.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.325+0000 7ff155b80700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1500b6450 con 0x7ff1500d0250 2023-10-06T04:39:43.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.325+0000 7ff147fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff15006d3b0 0x7ff1500b3810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46582/0 (socket says 172.21.15.112:46582) 2023-10-06T04:39:43.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.325+0000 7ff147fff700 1 -- 172.21.15.112:0/3765424338 learned_addr learned my addr 172.21.15.112:0/3765424338 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:43.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.325+0000 7ff15537f700 1 --2- 172.21.15.112:0/3765424338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1500d0250 0x7ff1500b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.326+0000 7ff1477fe700 1 -- 172.21.15.112:0/3765424338 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263443828 0 0) 0x7ff1500afed0 con 0x7ff15006d3b0 2023-10-06T04:39:43.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.326+0000 7ff1477fe700 1 -- 172.21.15.112:0/3765424338 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff138003570 con 0x7ff15006d3b0 2023-10-06T04:39:43.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.326+0000 7ff1477fe700 1 -- 172.21.15.112:0/3765424338 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488137995 0 0) 0x7ff1500b6170 con 0x7ff1500b11a0 2023-10-06T04:39:43.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.326+0000 7ff1477fe700 1 -- 172.21.15.112:0/3765424338 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1500afed0 con 0x7ff1500b11a0 2023-10-06T04:39:43.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.326+0000 7ff1477fe700 1 -- 172.21.15.112:0/3765424338 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 256676808 0 0) 0x7ff138003570 con 0x7ff15006d3b0 2023-10-06T04:39:43.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.326+0000 7ff15537f700 1 -- 172.21.15.112:0/3765424338 >> v1:172.21.15.179:6789/0 conn(0x7ff1500b11a0 legacy=0x7ff1500b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:43.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.326+0000 7ff15537f700 1 -- 172.21.15.112:0/3765424338 >> v1:172.21.15.112:6789/0 conn(0x7ff15006d3b0 legacy=0x7ff1500b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:43.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.326+0000 7ff15537f700 1 -- 172.21.15.112:0/3765424338 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1500b6730 con 0x7ff1500d0250 2023-10-06T04:39:43.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.326+0000 7ff15537f700 1 --2- 172.21.15.112:0/3765424338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1500d0250 0x7ff1500b3f20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff148009e90 tx=0x7ff148009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99664261ab89bf39 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:43.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.326+0000 7ff1477fe700 1 -- 172.21.15.112:0/3765424338 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14800e070 con 0x7ff1500d0250 2023-10-06T04:39:43.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.326+0000 7ff1477fe700 1 -- 172.21.15.112:0/3765424338 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14800b870 con 0x7ff1500d0250 2023-10-06T04:39:43.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.326+0000 7ff1477fe700 1 -- 172.21.15.112:0/3765424338 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff140001470 con 0x7ff1500d0250 2023-10-06T04:39:43.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.327+0000 7ff155b80700 1 -- 172.21.15.112:0/3765424338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1500d0250 msgr2=0x7ff1500b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:43.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.327+0000 7ff155b80700 1 --2- 172.21.15.112:0/3765424338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1500d0250 0x7ff1500b3f20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff148009e90 tx=0x7ff148009780 comp rx=0 tx=0).stop 2023-10-06T04:39:43.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.327+0000 7ff155b80700 1 -- 172.21.15.112:0/3765424338 shutdown_connections 2023-10-06T04:39:43.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.327+0000 7ff155b80700 1 --2- 172.21.15.112:0/3765424338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1500d0250 0x7ff1500b3f20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.327+0000 7ff155b80700 1 -- 172.21.15.112:0/3765424338 >> 172.21.15.112:0/3765424338 conn(0x7ff15006cfb0 msgr2=0x7ff1500d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:43.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.327+0000 7ff155b80700 1 -- 172.21.15.112:0/3765424338 shutdown_connections 2023-10-06T04:39:43.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.327+0000 7ff155b80700 1 -- 172.21.15.112:0/3765424338 wait complete. 2023-10-06T04:39:43.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.328+0000 7ff155b80700 1 Processor -- start 2023-10-06T04:39:43.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.328+0000 7ff155b80700 1 -- start start 2023-10-06T04:39:43.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.329+0000 7ff155b80700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff15006d3b0 0x7ff15014fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.329+0000 7ff155b80700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1500b11a0 0x7ff1500b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.329+0000 7ff155b80700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1500d0250 0x7ff1500b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.329+0000 7ff155b80700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1500c6440 con 0x7ff1500b11a0 2023-10-06T04:39:43.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.329+0000 7ff155b80700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1500c5830 con 0x7ff15006d3b0 2023-10-06T04:39:43.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.329+0000 7ff155b80700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1500c5b10 con 0x7ff1500d0250 2023-10-06T04:39:43.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.329+0000 7ff147fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1500b11a0 0x7ff1500b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.329+0000 7ff147fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1500b11a0 0x7ff1500b4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34194/0 (socket says 172.21.15.112:34194) 2023-10-06T04:39:43.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.329+0000 7ff147fff700 1 -- 172.21.15.112:0/2202941441 learned_addr learned my addr 172.21.15.112:0/2202941441 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:43.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.329+0000 7ff154b7e700 1 --2- 172.21.15.112:0/2202941441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff15006d3b0 0x7ff15014fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.329+0000 7ff15537f700 1 --2- 172.21.15.112:0/2202941441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1500d0250 0x7ff1500b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.329+0000 7ff147fff700 1 -- 172.21.15.112:0/2202941441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1500d0250 msgr2=0x7ff1500b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:43.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.329+0000 7ff147fff700 1 --2- 172.21.15.112:0/2202941441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1500d0250 0x7ff1500b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.329+0000 7ff147fff700 1 -- 172.21.15.112:0/2202941441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff15006d3b0 msgr2=0x7ff15014fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:43.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.329+0000 7ff147fff700 1 --2- 172.21.15.112:0/2202941441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff15006d3b0 0x7ff15014fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.329+0000 7ff147fff700 1 -- 172.21.15.112:0/2202941441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff148009a20 con 0x7ff1500b11a0 2023-10-06T04:39:43.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.329+0000 7ff147fff700 1 --2- 172.21.15.112:0/2202941441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1500b11a0 0x7ff1500b4ac0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff14000c7f0 tx=0x7ff140001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:43.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.329+0000 7ff144ff9700 1 -- 172.21.15.112:0/2202941441 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff140007360 con 0x7ff1500b11a0 2023-10-06T04:39:43.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.329+0000 7ff144ff9700 1 -- 172.21.15.112:0/2202941441 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff140007500 con 0x7ff1500b11a0 2023-10-06T04:39:43.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.329+0000 7ff155b80700 1 -- 172.21.15.112:0/2202941441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1500c5df0 con 0x7ff1500b11a0 2023-10-06T04:39:43.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.329+0000 7ff144ff9700 1 -- 172.21.15.112:0/2202941441 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff140004a80 con 0x7ff1500b11a0 2023-10-06T04:39:43.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.330+0000 7ff155b80700 1 -- 172.21.15.112:0/2202941441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff150150320 con 0x7ff1500b11a0 2023-10-06T04:39:43.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.330+0000 7ff155b80700 1 -- 172.21.15.112:0/2202941441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1500c65b0 con 0x7ff1500b11a0 2023-10-06T04:39:43.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.331+0000 7ff144ff9700 1 -- 172.21.15.112:0/2202941441 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff14001c3b0 con 0x7ff1500b11a0 2023-10-06T04:39:43.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.331+0000 7ff144ff9700 1 --2- 172.21.15.112:0/2202941441 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff13c066f30 0x7ff13c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.331+0000 7ff144ff9700 1 -- 172.21.15.112:0/2202941441 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff140083c60 con 0x7ff1500b11a0 2023-10-06T04:39:43.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.331+0000 7ff154b7e700 1 --2- 172.21.15.112:0/2202941441 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff13c066f30 0x7ff13c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.332+0000 7ff154b7e700 1 --2- 172.21.15.112:0/2202941441 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff13c066f30 0x7ff13c0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff14c007fd0 tx=0x7ff14c007d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:43.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.335+0000 7ff144ff9700 1 -- 172.21.15.112:0/2202941441 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff14004c5a0 con 0x7ff1500b11a0 2023-10-06T04:39:43.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.520+0000 7ff155b80700 1 -- 172.21.15.112:0/2202941441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff15005f230 con 0x7ff1500b11a0 2023-10-06T04:39:43.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.521+0000 7ff144ff9700 1 -- 172.21.15.112:0/2202941441 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7ff140018020 con 0x7ff1500b11a0 2023-10-06T04:39:43.523 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:43.524 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:39:22.637355+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:18.657040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:19.972295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:43.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.523+0000 7ff155b80700 1 -- 172.21.15.112:0/2202941441 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff13c066f30 msgr2=0x7ff13c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:43.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.523+0000 7ff155b80700 1 --2- 172.21.15.112:0/2202941441 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff13c066f30 0x7ff13c0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff14c007fd0 tx=0x7ff14c007d10 comp rx=0 tx=0).stop 2023-10-06T04:39:43.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.523+0000 7ff155b80700 1 -- 172.21.15.112:0/2202941441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1500b11a0 msgr2=0x7ff1500b4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:43.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.523+0000 7ff155b80700 1 --2- 172.21.15.112:0/2202941441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1500b11a0 0x7ff1500b4ac0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff14000c7f0 tx=0x7ff140001a10 comp rx=0 tx=0).stop 2023-10-06T04:39:43.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.523+0000 7ff155b80700 1 -- 172.21.15.112:0/2202941441 shutdown_connections 2023-10-06T04:39:43.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.523+0000 7ff155b80700 1 --2- 172.21.15.112:0/2202941441 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff13c066f30 0x7ff13c0693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.523+0000 7ff155b80700 1 --2- 172.21.15.112:0/2202941441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1500d0250 0x7ff1500b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.523+0000 7ff155b80700 1 --2- 172.21.15.112:0/2202941441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff15006d3b0 0x7ff15014fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.523+0000 7ff155b80700 1 --2- 172.21.15.112:0/2202941441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1500b11a0 0x7ff1500b4ac0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.523+0000 7ff155b80700 1 -- 172.21.15.112:0/2202941441 >> 172.21.15.112:0/2202941441 conn(0x7ff15006cfb0 msgr2=0x7ff1500cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:43.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.523+0000 7ff155b80700 1 -- 172.21.15.112:0/2202941441 shutdown_connections 2023-10-06T04:39:43.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.523+0000 7ff155b80700 1 -- 172.21.15.112:0/2202941441 wait complete. 2023-10-06T04:39:43.537 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:13.929254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:39:14.321892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:39:18.657040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:39:19.972295+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:39:43.538 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:39:43.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.652+0000 7fa9edcda700 1 Processor -- start 2023-10-06T04:39:43.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.652+0000 7fa9edcda700 1 -- start start 2023-10-06T04:39:43.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.653+0000 7fa9edcda700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa9e8157220 0x7fa9e80d0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.653+0000 7fa9edcda700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9e80d0a70 0x7fa9e80c7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.653+0000 7fa9edcda700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e80cab40 con 0x7fa9e80c7bd0 2023-10-06T04:39:43.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.653+0000 7fa9edcda700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e80cceb0 con 0x7fa9e8157220 2023-10-06T04:39:43.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.653+0000 7fa9edcda700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80cd100 con 0x7fa9e80d0a70 2023-10-06T04:39:43.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.653+0000 7fa9eccd8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa9e8157220 0x7fa9e80d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.653+0000 7fa9eccd8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa9e8157220 0x7fa9e80d0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34206/0 (socket says 172.21.15.112:34206) 2023-10-06T04:39:43.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.653+0000 7fa9eccd8700 1 -- 172.21.15.112:0/1491639520 learned_addr learned my addr 172.21.15.112:0/1491639520 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:43.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.653+0000 7fa9e7fff700 1 --2- 172.21.15.112:0/1491639520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9e80d0a70 0x7fa9e80c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.653+0000 7fa9eccd8700 1 -- 172.21.15.112:0/1491639520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9e80d0a70 msgr2=0x7fa9e80c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:43.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.653+0000 7fa9eccd8700 1 --2- 172.21.15.112:0/1491639520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9e80d0a70 0x7fa9e80c7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.653+0000 7fa9eccd8700 1 -- 172.21.15.112:0/1491639520 >> v1:172.21.15.179:6789/0 conn(0x7fa9e80c7bd0 legacy=0x7fa9e815d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:43.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.653+0000 7fa9eccd8700 1 -- 172.21.15.112:0/1491639520 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e80d0ee0 con 0x7fa9e8157220 2023-10-06T04:39:43.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.653+0000 7fa9eccd8700 1 --2- 172.21.15.112:0/1491639520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9e8157220 0x7fa9e80d0530 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00099b0 tx=0x7fa9e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1831687446e4ae2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:43.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.653+0000 7fa9e77fe700 1 -- 172.21.15.112:0/1491639520 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e000b820 con 0x7fa9e8157220 2023-10-06T04:39:43.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.653+0000 7fa9e77fe700 1 -- 172.21.15.112:0/1491639520 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e000b980 con 0x7fa9e8157220 2023-10-06T04:39:43.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.653+0000 7fa9e77fe700 1 -- 172.21.15.112:0/1491639520 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e000bd20 con 0x7fa9e8157220 2023-10-06T04:39:43.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.654+0000 7fa9edcda700 1 -- 172.21.15.112:0/1491639520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9e8157220 msgr2=0x7fa9e80d0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:43.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.654+0000 7fa9edcda700 1 --2- 172.21.15.112:0/1491639520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9e8157220 0x7fa9e80d0530 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00099b0 tx=0x7fa9e0009250 comp rx=0 tx=0).stop 2023-10-06T04:39:43.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.654+0000 7fa9edcda700 1 -- 172.21.15.112:0/1491639520 shutdown_connections 2023-10-06T04:39:43.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.654+0000 7fa9edcda700 1 --2- 172.21.15.112:0/1491639520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9e8157220 0x7fa9e80d0530 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.654+0000 7fa9edcda700 1 --2- 172.21.15.112:0/1491639520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9e80d0a70 0x7fa9e80c7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.654+0000 7fa9edcda700 1 -- 172.21.15.112:0/1491639520 >> 172.21.15.112:0/1491639520 conn(0x7fa9e806c7d0 msgr2=0x7fa9e806cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:43.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.654+0000 7fa9edcda700 1 -- 172.21.15.112:0/1491639520 shutdown_connections 2023-10-06T04:39:43.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.654+0000 7fa9edcda700 1 -- 172.21.15.112:0/1491639520 wait complete. 2023-10-06T04:39:43.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.655+0000 7fa9edcda700 1 Processor -- start 2023-10-06T04:39:43.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.655+0000 7fa9edcda700 1 -- start start 2023-10-06T04:39:43.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.656+0000 7fa9edcda700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9e80c7bd0 0x7fa9e815c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.656+0000 7fa9edcda700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9e80d0a70 0x7fa9e8153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.656+0000 7fa9edcda700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9e8157220 0x7fa9e80c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.656+0000 7fa9edcda700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80c65a0 con 0x7fa9e8157220 2023-10-06T04:39:43.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.656+0000 7fa9edcda700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80c6880 con 0x7fa9e80d0a70 2023-10-06T04:39:43.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.656+0000 7fa9edcda700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80c6b60 con 0x7fa9e80c7bd0 2023-10-06T04:39:43.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.656+0000 7fa9ed4d9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9e8157220 0x7fa9e80c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.656+0000 7fa9eccd8700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9e80c7bd0 0x7fa9e815c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.656+0000 7fa9ed4d9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9e8157220 0x7fa9e80c5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34218/0 (socket says 172.21.15.112:34218) 2023-10-06T04:39:43.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.656+0000 7fa9ed4d9700 1 -- 172.21.15.112:0/1234401052 learned_addr learned my addr 172.21.15.112:0/1234401052 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:43.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.656+0000 7fa9e7fff700 1 --2- 172.21.15.112:0/1234401052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9e80d0a70 0x7fa9e8153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.656+0000 7fa9ed4d9700 1 -- 172.21.15.112:0/1234401052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9e80c7bd0 msgr2=0x7fa9e815c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:43.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.656+0000 7fa9ed4d9700 1 --2- 172.21.15.112:0/1234401052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9e80c7bd0 0x7fa9e815c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.656+0000 7fa9ed4d9700 1 -- 172.21.15.112:0/1234401052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9e80d0a70 msgr2=0x7fa9e8153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:43.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.656+0000 7fa9ed4d9700 1 --2- 172.21.15.112:0/1234401052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9e80d0a70 0x7fa9e8153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.656+0000 7fa9ed4d9700 1 -- 172.21.15.112:0/1234401052 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e00094f0 con 0x7fa9e8157220 2023-10-06T04:39:43.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.656+0000 7fa9eccd8700 1 --2- 172.21.15.112:0/1234401052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9e80c7bd0 0x7fa9e815c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:43.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.657+0000 7fa9ed4d9700 1 --2- 172.21.15.112:0/1234401052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9e8157220 0x7fa9e80c5680 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000b4e0 tx=0x7fa9d0006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:43.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.657+0000 7fa9e4ff9700 1 -- 172.21.15.112:0/1234401052 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d000be90 con 0x7fa9e8157220 2023-10-06T04:39:43.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.657+0000 7fa9e4ff9700 1 -- 172.21.15.112:0/1234401052 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d000f510 con 0x7fa9e8157220 2023-10-06T04:39:43.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.657+0000 7fa9edcda700 1 -- 172.21.15.112:0/1234401052 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e80c3ac0 con 0x7fa9e8157220 2023-10-06T04:39:43.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.657+0000 7fa9e4ff9700 1 -- 172.21.15.112:0/1234401052 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d000f8d0 con 0x7fa9e8157220 2023-10-06T04:39:43.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.657+0000 7fa9edcda700 1 -- 172.21.15.112:0/1234401052 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e81543a0 con 0x7fa9e8157220 2023-10-06T04:39:43.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.658+0000 7fa9edcda700 1 -- 172.21.15.112:0/1234401052 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e805f230 con 0x7fa9e8157220 2023-10-06T04:39:43.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.658+0000 7fa9e4ff9700 1 -- 172.21.15.112:0/1234401052 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9d000fd00 con 0x7fa9e8157220 2023-10-06T04:39:43.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.658+0000 7fa9e4ff9700 1 --2- 172.21.15.112:0/1234401052 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa9c8066f30 0x7fa9c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.658+0000 7fa9e4ff9700 1 -- 172.21.15.112:0/1234401052 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa9d0084050 con 0x7fa9e8157220 2023-10-06T04:39:43.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.659+0000 7fa9eccd8700 1 --2- 172.21.15.112:0/1234401052 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa9c8066f30 0x7fa9c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.659+0000 7fa9eccd8700 1 --2- 172.21.15.112:0/1234401052 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa9c8066f30 0x7fa9c80693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00099b0 tx=0x7fa9e0016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:43.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.663+0000 7fa9e4ff9700 1 -- 172.21.15.112:0/1234401052 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9d0051140 con 0x7fa9e8157220 2023-10-06T04:39:43.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.847+0000 7fa9edcda700 1 -- 172.21.15.112:0/1234401052 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa9e80c66e0 con 0x7fa9e8157220 2023-10-06T04:39:43.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.847+0000 7fa9e4ff9700 1 -- 172.21.15.112:0/1234401052 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa9e80c66e0 con 0x7fa9e8157220 2023-10-06T04:39:43.850 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-10-06T04:39:43.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.849+0000 7fa9edcda700 1 -- 172.21.15.112:0/1234401052 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa9c8066f30 msgr2=0x7fa9c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:43.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.849+0000 7fa9edcda700 1 --2- 172.21.15.112:0/1234401052 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa9c8066f30 0x7fa9c80693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00099b0 tx=0x7fa9e0016000 comp rx=0 tx=0).stop 2023-10-06T04:39:43.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.849+0000 7fa9edcda700 1 -- 172.21.15.112:0/1234401052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9e8157220 msgr2=0x7fa9e80c5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:43.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.849+0000 7fa9edcda700 1 --2- 172.21.15.112:0/1234401052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9e8157220 0x7fa9e80c5680 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000b4e0 tx=0x7fa9d0006f90 comp rx=0 tx=0).stop 2023-10-06T04:39:43.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.849+0000 7fa9edcda700 1 -- 172.21.15.112:0/1234401052 shutdown_connections 2023-10-06T04:39:43.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.849+0000 7fa9edcda700 1 --2- 172.21.15.112:0/1234401052 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa9c8066f30 0x7fa9c80693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.849+0000 7fa9edcda700 1 --2- 172.21.15.112:0/1234401052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9e8157220 0x7fa9e80c5680 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.849+0000 7fa9edcda700 1 --2- 172.21.15.112:0/1234401052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9e80c7bd0 0x7fa9e815c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.849+0000 7fa9edcda700 1 --2- 172.21.15.112:0/1234401052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9e80d0a70 0x7fa9e8153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.849+0000 7fa9edcda700 1 -- 172.21.15.112:0/1234401052 >> 172.21.15.112:0/1234401052 conn(0x7fa9e806c7d0 msgr2=0x7fa9e80ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:43.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.849+0000 7fa9edcda700 1 -- 172.21.15.112:0/1234401052 shutdown_connections 2023-10-06T04:39:43.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.850+0000 7fa9edcda700 1 -- 172.21.15.112:0/1234401052 wait complete. 2023-10-06T04:39:43.864 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:39:43.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.978+0000 7f7ae086b700 1 Processor -- start 2023-10-06T04:39:43.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.978+0000 7f7ae086b700 1 -- start start 2023-10-06T04:39:43.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.979+0000 7f7ae086b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7adc159aa0 0x7f7adc0cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.979+0000 7f7ae086b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7adc06f410 0x7f7adc0cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.979+0000 7f7ae086b700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7adc15e5b0 con 0x7f7adc0cb190 2023-10-06T04:39:43.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.979+0000 7f7ae086b700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7adc15d6c0 con 0x7f7adc06f410 2023-10-06T04:39:43.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.979+0000 7f7ae086b700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc15d9a0 con 0x7f7adc159aa0 2023-10-06T04:39:43.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.979+0000 7f7adad9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7adc159aa0 0x7f7adc0cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.979+0000 7f7adb59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7adc06f410 0x7f7adc0cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.979+0000 7f7adb59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7adc06f410 0x7f7adc0cb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.112:33872/0 (socket says 172.21.15.112:33872) 2023-10-06T04:39:43.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.979+0000 7f7adb59e700 1 -- 172.21.15.112:0/640279759 learned_addr learned my addr 172.21.15.112:0/640279759 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:43.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.980+0000 7f7adb59e700 1 -- 172.21.15.112:0/640279759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7adc159aa0 msgr2=0x7f7adc0cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:43.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.980+0000 7f7adb59e700 1 --2- 172.21.15.112:0/640279759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7adc159aa0 0x7f7adc0cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.980+0000 7f7adb59e700 1 -- 172.21.15.112:0/640279759 >> v1:172.21.15.179:6789/0 conn(0x7f7adc0cb190 legacy=0x7f7adc06ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:43.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.980+0000 7f7adb59e700 1 -- 172.21.15.112:0/640279759 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc15dc80 con 0x7f7adc06f410 2023-10-06T04:39:43.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.980+0000 7f7ada59c700 1 -- 172.21.15.112:0/640279759 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2499751105 0 0) 0x7f7adc15e5b0 con 0x7f7adc0cb190 2023-10-06T04:39:43.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.980+0000 7f7adad9d700 1 --2- 172.21.15.112:0/640279759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7adc159aa0 0x7f7adc0cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:43.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.980+0000 7f7adb59e700 1 --2- 172.21.15.112:0/640279759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7adc06f410 0x7f7adc0cb600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4009f20 tx=0x7f7ad4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=504f88d56a042731 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:43.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.980+0000 7f7ada59c700 1 -- 172.21.15.112:0/640279759 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad400e070 con 0x7f7adc06f410 2023-10-06T04:39:43.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.980+0000 7f7ada59c700 1 -- 172.21.15.112:0/640279759 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad400b9d0 con 0x7f7adc06f410 2023-10-06T04:39:43.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.980+0000 7f7ada59c700 1 -- 172.21.15.112:0/640279759 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad40092e0 con 0x7f7adc06f410 2023-10-06T04:39:43.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.981+0000 7f7ae086b700 1 -- 172.21.15.112:0/640279759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7adc06f410 msgr2=0x7f7adc0cb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:43.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.981+0000 7f7ae086b700 1 --2- 172.21.15.112:0/640279759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7adc06f410 0x7f7adc0cb600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4009f20 tx=0x7f7ad4009840 comp rx=0 tx=0).stop 2023-10-06T04:39:43.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.981+0000 7f7ae086b700 1 -- 172.21.15.112:0/640279759 shutdown_connections 2023-10-06T04:39:43.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.981+0000 7f7ae086b700 1 --2- 172.21.15.112:0/640279759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7adc06f410 0x7f7adc0cb600 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.981+0000 7f7ae086b700 1 --2- 172.21.15.112:0/640279759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7adc159aa0 0x7f7adc0cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.981+0000 7f7ae086b700 1 -- 172.21.15.112:0/640279759 >> 172.21.15.112:0/640279759 conn(0x7f7adc0631f0 msgr2=0x7f7adc0635f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:43.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.981+0000 7f7ae086b700 1 -- 172.21.15.112:0/640279759 shutdown_connections 2023-10-06T04:39:43.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.981+0000 7f7ae086b700 1 -- 172.21.15.112:0/640279759 wait complete. 2023-10-06T04:39:43.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.982+0000 7f7ae086b700 1 Processor -- start 2023-10-06T04:39:43.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.982+0000 7f7ae086b700 1 -- start start 2023-10-06T04:39:43.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7ae086b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7adc06f410 0x7f7adc15cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7ae086b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7adc0cb190 0x7f7adc155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7ae086b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7adc159aa0 0x7f7adc0c3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7ae086b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc158f00 con 0x7f7adc159aa0 2023-10-06T04:39:43.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7ae086b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc15d060 con 0x7f7adc06f410 2023-10-06T04:39:43.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7ae086b700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc158660 con 0x7f7adc0cb190 2023-10-06T04:39:43.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7adb59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7adc159aa0 0x7f7adc0c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7adb59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7adc159aa0 0x7f7adc0c3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34226/0 (socket says 172.21.15.112:34226) 2023-10-06T04:39:43.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7adb59e700 1 -- 172.21.15.112:0/2277452136 learned_addr learned my addr 172.21.15.112:0/2277452136 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:43.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7ad259c700 1 --2- 172.21.15.112:0/2277452136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7adc0cb190 0x7f7adc155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7adad9d700 1 --2- 172.21.15.112:0/2277452136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7adc06f410 0x7f7adc15cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7adb59e700 1 -- 172.21.15.112:0/2277452136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7adc0cb190 msgr2=0x7f7adc155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:43.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7adb59e700 1 --2- 172.21.15.112:0/2277452136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7adc0cb190 0x7f7adc155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7adb59e700 1 -- 172.21.15.112:0/2277452136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7adc06f410 msgr2=0x7f7adc15cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:43.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7adb59e700 1 --2- 172.21.15.112:0/2277452136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7adc06f410 0x7f7adc15cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:43.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7adb59e700 1 -- 172.21.15.112:0/2277452136 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc0093c0 con 0x7f7adc159aa0 2023-10-06T04:39:43.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7adb59e700 1 --2- 172.21.15.112:0/2277452136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7adc159aa0 0x7f7adc0c3560 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7adc070ed0 tx=0x7f7ad4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:43.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7ad37fe700 1 -- 172.21.15.112:0/2277452136 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4008c30 con 0x7f7adc159aa0 2023-10-06T04:39:43.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7ad37fe700 1 -- 172.21.15.112:0/2277452136 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad4008dd0 con 0x7f7adc159aa0 2023-10-06T04:39:43.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7ad37fe700 1 -- 172.21.15.112:0/2277452136 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad401d670 con 0x7f7adc159aa0 2023-10-06T04:39:43.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7ae086b700 1 -- 172.21.15.112:0/2277452136 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad4009ae0 con 0x7f7adc159aa0 2023-10-06T04:39:43.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.983+0000 7f7ae086b700 1 -- 172.21.15.112:0/2277452136 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7adc158c20 con 0x7f7adc159aa0 2023-10-06T04:39:43.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.984+0000 7f7ae086b700 1 -- 172.21.15.112:0/2277452136 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7adc05f230 con 0x7f7adc159aa0 2023-10-06T04:39:43.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.985+0000 7f7ad37fe700 1 -- 172.21.15.112:0/2277452136 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ad4003040 con 0x7f7adc159aa0 2023-10-06T04:39:43.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.985+0000 7f7ad37fe700 1 --2- 172.21.15.112:0/2277452136 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7abc066f30 0x7f7abc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:43.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.985+0000 7f7ad37fe700 1 -- 172.21.15.112:0/2277452136 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7ad40863a0 con 0x7f7adc159aa0 2023-10-06T04:39:43.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.985+0000 7f7adad9d700 1 --2- 172.21.15.112:0/2277452136 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7abc066f30 0x7f7abc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:43.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.985+0000 7f7adad9d700 1 --2- 172.21.15.112:0/2277452136 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7abc066f30 0x7f7abc0693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009390 tx=0x7f7acc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:43.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:43.989+0000 7f7ad37fe700 1 -- 172.21.15.112:0/2277452136 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ad40534b0 con 0x7f7adc159aa0 2023-10-06T04:39:44.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.170+0000 7f7ae086b700 1 -- 172.21.15.112:0/2277452136 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7adc15df60 con 0x7f7adc159aa0 2023-10-06T04:39:44.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.171+0000 7f7ad37fe700 1 -- 172.21.15.112:0/2277452136 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ad4056ad0 con 0x7f7adc159aa0 2023-10-06T04:39:44.173 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-10-06T04:39:44.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.173+0000 7f7ae086b700 1 -- 172.21.15.112:0/2277452136 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7abc066f30 msgr2=0x7f7abc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:44.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.173+0000 7f7ae086b700 1 --2- 172.21.15.112:0/2277452136 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7abc066f30 0x7f7abc0693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009390 tx=0x7f7acc008040 comp rx=0 tx=0).stop 2023-10-06T04:39:44.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.173+0000 7f7ae086b700 1 -- 172.21.15.112:0/2277452136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7adc159aa0 msgr2=0x7f7adc0c3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:44.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.173+0000 7f7ae086b700 1 --2- 172.21.15.112:0/2277452136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7adc159aa0 0x7f7adc0c3560 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7adc070ed0 tx=0x7f7ad4018000 comp rx=0 tx=0).stop 2023-10-06T04:39:44.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.173+0000 7f7ae086b700 1 -- 172.21.15.112:0/2277452136 shutdown_connections 2023-10-06T04:39:44.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.173+0000 7f7ae086b700 1 --2- 172.21.15.112:0/2277452136 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7abc066f30 0x7f7abc0693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.173+0000 7f7ae086b700 1 --2- 172.21.15.112:0/2277452136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7adc159aa0 0x7f7adc0c3560 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.173+0000 7f7ae086b700 1 --2- 172.21.15.112:0/2277452136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7adc06f410 0x7f7adc15cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.173+0000 7f7ae086b700 1 --2- 172.21.15.112:0/2277452136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7adc0cb190 0x7f7adc155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.173+0000 7f7ae086b700 1 -- 172.21.15.112:0/2277452136 >> 172.21.15.112:0/2277452136 conn(0x7f7adc0631f0 msgr2=0x7f7adc067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:44.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.173+0000 7f7ae086b700 1 -- 172.21.15.112:0/2277452136 shutdown_connections 2023-10-06T04:39:44.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.173+0000 7f7ae086b700 1 -- 172.21.15.112:0/2277452136 wait complete. 2023-10-06T04:39:44.187 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:39:44.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.301+0000 7f4ddc538700 1 Processor -- start 2023-10-06T04:39:44.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.301+0000 7f4ddc538700 1 -- start start 2023-10-06T04:39:44.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.302+0000 7f4ddc538700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dd40aca30 0x7f4dd406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:44.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.302+0000 7f4ddc538700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd406dff0 con 0x7f4dd40b17f0 2023-10-06T04:39:44.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.302+0000 7f4ddc538700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd40ad5a0 con 0x7f4dd40ada30 2023-10-06T04:39:44.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.302+0000 7f4ddc538700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd40ad2a0 con 0x7f4dd40aca30 2023-10-06T04:39:44.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.303+0000 7f4dda2d4700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4dd40b17f0 0x7f4dd40b1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46598/0 (socket says 172.21.15.112:46598) 2023-10-06T04:39:44.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.303+0000 7f4dda2d4700 1 -- 172.21.15.112:0/908203705 learned_addr learned my addr 172.21.15.112:0/908203705 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:44.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.303+0000 7f4dd9ad3700 1 --2- 172.21.15.112:0/908203705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dd40aca30 0x7f4dd406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:44.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.303+0000 7f4dd92d2700 1 -- 172.21.15.112:0/908203705 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599022112 0 0) 0x7f4dd406dff0 con 0x7f4dd40b17f0 2023-10-06T04:39:44.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.303+0000 7f4dd92d2700 1 -- 172.21.15.112:0/908203705 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dbc003570 con 0x7f4dd40b17f0 2023-10-06T04:39:44.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.303+0000 7f4dd92d2700 1 -- 172.21.15.112:0/908203705 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3916930309 0 0) 0x7f4dbc003570 con 0x7f4dd40b17f0 2023-10-06T04:39:44.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.303+0000 7f4dd92d2700 1 -- 172.21.15.112:0/908203705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dd40aca30 msgr2=0x7f4dd406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:44.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.303+0000 7f4dd92d2700 1 --2- 172.21.15.112:0/908203705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dd40aca30 0x7f4dd406b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.303+0000 7f4dd92d2700 1 -- 172.21.15.112:0/908203705 >> v1:172.21.15.179:6789/0 conn(0x7f4dd40ada30 legacy=0x7f4dd40adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:44.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.303+0000 7f4dd92d2700 1 -- 172.21.15.112:0/908203705 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd40cad80 con 0x7f4dd40b17f0 2023-10-06T04:39:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.303+0000 7f4dd92d2700 1 -- 172.21.15.112:0/908203705 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f4dc40017f0 con 0x7f4dd40b17f0 2023-10-06T04:39:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.303+0000 7f4dd92d2700 1 -- 172.21.15.112:0/908203705 >> v1:172.21.15.112:6789/0 conn(0x7f4dd40b17f0 legacy=0x7f4dd40b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.303+0000 7f4dd92d2700 1 --2- 172.21.15.112:0/908203705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dbc003a90 0x7f4dbc003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.303+0000 7f4dd92d2700 1 --2- 172.21.15.112:0/908203705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dbc004810 0x7f4dbc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.303+0000 7f4dd92d2700 1 --2- 172.21.15.112:0/908203705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dd40aca30 0x7f4dbc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.303+0000 7f4dd92d2700 1 -- 172.21.15.112:0/908203705 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd40ad2a0 con 0x7f4dbc003a90 2023-10-06T04:39:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.303+0000 7f4dd92d2700 1 -- 172.21.15.112:0/908203705 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc00bb90 con 0x7f4dbc004810 2023-10-06T04:39:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.303+0000 7f4dd92d2700 1 -- 172.21.15.112:0/908203705 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc00bd50 con 0x7f4dd40aca30 2023-10-06T04:39:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.303+0000 7f4dda2d4700 1 --2- 172.21.15.112:0/908203705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dbc003a90 0x7f4dbc003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.303+0000 7f4dd9ad3700 1 --2- 172.21.15.112:0/908203705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dbc004810 0x7f4dbc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.303+0000 7f4ddaad5700 1 --2- 172.21.15.112:0/908203705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dd40aca30 0x7f4dbc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.304+0000 7f4dda2d4700 1 -- 172.21.15.112:0/908203705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dd40aca30 msgr2=0x7f4dbc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.304+0000 7f4dda2d4700 1 --2- 172.21.15.112:0/908203705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dd40aca30 0x7f4dbc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.304+0000 7f4dda2d4700 1 -- 172.21.15.112:0/908203705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dbc004810 msgr2=0x7f4dbc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.304+0000 7f4dda2d4700 1 --2- 172.21.15.112:0/908203705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dbc004810 0x7f4dbc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.304+0000 7f4dda2d4700 1 -- 172.21.15.112:0/908203705 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc003570 con 0x7f4dbc003a90 2023-10-06T04:39:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.304+0000 7f4dda2d4700 1 --2- 172.21.15.112:0/908203705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dbc003a90 0x7f4dbc003e60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400a950 tx=0x7f4dc40021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbdb72f4d9460bd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.304+0000 7f4dd92d2700 1 -- 172.21.15.112:0/908203705 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc40070d0 con 0x7f4dbc003a90 2023-10-06T04:39:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.304+0000 7f4dd92d2700 1 -- 172.21.15.112:0/908203705 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc4007250 con 0x7f4dbc003a90 2023-10-06T04:39:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.304+0000 7f4dd92d2700 1 -- 172.21.15.112:0/908203705 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4007610 con 0x7f4dbc003a90 2023-10-06T04:39:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.304+0000 7f4ddc538700 1 -- 172.21.15.112:0/908203705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dbc003a90 msgr2=0x7f4dbc003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.304+0000 7f4ddc538700 1 --2- 172.21.15.112:0/908203705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dbc003a90 0x7f4dbc003e60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400a950 tx=0x7f4dc40021f0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.304+0000 7f4ddaad5700 1 -- 172.21.15.112:0/908203705 reap_dead start 2023-10-06T04:39:44.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.304+0000 7f4ddc538700 1 -- 172.21.15.112:0/908203705 shutdown_connections 2023-10-06T04:39:44.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.304+0000 7f4ddc538700 1 -- 172.21.15.112:0/908203705 >> 172.21.15.112:0/908203705 conn(0x7f4dd4068610 msgr2=0x7f4dd406d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:44.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.304+0000 7f4ddc538700 1 -- 172.21.15.112:0/908203705 shutdown_connections 2023-10-06T04:39:44.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.304+0000 7f4ddc538700 1 -- 172.21.15.112:0/908203705 wait complete. 2023-10-06T04:39:44.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.305+0000 7f4ddc538700 1 Processor -- start 2023-10-06T04:39:44.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.305+0000 7f4ddc538700 1 -- start start 2023-10-06T04:39:44.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.306+0000 7f4ddc538700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dbc003a90 0x7f4dd40cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:44.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.306+0000 7f4ddc538700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dd406c7d0 0x7f4dd415ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:44.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.306+0000 7f4ddc538700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dd4167620 0x7f4dd4167a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:44.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.306+0000 7f4ddc538700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd416ae00 con 0x7f4dd4167620 2023-10-06T04:39:44.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.306+0000 7f4ddc538700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd406d5f0 con 0x7f4dd406c7d0 2023-10-06T04:39:44.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.306+0000 7f4ddc538700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd406cd50 con 0x7f4dbc003a90 2023-10-06T04:39:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.306+0000 7f4ddaad5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dd4167620 0x7f4dd4167a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.306+0000 7f4ddaad5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dd4167620 0x7f4dd4167a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34246/0 (socket says 172.21.15.112:34246) 2023-10-06T04:39:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.306+0000 7f4ddaad5700 1 -- 172.21.15.112:0/3916128351 learned_addr learned my addr 172.21.15.112:0/3916128351 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.307+0000 7f4dda2d4700 1 --2- 172.21.15.112:0/3916128351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dbc003a90 0x7f4dd40cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.307+0000 7f4ddaad5700 1 -- 172.21.15.112:0/3916128351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dbc003a90 msgr2=0x7f4dd40cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.307+0000 7f4ddaad5700 1 --2- 172.21.15.112:0/3916128351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dbc003a90 0x7f4dd40cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.307+0000 7f4dd9ad3700 1 --2- 172.21.15.112:0/3916128351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dd406c7d0 0x7f4dd415ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.307+0000 7f4ddaad5700 1 -- 172.21.15.112:0/3916128351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dd406c7d0 msgr2=0x7f4dd415ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.307+0000 7f4ddaad5700 1 --2- 172.21.15.112:0/3916128351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dd406c7d0 0x7f4dd415ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.307+0000 7f4ddaad5700 1 -- 172.21.15.112:0/3916128351 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd406d030 con 0x7f4dd4167620 2023-10-06T04:39:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.307+0000 7f4ddaad5700 1 --2- 172.21.15.112:0/3916128351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dd4167620 0x7f4dd4167a60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40afbf0 tx=0x7f4dcc007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:44.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.307+0000 7f4dd27fc700 1 -- 172.21.15.112:0/3916128351 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc002e20 con 0x7f4dd4167620 2023-10-06T04:39:44.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.307+0000 7f4dd27fc700 1 -- 172.21.15.112:0/3916128351 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc00f8a0 con 0x7f4dd4167620 2023-10-06T04:39:44.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.307+0000 7f4ddc538700 1 -- 172.21.15.112:0/3916128351 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd406d310 con 0x7f4dd4167620 2023-10-06T04:39:44.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.307+0000 7f4dd27fc700 1 -- 172.21.15.112:0/3916128351 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc00fc60 con 0x7f4dd4167620 2023-10-06T04:39:44.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.307+0000 7f4ddc538700 1 -- 172.21.15.112:0/3916128351 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd415b350 con 0x7f4dd4167620 2023-10-06T04:39:44.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.308+0000 7f4ddc538700 1 -- 172.21.15.112:0/3916128351 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd416af70 con 0x7f4dd4167620 2023-10-06T04:39:44.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.308+0000 7f4dd27fc700 1 -- 172.21.15.112:0/3916128351 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4dcc013600 con 0x7f4dd4167620 2023-10-06T04:39:44.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.309+0000 7f4dd27fc700 1 --2- 172.21.15.112:0/3916128351 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4dc0066f30 0x7f4dc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:44.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.309+0000 7f4dd27fc700 1 -- 172.21.15.112:0/3916128351 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4dcc084490 con 0x7f4dd4167620 2023-10-06T04:39:44.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.309+0000 7f4dda2d4700 1 --2- 172.21.15.112:0/3916128351 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4dc0066f30 0x7f4dc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:44.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.309+0000 7f4dda2d4700 1 --2- 172.21.15.112:0/3916128351 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4dc0066f30 0x7f4dc00693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4002250 tx=0x7f4dc4015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:44.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.313+0000 7f4dd27fc700 1 -- 172.21.15.112:0/3916128351 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4dd416af70 con 0x7f4dd4167620 2023-10-06T04:39:44.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.496+0000 7f4ddc538700 1 -- 172.21.15.112:0/3916128351 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4dd416af70 con 0x7f4dd4167620 2023-10-06T04:39:44.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.497+0000 7f4dd27fc700 1 -- 172.21.15.112:0/3916128351 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4dd416af70 con 0x7f4dd4167620 2023-10-06T04:39:44.499 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-10-06T04:39:44.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.499+0000 7f4ddc538700 1 -- 172.21.15.112:0/3916128351 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4dc0066f30 msgr2=0x7f4dc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:44.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.499+0000 7f4ddc538700 1 --2- 172.21.15.112:0/3916128351 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4dc0066f30 0x7f4dc00693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4002250 tx=0x7f4dc4015000 comp rx=0 tx=0).stop 2023-10-06T04:39:44.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.499+0000 7f4ddc538700 1 -- 172.21.15.112:0/3916128351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dd4167620 msgr2=0x7f4dd4167a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:44.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.499+0000 7f4ddc538700 1 --2- 172.21.15.112:0/3916128351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dd4167620 0x7f4dd4167a60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40afbf0 tx=0x7f4dcc007d10 comp rx=0 tx=0).stop 2023-10-06T04:39:44.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.499+0000 7f4ddc538700 1 -- 172.21.15.112:0/3916128351 shutdown_connections 2023-10-06T04:39:44.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.499+0000 7f4ddc538700 1 --2- 172.21.15.112:0/3916128351 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4dc0066f30 0x7f4dc00693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.499+0000 7f4ddc538700 1 --2- 172.21.15.112:0/3916128351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dd4167620 0x7f4dd4167a60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.499+0000 7f4ddc538700 1 --2- 172.21.15.112:0/3916128351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dbc003a90 0x7f4dd40cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.499+0000 7f4ddc538700 1 --2- 172.21.15.112:0/3916128351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dd406c7d0 0x7f4dd415ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.499+0000 7f4ddc538700 1 -- 172.21.15.112:0/3916128351 >> 172.21.15.112:0/3916128351 conn(0x7f4dd4068610 msgr2=0x7f4dd41545d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:44.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.499+0000 7f4ddc538700 1 -- 172.21.15.112:0/3916128351 shutdown_connections 2023-10-06T04:39:44.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.499+0000 7f4ddc538700 1 -- 172.21.15.112:0/3916128351 wait complete. 2023-10-06T04:39:44.513 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:39:44.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.628+0000 7fb74fc9a700 1 Processor -- start 2023-10-06T04:39:44.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.628+0000 7fb74fc9a700 1 -- start start 2023-10-06T04:39:44.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.629+0000 7fb74fc9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb748159a20 0x7fb7480cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:44.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.629+0000 7fb74fc9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb74806d3b0 0x7fb7480cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:44.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.629+0000 7fb74fc9a700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb74815af50 con 0x7fb74815a9f0 2023-10-06T04:39:44.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.629+0000 7fb74fc9a700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7480cca70 con 0x7fb74806d3b0 2023-10-06T04:39:44.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.629+0000 7fb74fc9a700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74808a080 con 0x7fb748159a20 2023-10-06T04:39:44.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.629+0000 7fb74d235700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb74806d3b0 0x7fb7480cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:44.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.629+0000 7fb74da36700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb748159a20 0x7fb7480cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:44.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.629+0000 7fb74d235700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb74806d3b0 0x7fb7480cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.112:33916/0 (socket says 172.21.15.112:33916) 2023-10-06T04:39:44.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.629+0000 7fb74da36700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb748159a20 0x7fb7480cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.112:39370/0 (socket says 172.21.15.112:39370) 2023-10-06T04:39:44.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.629+0000 7fb74d235700 1 -- 172.21.15.112:0/4119213005 learned_addr learned my addr 172.21.15.112:0/4119213005 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:44.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.629+0000 7fb74e237700 1 --1- 172.21.15.112:0/4119213005 >> v1:172.21.15.179:6789/0 conn(0x7fb74815a9f0 0x7fb74815d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.112:54774/0 (socket says 172.21.15.112:54774) 2023-10-06T04:39:44.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.630+0000 7fb74d235700 1 -- 172.21.15.112:0/4119213005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb748159a20 msgr2=0x7fb7480cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:44.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.630+0000 7fb74d235700 1 --2- 172.21.15.112:0/4119213005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb748159a20 0x7fb7480cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.630+0000 7fb74d235700 1 -- 172.21.15.112:0/4119213005 >> v1:172.21.15.179:6789/0 conn(0x7fb74815a9f0 legacy=0x7fb74815d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:44.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.630+0000 7fb74d235700 1 -- 172.21.15.112:0/4119213005 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7480cae50 con 0x7fb74806d3b0 2023-10-06T04:39:44.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.630+0000 7fb74ca34700 1 -- 172.21.15.112:0/4119213005 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1456749965 0 0) 0x7fb74815af50 con 0x7fb74815a9f0 2023-10-06T04:39:44.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.630+0000 7fb74d235700 1 --2- 172.21.15.112:0/4119213005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb74806d3b0 0x7fb7480cbd30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb7380099e0 tx=0x7fb738009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67edf8fcd13564b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:44.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.630+0000 7fb74ca34700 1 -- 172.21.15.112:0/4119213005 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73800b820 con 0x7fb74806d3b0 2023-10-06T04:39:44.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.630+0000 7fb74ca34700 1 -- 172.21.15.112:0/4119213005 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73800b980 con 0x7fb74806d3b0 2023-10-06T04:39:44.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.630+0000 7fb74ca34700 1 -- 172.21.15.112:0/4119213005 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73800bd20 con 0x7fb74806d3b0 2023-10-06T04:39:44.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.631+0000 7fb74fc9a700 1 -- 172.21.15.112:0/4119213005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb74806d3b0 msgr2=0x7fb7480cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:44.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.631+0000 7fb74fc9a700 1 --2- 172.21.15.112:0/4119213005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb74806d3b0 0x7fb7480cbd30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb7380099e0 tx=0x7fb738009250 comp rx=0 tx=0).stop 2023-10-06T04:39:44.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.631+0000 7fb74fc9a700 1 -- 172.21.15.112:0/4119213005 shutdown_connections 2023-10-06T04:39:44.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.631+0000 7fb74fc9a700 1 --2- 172.21.15.112:0/4119213005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb748159a20 0x7fb7480cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.631+0000 7fb74fc9a700 1 --2- 172.21.15.112:0/4119213005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb74806d3b0 0x7fb7480cbd30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.631+0000 7fb74fc9a700 1 -- 172.21.15.112:0/4119213005 >> 172.21.15.112:0/4119213005 conn(0x7fb74806cfb0 msgr2=0x7fb7480d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:44.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.631+0000 7fb74fc9a700 1 -- 172.21.15.112:0/4119213005 shutdown_connections 2023-10-06T04:39:44.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.631+0000 7fb74fc9a700 1 -- 172.21.15.112:0/4119213005 wait complete. 2023-10-06T04:39:44.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.632+0000 7fb74fc9a700 1 Processor -- start 2023-10-06T04:39:44.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.632+0000 7fb74fc9a700 1 -- start start 2023-10-06T04:39:44.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.633+0000 7fb74fc9a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb74806d3b0 0x7fb7480b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:44.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.633+0000 7fb74fc9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb748159a20 0x7fb74809d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:44.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.633+0000 7fb74fc9a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb74815a9f0 0x7fb74815d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:44.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.633+0000 7fb74fc9a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480b1b90 con 0x7fb74815a9f0 2023-10-06T04:39:44.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.633+0000 7fb74fc9a700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480b0f80 con 0x7fb74806d3b0 2023-10-06T04:39:44.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.633+0000 7fb74fc9a700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480b1260 con 0x7fb748159a20 2023-10-06T04:39:44.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.633+0000 7fb74e237700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb74815a9f0 0x7fb74815d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:44.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.633+0000 7fb74e237700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb74815a9f0 0x7fb74815d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34262/0 (socket says 172.21.15.112:34262) 2023-10-06T04:39:44.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.633+0000 7fb74e237700 1 -- 172.21.15.112:0/1167713057 learned_addr learned my addr 172.21.15.112:0/1167713057 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:44.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.633+0000 7fb74d235700 1 --2- 172.21.15.112:0/1167713057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb748159a20 0x7fb74809d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:44.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.633+0000 7fb74da36700 1 --2- 172.21.15.112:0/1167713057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb74806d3b0 0x7fb7480b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:44.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.633+0000 7fb74e237700 1 -- 172.21.15.112:0/1167713057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb748159a20 msgr2=0x7fb74809d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:44.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.633+0000 7fb74e237700 1 --2- 172.21.15.112:0/1167713057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb748159a20 0x7fb74809d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.633+0000 7fb74e237700 1 -- 172.21.15.112:0/1167713057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb74806d3b0 msgr2=0x7fb7480b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:44.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.633+0000 7fb74e237700 1 --2- 172.21.15.112:0/1167713057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb74806d3b0 0x7fb7480b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.633+0000 7fb74e237700 1 -- 172.21.15.112:0/1167713057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7380094f0 con 0x7fb74815a9f0 2023-10-06T04:39:44.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.633+0000 7fb74e237700 1 --2- 172.21.15.112:0/1167713057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb74815a9f0 0x7fb74815d9b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb74000ccc0 tx=0x7fb740001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:44.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.633+0000 7fb73dffb700 1 -- 172.21.15.112:0/1167713057 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb740005df0 con 0x7fb74815a9f0 2023-10-06T04:39:44.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.633+0000 7fb73dffb700 1 -- 172.21.15.112:0/1167713057 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74000a900 con 0x7fb74815a9f0 2023-10-06T04:39:44.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.633+0000 7fb74fc9a700 1 -- 172.21.15.112:0/1167713057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7480b1540 con 0x7fb74815a9f0 2023-10-06T04:39:44.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.633+0000 7fb73dffb700 1 -- 172.21.15.112:0/1167713057 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74000acc0 con 0x7fb74815a9f0 2023-10-06T04:39:44.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.634+0000 7fb74fc9a700 1 -- 172.21.15.112:0/1167713057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7480b66a0 con 0x7fb74815a9f0 2023-10-06T04:39:44.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.634+0000 7fb74fc9a700 1 -- 172.21.15.112:0/1167713057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7480b1d00 con 0x7fb74815a9f0 2023-10-06T04:39:44.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.635+0000 7fb73dffb700 1 -- 172.21.15.112:0/1167713057 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb740007300 con 0x7fb74815a9f0 2023-10-06T04:39:44.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.635+0000 7fb73dffb700 1 --2- 172.21.15.112:0/1167713057 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb72c066f30 0x7fb72c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:44.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.635+0000 7fb74da36700 1 --2- 172.21.15.112:0/1167713057 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb72c066f30 0x7fb72c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:44.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.635+0000 7fb73dffb700 1 -- 172.21.15.112:0/1167713057 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb7400847c0 con 0x7fb74815a9f0 2023-10-06T04:39:44.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.636+0000 7fb74da36700 1 --2- 172.21.15.112:0/1167713057 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb72c066f30 0x7fb72c0693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb744009d40 tx=0x7fb744008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:44.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.640+0000 7fb73dffb700 1 -- 172.21.15.112:0/1167713057 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb740051950 con 0x7fb74815a9f0 2023-10-06T04:39:44.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.824+0000 7fb74fc9a700 1 -- 172.21.15.112:0/1167713057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb74805f230 con 0x7fb74815a9f0 2023-10-06T04:39:44.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.825+0000 7fb73dffb700 1 -- 172.21.15.112:0/1167713057 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb740054f70 con 0x7fb74815a9f0 2023-10-06T04:39:44.827 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-10-06T04:39:44.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.827+0000 7fb74fc9a700 1 -- 172.21.15.112:0/1167713057 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb72c066f30 msgr2=0x7fb72c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:44.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.827+0000 7fb74fc9a700 1 --2- 172.21.15.112:0/1167713057 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb72c066f30 0x7fb72c0693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb744009d40 tx=0x7fb744008040 comp rx=0 tx=0).stop 2023-10-06T04:39:44.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.827+0000 7fb74fc9a700 1 -- 172.21.15.112:0/1167713057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb74815a9f0 msgr2=0x7fb74815d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:44.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.827+0000 7fb74fc9a700 1 --2- 172.21.15.112:0/1167713057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb74815a9f0 0x7fb74815d9b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb74000ccc0 tx=0x7fb740001a20 comp rx=0 tx=0).stop 2023-10-06T04:39:44.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.827+0000 7fb74fc9a700 1 -- 172.21.15.112:0/1167713057 shutdown_connections 2023-10-06T04:39:44.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.827+0000 7fb74fc9a700 1 --2- 172.21.15.112:0/1167713057 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb72c066f30 0x7fb72c0693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.827+0000 7fb74fc9a700 1 --2- 172.21.15.112:0/1167713057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb74815a9f0 0x7fb74815d9b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.827+0000 7fb74fc9a700 1 --2- 172.21.15.112:0/1167713057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb74806d3b0 0x7fb7480b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.827+0000 7fb74fc9a700 1 --2- 172.21.15.112:0/1167713057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb748159a20 0x7fb74809d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.827+0000 7fb74fc9a700 1 -- 172.21.15.112:0/1167713057 >> 172.21.15.112:0/1167713057 conn(0x7fb74806cfb0 msgr2=0x7fb74806f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:44.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.827+0000 7fb74fc9a700 1 -- 172.21.15.112:0/1167713057 shutdown_connections 2023-10-06T04:39:44.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.827+0000 7fb74fc9a700 1 -- 172.21.15.112:0/1167713057 wait complete. 2023-10-06T04:39:44.841 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:44.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.952+0000 7f6177c4e700 1 Processor -- start 2023-10-06T04:39:44.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.952+0000 7f6177c4e700 1 -- start start 2023-10-06T04:39:44.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.953+0000 7f6177c4e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6170159d50 0x7f61700b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:44.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.953+0000 7f6177c4e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f617015a120 0x7f61700cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:44.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.953+0000 7f6177c4e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61700b0e70 0x7f61700b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:44.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.953+0000 7f6177c4e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61700b1810 con 0x7f617015a120 2023-10-06T04:39:44.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.953+0000 7f6177c4e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61700cd740 con 0x7f6170159d50 2023-10-06T04:39:44.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.953+0000 7f6177c4e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61700ccb30 con 0x7f61700b0e70 2023-10-06T04:39:44.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.953+0000 7f61751e9700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f617015a120 0x7f61700cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:44.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.953+0000 7f61751e9700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f617015a120 0x7f61700cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34278/0 (socket says 172.21.15.112:34278) 2023-10-06T04:39:44.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.953+0000 7f61751e9700 1 -- 172.21.15.112:0/888070866 learned_addr learned my addr 172.21.15.112:0/888070866 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:44.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.953+0000 7f61759ea700 1 --2- 172.21.15.112:0/888070866 >> v2:172.21.15.179:3300/0 conn(0x7f6170159d50 0x7f61700b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:44.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.953+0000 7f61761eb700 1 --2- 172.21.15.112:0/888070866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61700b0e70 0x7f61700b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:44.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.953+0000 7f61751e9700 1 -- 172.21.15.112:0/888070866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61700b0e70 msgr2=0x7f61700b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:44.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.953+0000 7f61751e9700 1 --2- 172.21.15.112:0/888070866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61700b0e70 0x7f61700b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.953+0000 7f61751e9700 1 -- 172.21.15.112:0/888070866 >> v2:172.21.15.179:3300/0 conn(0x7f6170159d50 msgr2=0x7f61700b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:44.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.953+0000 7f61751e9700 1 --2- 172.21.15.112:0/888070866 >> v2:172.21.15.179:3300/0 conn(0x7f6170159d50 0x7f61700b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.953+0000 7f61751e9700 1 -- 172.21.15.112:0/888070866 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61700cce10 con 0x7f617015a120 2023-10-06T04:39:44.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.953+0000 7f61751e9700 1 --2- 172.21.15.112:0/888070866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f617015a120 0x7f61700cdbd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6170088770 tx=0x7f6160009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ac1a195f1d6070 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:44.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.954+0000 7f61749e8700 1 -- 172.21.15.112:0/888070866 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160009e70 con 0x7f617015a120 2023-10-06T04:39:44.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.954+0000 7f61749e8700 1 -- 172.21.15.112:0/888070866 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616000b860 con 0x7f617015a120 2023-10-06T04:39:44.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.954+0000 7f61749e8700 1 -- 172.21.15.112:0/888070866 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616000bc00 con 0x7f617015a120 2023-10-06T04:39:44.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.954+0000 7f6177c4e700 1 -- 172.21.15.112:0/888070866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f617015a120 msgr2=0x7f61700cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:44.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.954+0000 7f6177c4e700 1 --2- 172.21.15.112:0/888070866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f617015a120 0x7f61700cdbd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6170088770 tx=0x7f6160009250 comp rx=0 tx=0).stop 2023-10-06T04:39:44.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.954+0000 7f6177c4e700 1 -- 172.21.15.112:0/888070866 shutdown_connections 2023-10-06T04:39:44.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.954+0000 7f6177c4e700 1 --2- 172.21.15.112:0/888070866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61700b0e70 0x7f61700b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.954+0000 7f6177c4e700 1 --2- 172.21.15.112:0/888070866 >> v2:172.21.15.179:3300/0 conn(0x7f6170159d50 0x7f61700b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.954+0000 7f6177c4e700 1 --2- 172.21.15.112:0/888070866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f617015a120 0x7f61700cdbd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.954+0000 7f6177c4e700 1 -- 172.21.15.112:0/888070866 >> 172.21.15.112:0/888070866 conn(0x7f6170099b60 msgr2=0x7f617006cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:44.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.954+0000 7f6177c4e700 1 -- 172.21.15.112:0/888070866 shutdown_connections 2023-10-06T04:39:44.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.954+0000 7f6177c4e700 1 -- 172.21.15.112:0/888070866 wait complete. 2023-10-06T04:39:44.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.955+0000 7f6177c4e700 1 Processor -- start 2023-10-06T04:39:44.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.955+0000 7f6177c4e700 1 -- start start 2023-10-06T04:39:44.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.956+0000 7f6177c4e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61700b0e70 0x7f617009f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:44.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.956+0000 7f6177c4e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6170159d50 0x7f617016e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:44.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.956+0000 7f6177c4e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f617015a120 0x7f617014e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:44.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.956+0000 7f6177c4e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617009fda0 con 0x7f617015a120 2023-10-06T04:39:44.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.956+0000 7f6177c4e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617009ff60 con 0x7f61700b0e70 2023-10-06T04:39:44.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.956+0000 7f6177c4e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61700a0240 con 0x7f6170159d50 2023-10-06T04:39:44.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.956+0000 7f61761eb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f617015a120 0x7f617014e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:44.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.956+0000 7f61761eb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f617015a120 0x7f617014e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34294/0 (socket says 172.21.15.112:34294) 2023-10-06T04:39:44.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.956+0000 7f61761eb700 1 -- 172.21.15.112:0/2700412745 learned_addr learned my addr 172.21.15.112:0/2700412745 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:44.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.957+0000 7f61751e9700 1 --2- 172.21.15.112:0/2700412745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6170159d50 0x7f617016e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:44.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.957+0000 7f61759ea700 1 --2- 172.21.15.112:0/2700412745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61700b0e70 0x7f617009f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:44.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.957+0000 7f61761eb700 1 -- 172.21.15.112:0/2700412745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6170159d50 msgr2=0x7f617016e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:44.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.957+0000 7f61761eb700 1 --2- 172.21.15.112:0/2700412745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6170159d50 0x7f617016e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.957+0000 7f61761eb700 1 -- 172.21.15.112:0/2700412745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61700b0e70 msgr2=0x7f617009f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:44.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.957+0000 7f61761eb700 1 --2- 172.21.15.112:0/2700412745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61700b0e70 0x7f617009f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:44.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.957+0000 7f61761eb700 1 -- 172.21.15.112:0/2700412745 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61600094f0 con 0x7f617015a120 2023-10-06T04:39:44.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.957+0000 7f61759ea700 1 --2- 172.21.15.112:0/2700412745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61700b0e70 0x7f617009f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:44.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.957+0000 7f61751e9700 1 --2- 172.21.15.112:0/2700412745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6170159d50 0x7f617016e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:44.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.957+0000 7f61761eb700 1 --2- 172.21.15.112:0/2700412745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f617015a120 0x7f617014e570 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6168007f50 tx=0x7f6168009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:44.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.957+0000 7f6165ffb700 1 -- 172.21.15.112:0/2700412745 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616800ec70 con 0x7f617015a120 2023-10-06T04:39:44.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.957+0000 7f6165ffb700 1 -- 172.21.15.112:0/2700412745 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616800edf0 con 0x7f617015a120 2023-10-06T04:39:44.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.957+0000 7f6177c4e700 1 -- 172.21.15.112:0/2700412745 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617016e560 con 0x7f617015a120 2023-10-06T04:39:44.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.957+0000 7f6165ffb700 1 -- 172.21.15.112:0/2700412745 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6168014670 con 0x7f617015a120 2023-10-06T04:39:44.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.957+0000 7f6177c4e700 1 -- 172.21.15.112:0/2700412745 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61700b60e0 con 0x7f617015a120 2023-10-06T04:39:44.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.958+0000 7f6177c4e700 1 -- 172.21.15.112:0/2700412745 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617005f230 con 0x7f617015a120 2023-10-06T04:39:44.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.958+0000 7f6165ffb700 1 -- 172.21.15.112:0/2700412745 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f61680149e0 con 0x7f617015a120 2023-10-06T04:39:44.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.958+0000 7f6165ffb700 1 --2- 172.21.15.112:0/2700412745 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6154066f30 0x7f61540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:44.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.959+0000 7f6165ffb700 1 -- 172.21.15.112:0/2700412745 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6168084d70 con 0x7f617015a120 2023-10-06T04:39:44.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.959+0000 7f61759ea700 1 --2- 172.21.15.112:0/2700412745 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6154066f30 0x7f61540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:44.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.959+0000 7f61759ea700 1 --2- 172.21.15.112:0/2700412745 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6154066f30 0x7f61540693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f616c006f00 tx=0x7f616c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:44.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:44.963+0000 7f6165ffb700 1 -- 172.21.15.112:0/2700412745 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6168051e80 con 0x7f617015a120 2023-10-06T04:39:45.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.147+0000 7f6177c4e700 1 -- 172.21.15.112:0/2700412745 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f617008a910 con 0x7f617015a120 2023-10-06T04:39:45.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.148+0000 7f6165ffb700 1 -- 172.21.15.112:0/2700412745 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f61680554a0 con 0x7f617015a120 2023-10-06T04:39:45.151 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:45.151 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:39:22.637355+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:18.657040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:19.972295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:45.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.150+0000 7f6177c4e700 1 -- 172.21.15.112:0/2700412745 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6154066f30 msgr2=0x7f61540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:45.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.150+0000 7f6177c4e700 1 --2- 172.21.15.112:0/2700412745 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6154066f30 0x7f61540693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f616c006f00 tx=0x7f616c008040 comp rx=0 tx=0).stop 2023-10-06T04:39:45.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.150+0000 7f6177c4e700 1 -- 172.21.15.112:0/2700412745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f617015a120 msgr2=0x7f617014e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:45.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.150+0000 7f6177c4e700 1 --2- 172.21.15.112:0/2700412745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f617015a120 0x7f617014e570 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6168007f50 tx=0x7f6168009860 comp rx=0 tx=0).stop 2023-10-06T04:39:45.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.150+0000 7f6177c4e700 1 -- 172.21.15.112:0/2700412745 shutdown_connections 2023-10-06T04:39:45.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.150+0000 7f6177c4e700 1 --2- 172.21.15.112:0/2700412745 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6154066f30 0x7f61540693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.150+0000 7f6177c4e700 1 --2- 172.21.15.112:0/2700412745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f617015a120 0x7f617014e570 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.150+0000 7f6177c4e700 1 --2- 172.21.15.112:0/2700412745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61700b0e70 0x7f617009f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.150+0000 7f6177c4e700 1 --2- 172.21.15.112:0/2700412745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6170159d50 0x7f617016e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.150+0000 7f6177c4e700 1 -- 172.21.15.112:0/2700412745 >> 172.21.15.112:0/2700412745 conn(0x7f6170099b60 msgr2=0x7f61701568a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:45.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.150+0000 7f6177c4e700 1 -- 172.21.15.112:0/2700412745 shutdown_connections 2023-10-06T04:39:45.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.150+0000 7f6177c4e700 1 -- 172.21.15.112:0/2700412745 wait complete. 2023-10-06T04:39:45.166 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:13.929254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:39:14.321892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:39:18.657040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:39:19.972295+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:39:45.167 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:39:45.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.280+0000 7fa4e0e37700 1 Processor -- start 2023-10-06T04:39:45.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.280+0000 7fa4e0e37700 1 -- start start 2023-10-06T04:39:45.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.281+0000 7fa4e0e37700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa4dc159a50 0x7fa4dc0b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:45.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.281+0000 7fa4e0e37700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4dc15d620 0x7fa4dc068050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:45.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.281+0000 7fa4e0e37700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4dc06daf0 con 0x7fa4dc068590 2023-10-06T04:39:45.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.281+0000 7fa4e0e37700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4dc068a30 con 0x7fa4dc159a50 2023-10-06T04:39:45.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.281+0000 7fa4e0e37700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc15db20 con 0x7fa4dc15d620 2023-10-06T04:39:45.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.282+0000 7fa4da59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa4dc159a50 0x7fa4dc0b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:45.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.282+0000 7fa4dad9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa4dc068590 0x7fa4dc069570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46606/0 (socket says 172.21.15.112:46606) 2023-10-06T04:39:45.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.282+0000 7fa4dad9d700 1 -- 172.21.15.112:0/29995170 learned_addr learned my addr 172.21.15.112:0/29995170 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:45.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.282+0000 7fa4d9d9b700 1 --2- 172.21.15.112:0/29995170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4dc15d620 0x7fa4dc068050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:45.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.282+0000 7fa4da59c700 1 -- 172.21.15.112:0/29995170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4dc15d620 msgr2=0x7fa4dc068050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:45.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.282+0000 7fa4da59c700 1 --2- 172.21.15.112:0/29995170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4dc15d620 0x7fa4dc068050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.282+0000 7fa4da59c700 1 -- 172.21.15.112:0/29995170 >> v1:172.21.15.112:6789/0 conn(0x7fa4dc068590 legacy=0x7fa4dc069570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:45.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.282+0000 7fa4da59c700 1 -- 172.21.15.112:0/29995170 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4dc15de00 con 0x7fa4dc159a50 2023-10-06T04:39:45.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.282+0000 7fa4d959a700 1 -- 172.21.15.112:0/29995170 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189382681 0 0) 0x7fa4dc06daf0 con 0x7fa4dc068590 2023-10-06T04:39:45.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.282+0000 7fa4da59c700 1 --2- 172.21.15.112:0/29995170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4dc159a50 0x7fa4dc0b38b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009e60 tx=0x7fa4cc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c9c29028e6009a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:45.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.282+0000 7fa4d959a700 1 -- 172.21.15.112:0/29995170 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc00e070 con 0x7fa4dc159a50 2023-10-06T04:39:45.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.282+0000 7fa4d959a700 1 -- 172.21.15.112:0/29995170 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc00bc30 con 0x7fa4dc159a50 2023-10-06T04:39:45.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.282+0000 7fa4d959a700 1 -- 172.21.15.112:0/29995170 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc012430 con 0x7fa4dc159a50 2023-10-06T04:39:45.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.283+0000 7fa4e0e37700 1 -- 172.21.15.112:0/29995170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4dc159a50 msgr2=0x7fa4dc0b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:45.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.283+0000 7fa4e0e37700 1 --2- 172.21.15.112:0/29995170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4dc159a50 0x7fa4dc0b38b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009e60 tx=0x7fa4cc009780 comp rx=0 tx=0).stop 2023-10-06T04:39:45.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.283+0000 7fa4e0e37700 1 -- 172.21.15.112:0/29995170 shutdown_connections 2023-10-06T04:39:45.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.283+0000 7fa4e0e37700 1 --2- 172.21.15.112:0/29995170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4dc159a50 0x7fa4dc0b38b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.283+0000 7fa4e0e37700 1 --2- 172.21.15.112:0/29995170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4dc15d620 0x7fa4dc068050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.283+0000 7fa4e0e37700 1 -- 172.21.15.112:0/29995170 >> 172.21.15.112:0/29995170 conn(0x7fa4dc0631f0 msgr2=0x7fa4dc0635f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:45.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.283+0000 7fa4e0e37700 1 -- 172.21.15.112:0/29995170 shutdown_connections 2023-10-06T04:39:45.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.283+0000 7fa4e0e37700 1 -- 172.21.15.112:0/29995170 wait complete. 2023-10-06T04:39:45.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.284+0000 7fa4e0e37700 1 Processor -- start 2023-10-06T04:39:45.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.284+0000 7fa4e0e37700 1 -- start start 2023-10-06T04:39:45.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.284+0000 7fa4e0e37700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4dc068590 0x7fa4dc159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:45.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.285+0000 7fa4e0e37700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4dc159a50 0x7fa4dc154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:45.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.285+0000 7fa4e0e37700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4dc15d620 0x7fa4dc141de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:45.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.285+0000 7fa4e0e37700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc15b280 con 0x7fa4dc159a50 2023-10-06T04:39:45.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.285+0000 7fa4e0e37700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc15a670 con 0x7fa4dc15d620 2023-10-06T04:39:45.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.285+0000 7fa4e0e37700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc15a950 con 0x7fa4dc068590 2023-10-06T04:39:45.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.285+0000 7fa4d9d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4dc159a50 0x7fa4dc154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:45.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.285+0000 7fa4d9d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4dc159a50 0x7fa4dc154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34310/0 (socket says 172.21.15.112:34310) 2023-10-06T04:39:45.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.285+0000 7fa4d9d9b700 1 -- 172.21.15.112:0/1151247893 learned_addr learned my addr 172.21.15.112:0/1151247893 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:45.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.285+0000 7fa4da59c700 1 --2- 172.21.15.112:0/1151247893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4dc068590 0x7fa4dc159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:45.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.285+0000 7fa4dad9d700 1 --2- 172.21.15.112:0/1151247893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4dc15d620 0x7fa4dc141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:45.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.285+0000 7fa4d9d9b700 1 -- 172.21.15.112:0/1151247893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4dc068590 msgr2=0x7fa4dc159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:45.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.285+0000 7fa4d9d9b700 1 --2- 172.21.15.112:0/1151247893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4dc068590 0x7fa4dc159e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.285+0000 7fa4d9d9b700 1 -- 172.21.15.112:0/1151247893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4dc15d620 msgr2=0x7fa4dc141de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:45.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.285+0000 7fa4d9d9b700 1 --2- 172.21.15.112:0/1151247893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4dc15d620 0x7fa4dc141de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.285+0000 7fa4d9d9b700 1 -- 172.21.15.112:0/1151247893 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc009a20 con 0x7fa4dc159a50 2023-10-06T04:39:45.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.285+0000 7fa4d9d9b700 1 --2- 172.21.15.112:0/1151247893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4dc159a50 0x7fa4dc154de0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0006b00 tx=0x7fa4d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:45.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.285+0000 7fa4ca7fc700 1 -- 172.21.15.112:0/1151247893 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d00125f0 con 0x7fa4dc159a50 2023-10-06T04:39:45.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.285+0000 7fa4ca7fc700 1 -- 172.21.15.112:0/1151247893 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d0012770 con 0x7fa4dc159a50 2023-10-06T04:39:45.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.285+0000 7fa4e0e37700 1 -- 172.21.15.112:0/1151247893 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4dc15ac30 con 0x7fa4dc159a50 2023-10-06T04:39:45.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.285+0000 7fa4ca7fc700 1 -- 172.21.15.112:0/1151247893 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0012b30 con 0x7fa4dc159a50 2023-10-06T04:39:45.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.285+0000 7fa4e0e37700 1 -- 172.21.15.112:0/1151247893 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4dc15a360 con 0x7fa4dc159a50 2023-10-06T04:39:45.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.286+0000 7fa4e0e37700 1 -- 172.21.15.112:0/1151247893 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4dc15b430 con 0x7fa4dc159a50 2023-10-06T04:39:45.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.287+0000 7fa4ca7fc700 1 -- 172.21.15.112:0/1151247893 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4d001e460 con 0x7fa4dc159a50 2023-10-06T04:39:45.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.287+0000 7fa4ca7fc700 1 --2- 172.21.15.112:0/1151247893 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa4bc066f30 0x7fa4bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:45.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.287+0000 7fa4ca7fc700 1 -- 172.21.15.112:0/1151247893 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa4d0084c80 con 0x7fa4dc159a50 2023-10-06T04:39:45.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.287+0000 7fa4da59c700 1 --2- 172.21.15.112:0/1151247893 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa4bc066f30 0x7fa4bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:45.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.287+0000 7fa4da59c700 1 --2- 172.21.15.112:0/1151247893 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa4bc066f30 0x7fa4bc0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009e60 tx=0x7fa4cc019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:45.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.291+0000 7fa4ca7fc700 1 -- 172.21.15.112:0/1151247893 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4dc15b430 con 0x7fa4dc159a50 2023-10-06T04:39:45.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.472+0000 7fa4e0e37700 1 -- 172.21.15.112:0/1151247893 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa4dc05f230 con 0x7fa4dc159a50 2023-10-06T04:39:45.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.473+0000 7fa4ca7fc700 1 -- 172.21.15.112:0/1151247893 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa4d0051d90 con 0x7fa4dc159a50 2023-10-06T04:39:45.475 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-10-06T04:39:45.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.475+0000 7fa4e0e37700 1 -- 172.21.15.112:0/1151247893 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa4bc066f30 msgr2=0x7fa4bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:45.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.475+0000 7fa4e0e37700 1 --2- 172.21.15.112:0/1151247893 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa4bc066f30 0x7fa4bc0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009e60 tx=0x7fa4cc019000 comp rx=0 tx=0).stop 2023-10-06T04:39:45.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.475+0000 7fa4e0e37700 1 -- 172.21.15.112:0/1151247893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4dc159a50 msgr2=0x7fa4dc154de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:45.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.475+0000 7fa4e0e37700 1 --2- 172.21.15.112:0/1151247893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4dc159a50 0x7fa4dc154de0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0006b00 tx=0x7fa4d0008040 comp rx=0 tx=0).stop 2023-10-06T04:39:45.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.475+0000 7fa4e0e37700 1 -- 172.21.15.112:0/1151247893 shutdown_connections 2023-10-06T04:39:45.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.475+0000 7fa4e0e37700 1 --2- 172.21.15.112:0/1151247893 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa4bc066f30 0x7fa4bc0693e0 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009e60 tx=0x7fa4cc019000 comp rx=0 tx=0).stop 2023-10-06T04:39:45.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.475+0000 7fa4e0e37700 1 --2- 172.21.15.112:0/1151247893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4dc15d620 0x7fa4dc141de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.475+0000 7fa4e0e37700 1 --2- 172.21.15.112:0/1151247893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4dc068590 0x7fa4dc159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.475+0000 7fa4e0e37700 1 --2- 172.21.15.112:0/1151247893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4dc159a50 0x7fa4dc154de0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.475+0000 7fa4e0e37700 1 -- 172.21.15.112:0/1151247893 >> 172.21.15.112:0/1151247893 conn(0x7fa4dc0631f0 msgr2=0x7fa4dc0af670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:45.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.475+0000 7fa4e0e37700 1 -- 172.21.15.112:0/1151247893 shutdown_connections 2023-10-06T04:39:45.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.475+0000 7fa4e0e37700 1 -- 172.21.15.112:0/1151247893 wait complete. 2023-10-06T04:39:45.489 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:39:45.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.604+0000 7f363aca1700 1 Processor -- start 2023-10-06T04:39:45.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.604+0000 7f363aca1700 1 -- start start 2023-10-06T04:39:45.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.605+0000 7f363aca1700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36340c7da0 0x7f36341643e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:45.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.605+0000 7f363aca1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36340cab40 con 0x7f36340d0c40 2023-10-06T04:39:45.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.605+0000 7f363aca1700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36340cceb0 con 0x7f3634157220 2023-10-06T04:39:45.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.605+0000 7f363aca1700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36340cd100 con 0x7f36340c7da0 2023-10-06T04:39:45.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.605+0000 7f363949e700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f36340d0c40 0x7f36340c7690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46612/0 (socket says 172.21.15.112:46612) 2023-10-06T04:39:45.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.605+0000 7f363949e700 1 -- 172.21.15.112:0/3434444341 learned_addr learned my addr 172.21.15.112:0/3434444341 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:45.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.605+0000 7f363a4a0700 1 --2- 172.21.15.112:0/3434444341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36340c7da0 0x7f36341643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:45.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.605+0000 7f3638c9d700 1 -- 172.21.15.112:0/3434444341 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706887897 0 0) 0x7f36340cab40 con 0x7f36340d0c40 2023-10-06T04:39:45.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.605+0000 7f3638c9d700 1 -- 172.21.15.112:0/3434444341 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3620003570 con 0x7f36340d0c40 2023-10-06T04:39:45.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.605+0000 7f3638c9d700 1 -- 172.21.15.112:0/3434444341 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581397520 0 0) 0x7f36340cceb0 con 0x7f3634157220 2023-10-06T04:39:45.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.605+0000 7f3638c9d700 1 -- 172.21.15.112:0/3434444341 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36340cab40 con 0x7f3634157220 2023-10-06T04:39:45.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.605+0000 7f3638c9d700 1 -- 172.21.15.112:0/3434444341 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2775110356 0 0) 0x7f3620003570 con 0x7f36340d0c40 2023-10-06T04:39:45.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.605+0000 7f363a4a0700 1 -- 172.21.15.112:0/3434444341 >> v1:172.21.15.179:6789/0 conn(0x7f3634157220 legacy=0x7f36340d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:45.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.605+0000 7f363a4a0700 1 -- 172.21.15.112:0/3434444341 >> v1:172.21.15.112:6789/0 conn(0x7f36340d0c40 legacy=0x7f36340c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:45.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.605+0000 7f363a4a0700 1 -- 172.21.15.112:0/3434444341 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36340cd3e0 con 0x7f36340c7da0 2023-10-06T04:39:45.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.606+0000 7f363a4a0700 1 --2- 172.21.15.112:0/3434444341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36340c7da0 0x7f36341643e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3630009e90 tx=0x7f3630009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8ba301b4c731730 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:45.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.606+0000 7f3638c9d700 1 -- 172.21.15.112:0/3434444341 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363000e070 con 0x7f36340c7da0 2023-10-06T04:39:45.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.606+0000 7f3638c9d700 1 -- 172.21.15.112:0/3434444341 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363000b870 con 0x7f36340c7da0 2023-10-06T04:39:45.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.606+0000 7f3638c9d700 1 -- 172.21.15.112:0/3434444341 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36240015f0 con 0x7f36340c7da0 2023-10-06T04:39:45.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.606+0000 7f363aca1700 1 -- 172.21.15.112:0/3434444341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36340c7da0 msgr2=0x7f36341643e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:45.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.606+0000 7f363aca1700 1 --2- 172.21.15.112:0/3434444341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36340c7da0 0x7f36341643e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3630009e90 tx=0x7f3630009780 comp rx=0 tx=0).stop 2023-10-06T04:39:45.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.606+0000 7f363aca1700 1 -- 172.21.15.112:0/3434444341 shutdown_connections 2023-10-06T04:39:45.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.606+0000 7f363aca1700 1 --2- 172.21.15.112:0/3434444341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36340c7da0 0x7f36341643e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.606+0000 7f363aca1700 1 -- 172.21.15.112:0/3434444341 >> 172.21.15.112:0/3434444341 conn(0x7f363406c7d0 msgr2=0x7f363406cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:45.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.606+0000 7f363aca1700 1 -- 172.21.15.112:0/3434444341 shutdown_connections 2023-10-06T04:39:45.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.606+0000 7f363aca1700 1 -- 172.21.15.112:0/3434444341 wait complete. 2023-10-06T04:39:45.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.607+0000 7f363aca1700 1 Processor -- start 2023-10-06T04:39:45.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.607+0000 7f363aca1700 1 -- start start 2023-10-06T04:39:45.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.608+0000 7f363aca1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36340c7da0 0x7f3634154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:45.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.608+0000 7f363aca1700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36340d0c40 0x7f363415c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:45.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.608+0000 7f363aca1700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3634157220 0x7f363415c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:45.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.608+0000 7f363aca1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36340c4fd0 con 0x7f36340c7da0 2023-10-06T04:39:45.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.608+0000 7f363aca1700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363415caa0 con 0x7f3634157220 2023-10-06T04:39:45.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.608+0000 7f363aca1700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3634157ab0 con 0x7f36340d0c40 2023-10-06T04:39:45.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.608+0000 7f3639c9f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36340c7da0 0x7f3634154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:45.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.608+0000 7f3639c9f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36340c7da0 0x7f3634154bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34318/0 (socket says 172.21.15.112:34318) 2023-10-06T04:39:45.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.608+0000 7f3639c9f700 1 -- 172.21.15.112:0/3859824812 learned_addr learned my addr 172.21.15.112:0/3859824812 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:45.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.608+0000 7f363949e700 1 --2- 172.21.15.112:0/3859824812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36340d0c40 0x7f363415c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:45.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.608+0000 7f363a4a0700 1 --2- 172.21.15.112:0/3859824812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3634157220 0x7f363415c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:45.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.609+0000 7f3639c9f700 1 -- 172.21.15.112:0/3859824812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36340d0c40 msgr2=0x7f363415c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:45.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.609+0000 7f3639c9f700 1 --2- 172.21.15.112:0/3859824812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36340d0c40 0x7f363415c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.609+0000 7f3639c9f700 1 -- 172.21.15.112:0/3859824812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3634157220 msgr2=0x7f363415c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:45.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.609+0000 7f3639c9f700 1 --2- 172.21.15.112:0/3859824812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3634157220 0x7f363415c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.609+0000 7f3639c9f700 1 -- 172.21.15.112:0/3859824812 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3630009a20 con 0x7f36340c7da0 2023-10-06T04:39:45.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.609+0000 7f363a4a0700 1 --2- 172.21.15.112:0/3859824812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3634157220 0x7f363415c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:45.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.609+0000 7f3639c9f700 1 --2- 172.21.15.112:0/3859824812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36340c7da0 0x7f3634154bb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f362c00c7c0 tx=0x7f362c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:45.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.609+0000 7f3629ffb700 1 -- 172.21.15.112:0/3859824812 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c016070 con 0x7f36340c7da0 2023-10-06T04:39:45.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.609+0000 7f3629ffb700 1 -- 172.21.15.112:0/3859824812 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362c011680 con 0x7f36340c7da0 2023-10-06T04:39:45.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.609+0000 7f363aca1700 1 -- 172.21.15.112:0/3859824812 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363415a4a0 con 0x7f36340c7da0 2023-10-06T04:39:45.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.609+0000 7f3629ffb700 1 -- 172.21.15.112:0/3859824812 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c011a20 con 0x7f36340c7da0 2023-10-06T04:39:45.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.609+0000 7f363aca1700 1 -- 172.21.15.112:0/3859824812 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363415aa60 con 0x7f36340c7da0 2023-10-06T04:39:45.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.610+0000 7f363aca1700 1 -- 172.21.15.112:0/3859824812 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363405f230 con 0x7f36340c7da0 2023-10-06T04:39:45.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.610+0000 7f3629ffb700 1 -- 172.21.15.112:0/3859824812 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f362c012440 con 0x7f36340c7da0 2023-10-06T04:39:45.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.611+0000 7f3629ffb700 1 --2- 172.21.15.112:0/3859824812 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3618066f30 0x7f36180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:45.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.611+0000 7f3629ffb700 1 -- 172.21.15.112:0/3859824812 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f362c084480 con 0x7f36340c7da0 2023-10-06T04:39:45.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.611+0000 7f363949e700 1 --2- 172.21.15.112:0/3859824812 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3618066f30 0x7f36180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:45.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.611+0000 7f363949e700 1 --2- 172.21.15.112:0/3859824812 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3618066f30 0x7f36180693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f363406ce10 tx=0x7f3624009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:45.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.615+0000 7f3629ffb700 1 -- 172.21.15.112:0/3859824812 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f362c051590 con 0x7f36340c7da0 2023-10-06T04:39:45.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.803+0000 7f363aca1700 1 -- 172.21.15.112:0/3859824812 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36340af820 con 0x7f36340c7da0 2023-10-06T04:39:45.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.803+0000 7f3629ffb700 1 -- 172.21.15.112:0/3859824812 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f362c054bb0 con 0x7f36340c7da0 2023-10-06T04:39:45.806 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-10-06T04:39:45.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.805+0000 7f363aca1700 1 -- 172.21.15.112:0/3859824812 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3618066f30 msgr2=0x7f36180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:45.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.805+0000 7f363aca1700 1 --2- 172.21.15.112:0/3859824812 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3618066f30 0x7f36180693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f363406ce10 tx=0x7f3624009040 comp rx=0 tx=0).stop 2023-10-06T04:39:45.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.805+0000 7f363aca1700 1 -- 172.21.15.112:0/3859824812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36340c7da0 msgr2=0x7f3634154bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:45.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.805+0000 7f363aca1700 1 --2- 172.21.15.112:0/3859824812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36340c7da0 0x7f3634154bb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f362c00c7c0 tx=0x7f362c007dd0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.805+0000 7f363aca1700 1 -- 172.21.15.112:0/3859824812 shutdown_connections 2023-10-06T04:39:45.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.805+0000 7f363aca1700 1 --2- 172.21.15.112:0/3859824812 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3618066f30 0x7f36180693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.805+0000 7f363aca1700 1 --2- 172.21.15.112:0/3859824812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3634157220 0x7f363415c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.805+0000 7f363aca1700 1 --2- 172.21.15.112:0/3859824812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36340c7da0 0x7f3634154bb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.805+0000 7f363aca1700 1 --2- 172.21.15.112:0/3859824812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36340d0c40 0x7f363415c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.805+0000 7f363aca1700 1 -- 172.21.15.112:0/3859824812 >> 172.21.15.112:0/3859824812 conn(0x7f363406c7d0 msgr2=0x7f36340cacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:45.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.805+0000 7f363aca1700 1 -- 172.21.15.112:0/3859824812 shutdown_connections 2023-10-06T04:39:45.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.805+0000 7f363aca1700 1 -- 172.21.15.112:0/3859824812 wait complete. 2023-10-06T04:39:45.819 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:39:45.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.934+0000 7fcafbf95700 1 Processor -- start 2023-10-06T04:39:45.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.934+0000 7fcafbf95700 1 -- start start 2023-10-06T04:39:45.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.935+0000 7fcafbf95700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaf40cbf00 0x7fcaf415b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:45.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.935+0000 7fcafbf95700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcaf406d3b0 0x7fcaf415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:45.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.935+0000 7fcafbf95700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaf415af50 con 0x7fcaf4159a20 2023-10-06T04:39:45.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.935+0000 7fcafbf95700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf40cca70 con 0x7fcaf406d3b0 2023-10-06T04:39:45.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.935+0000 7fcafbf95700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf408a080 con 0x7fcaf40cbf00 2023-10-06T04:39:45.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.935+0000 7fcaf9d31700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fcaf4159a20 0x7fcaf40cb7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46620/0 (socket says 172.21.15.112:46620) 2023-10-06T04:39:45.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.935+0000 7fcaf9d31700 1 -- 172.21.15.112:0/1673236219 learned_addr learned my addr 172.21.15.112:0/1673236219 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:45.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.935+0000 7fcaf9530700 1 --2- 172.21.15.112:0/1673236219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaf40cbf00 0x7fcaf415b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:45.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.935+0000 7fcafa532700 1 --2- 172.21.15.112:0/1673236219 >> v2:172.21.15.179:3300/0 conn(0x7fcaf406d3b0 0x7fcaf415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:45.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.935+0000 7fcaf8d2f700 1 -- 172.21.15.112:0/1673236219 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411232648 0 0) 0x7fcaf415af50 con 0x7fcaf4159a20 2023-10-06T04:39:45.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.935+0000 7fcaf8d2f700 1 -- 172.21.15.112:0/1673236219 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcae0003570 con 0x7fcaf4159a20 2023-10-06T04:39:45.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.935+0000 7fcaf8d2f700 1 -- 172.21.15.112:0/1673236219 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4117198684 0 0) 0x7fcae0003570 con 0x7fcaf4159a20 2023-10-06T04:39:45.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.935+0000 7fcaf8d2f700 1 -- 172.21.15.112:0/1673236219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaf40cbf00 msgr2=0x7fcaf415b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:45.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.935+0000 7fcaf8d2f700 1 --2- 172.21.15.112:0/1673236219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaf40cbf00 0x7fcaf415b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.935+0000 7fcaf8d2f700 1 -- 172.21.15.112:0/1673236219 >> v2:172.21.15.179:3300/0 conn(0x7fcaf406d3b0 msgr2=0x7fcaf415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:45.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.935+0000 7fcaf8d2f700 1 --2- 172.21.15.112:0/1673236219 >> v2:172.21.15.179:3300/0 conn(0x7fcaf406d3b0 0x7fcaf415bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.935+0000 7fcaf8d2f700 1 -- 172.21.15.112:0/1673236219 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf40cae50 con 0x7fcaf4159a20 2023-10-06T04:39:45.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcaf8d2f700 1 -- 172.21.15.112:0/1673236219 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7fcaf0001470 con 0x7fcaf4159a20 2023-10-06T04:39:45.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcaf9530700 1 --2- 172.21.15.112:0/1673236219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaf40cbf00 0x7fcaf415b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:45.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcaf8d2f700 1 -- 172.21.15.112:0/1673236219 >> v1:172.21.15.112:6789/0 conn(0x7fcaf4159a20 legacy=0x7fcaf40cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:45.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcaf8d2f700 1 --2- 172.21.15.112:0/1673236219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaf40cbf00 0x7fcae0003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:45.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcaf8d2f700 1 --2- 172.21.15.112:0/1673236219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcae0003fd0 0x7fcae0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:45.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcaf8d2f700 1 --2- 172.21.15.112:0/1673236219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcae0004d50 0x7fcae00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:45.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcaf8d2f700 1 -- 172.21.15.112:0/1673236219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf40cca70 con 0x7fcae0004d50 2023-10-06T04:39:45.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcaf8d2f700 1 -- 172.21.15.112:0/1673236219 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf408a080 con 0x7fcae0003fd0 2023-10-06T04:39:45.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcaf8d2f700 1 -- 172.21.15.112:0/1673236219 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae000ba90 con 0x7fcaf40cbf00 2023-10-06T04:39:45.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcafa532700 1 --2- 172.21.15.112:0/1673236219 >> v2:172.21.15.179:3300/0 conn(0x7fcaf406d3b0 0x7fcaf415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:45.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcaf9d31700 1 --2- 172.21.15.112:0/1673236219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaf40cbf00 0x7fcae0003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:45.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcafa532700 1 --2- 172.21.15.112:0/1673236219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcae0004d50 0x7fcae00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:45.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcaf9530700 1 --2- 172.21.15.112:0/1673236219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcae0003fd0 0x7fcae0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:45.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcafa532700 1 -- 172.21.15.112:0/1673236219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaf40cbf00 msgr2=0x7fcae0003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:45.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcafa532700 1 --2- 172.21.15.112:0/1673236219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaf40cbf00 0x7fcae0003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcafa532700 1 -- 172.21.15.112:0/1673236219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcae0003fd0 msgr2=0x7fcae0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:45.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcafa532700 1 --2- 172.21.15.112:0/1673236219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcae0003fd0 0x7fcae0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcafa532700 1 -- 172.21.15.112:0/1673236219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae4009420 con 0x7fcae0004d50 2023-10-06T04:39:45.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcafa532700 1 --2- 172.21.15.112:0/1673236219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcae0004d50 0x7fcae00051c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcaf406d7b0 tx=0x7fcaec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a01e041ba61588 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:45.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcaf8d2f700 1 -- 172.21.15.112:0/1673236219 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec00ec10 con 0x7fcae0004d50 2023-10-06T04:39:45.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcaf8d2f700 1 -- 172.21.15.112:0/1673236219 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaec00f040 con 0x7fcae0004d50 2023-10-06T04:39:45.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.936+0000 7fcaf8d2f700 1 -- 172.21.15.112:0/1673236219 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec014480 con 0x7fcae0004d50 2023-10-06T04:39:45.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.937+0000 7fcafbf95700 1 -- 172.21.15.112:0/1673236219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcae0004d50 msgr2=0x7fcae00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:45.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.937+0000 7fcafbf95700 1 --2- 172.21.15.112:0/1673236219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcae0004d50 0x7fcae00051c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcaf406d7b0 tx=0x7fcaec00b040 comp rx=0 tx=0).stop 2023-10-06T04:39:45.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.937+0000 7fcafa532700 1 -- 172.21.15.112:0/1673236219 reap_dead start 2023-10-06T04:39:45.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.937+0000 7fcafbf95700 1 -- 172.21.15.112:0/1673236219 shutdown_connections 2023-10-06T04:39:45.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.937+0000 7fcafbf95700 1 -- 172.21.15.112:0/1673236219 >> 172.21.15.112:0/1673236219 conn(0x7fcaf406cfb0 msgr2=0x7fcaf40d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:45.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.937+0000 7fcafbf95700 1 -- 172.21.15.112:0/1673236219 shutdown_connections 2023-10-06T04:39:45.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.937+0000 7fcafbf95700 1 -- 172.21.15.112:0/1673236219 wait complete. 2023-10-06T04:39:45.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.938+0000 7fcafbf95700 1 Processor -- start 2023-10-06T04:39:45.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.938+0000 7fcafbf95700 1 -- start start 2023-10-06T04:39:45.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.939+0000 7fcafbf95700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaf409db10 0x7fcaf4158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:45.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.939+0000 7fcafbf95700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaf409dee0 0x7fcaf4155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:45.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.939+0000 7fcafbf95700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcaf416a1d0 0x7fcaf40cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:45.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.939+0000 7fcafbf95700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf41562f0 con 0x7fcaf416a1d0 2023-10-06T04:39:45.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.939+0000 7fcafbf95700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf40b4e20 con 0x7fcaf409dee0 2023-10-06T04:39:45.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.939+0000 7fcafbf95700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf40b57b0 con 0x7fcaf409db10 2023-10-06T04:39:45.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.939+0000 7fcafa532700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcaf416a1d0 0x7fcaf40cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:45.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.939+0000 7fcafa532700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcaf416a1d0 0x7fcaf40cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34328/0 (socket says 172.21.15.112:34328) 2023-10-06T04:39:45.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.939+0000 7fcafa532700 1 -- 172.21.15.112:0/1021927449 learned_addr learned my addr 172.21.15.112:0/1021927449 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:45.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.939+0000 7fcaf9530700 1 --2- 172.21.15.112:0/1021927449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaf409dee0 0x7fcaf4155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:45.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.939+0000 7fcaf9d31700 1 --2- 172.21.15.112:0/1021927449 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaf409db10 0x7fcaf4158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:45.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.939+0000 7fcafa532700 1 -- 172.21.15.112:0/1021927449 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaf409db10 msgr2=0x7fcaf4158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:45.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.939+0000 7fcafa532700 1 --2- 172.21.15.112:0/1021927449 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaf409db10 0x7fcaf4158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.939+0000 7fcafa532700 1 -- 172.21.15.112:0/1021927449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaf409dee0 msgr2=0x7fcaf4155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:45.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.939+0000 7fcafa532700 1 --2- 172.21.15.112:0/1021927449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaf409dee0 0x7fcaf4155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:45.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.939+0000 7fcafa532700 1 -- 172.21.15.112:0/1021927449 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf40b50c0 con 0x7fcaf416a1d0 2023-10-06T04:39:45.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.939+0000 7fcafa532700 1 --2- 172.21.15.112:0/1021927449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcaf416a1d0 0x7fcaf40cf8a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcaec009750 tx=0x7fcaec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:45.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.940+0000 7fcae9ffb700 1 -- 172.21.15.112:0/1021927449 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec014480 con 0x7fcaf416a1d0 2023-10-06T04:39:45.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.940+0000 7fcae9ffb700 1 -- 172.21.15.112:0/1021927449 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaec014e90 con 0x7fcaf416a1d0 2023-10-06T04:39:45.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.940+0000 7fcafbf95700 1 -- 172.21.15.112:0/1021927449 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf4159210 con 0x7fcaf416a1d0 2023-10-06T04:39:45.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.940+0000 7fcae9ffb700 1 -- 172.21.15.112:0/1021927449 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec01f680 con 0x7fcaf416a1d0 2023-10-06T04:39:45.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.940+0000 7fcafbf95700 1 -- 172.21.15.112:0/1021927449 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf416a620 con 0x7fcaf416a1d0 2023-10-06T04:39:45.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.941+0000 7fcafbf95700 1 -- 172.21.15.112:0/1021927449 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf40b5970 con 0x7fcaf416a1d0 2023-10-06T04:39:45.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.941+0000 7fcae9ffb700 1 -- 172.21.15.112:0/1021927449 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcaec01d440 con 0x7fcaf416a1d0 2023-10-06T04:39:45.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.941+0000 7fcae9ffb700 1 --2- 172.21.15.112:0/1021927449 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcad8066f30 0x7fcad80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:45.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.942+0000 7fcae9ffb700 1 -- 172.21.15.112:0/1021927449 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcaec085e80 con 0x7fcaf416a1d0 2023-10-06T04:39:45.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.942+0000 7fcaf9d31700 1 --2- 172.21.15.112:0/1021927449 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcad8066f30 0x7fcad80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:45.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.942+0000 7fcaf9d31700 1 --2- 172.21.15.112:0/1021927449 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcad8066f30 0x7fcad80693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0004890 tx=0x7fcaf0001e50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:45.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:45.946+0000 7fcae9ffb700 1 -- 172.21.15.112:0/1021927449 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcaec052f90 con 0x7fcaf416a1d0 2023-10-06T04:39:46.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.127+0000 7fcafbf95700 1 -- 172.21.15.112:0/1021927449 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcaf41562f0 con 0x7fcaf416a1d0 2023-10-06T04:39:46.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.127+0000 7fcae9ffb700 1 -- 172.21.15.112:0/1021927449 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcaec002030 con 0x7fcaf416a1d0 2023-10-06T04:39:46.130 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-10-06T04:39:46.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.129+0000 7fcafbf95700 1 -- 172.21.15.112:0/1021927449 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcad8066f30 msgr2=0x7fcad80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.129+0000 7fcafbf95700 1 --2- 172.21.15.112:0/1021927449 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcad8066f30 0x7fcad80693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0004890 tx=0x7fcaf0001e50 comp rx=0 tx=0).stop 2023-10-06T04:39:46.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.129+0000 7fcafbf95700 1 -- 172.21.15.112:0/1021927449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcaf416a1d0 msgr2=0x7fcaf40cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.129+0000 7fcafbf95700 1 --2- 172.21.15.112:0/1021927449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcaf416a1d0 0x7fcaf40cf8a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcaec009750 tx=0x7fcaec019000 comp rx=0 tx=0).stop 2023-10-06T04:39:46.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.129+0000 7fcafbf95700 1 -- 172.21.15.112:0/1021927449 shutdown_connections 2023-10-06T04:39:46.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.129+0000 7fcafbf95700 1 --2- 172.21.15.112:0/1021927449 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcad8066f30 0x7fcad80693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.129+0000 7fcafbf95700 1 --2- 172.21.15.112:0/1021927449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcaf416a1d0 0x7fcaf40cf8a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.129+0000 7fcafbf95700 1 --2- 172.21.15.112:0/1021927449 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaf409db10 0x7fcaf4158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.129+0000 7fcafbf95700 1 --2- 172.21.15.112:0/1021927449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaf409dee0 0x7fcaf4155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.129+0000 7fcafbf95700 1 -- 172.21.15.112:0/1021927449 >> 172.21.15.112:0/1021927449 conn(0x7fcaf406cfb0 msgr2=0x7fcaf4155430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:46.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.130+0000 7fcafbf95700 1 -- 172.21.15.112:0/1021927449 shutdown_connections 2023-10-06T04:39:46.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.130+0000 7fcafbf95700 1 -- 172.21.15.112:0/1021927449 wait complete. 2023-10-06T04:39:46.144 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:39:46.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.258+0000 7f5d33709700 1 Processor -- start 2023-10-06T04:39:46.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.259+0000 7f5d33709700 1 -- start start 2023-10-06T04:39:46.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.259+0000 7f5d33709700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5d2c159a20 0x7f5d2c0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.259+0000 7f5d33709700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5d2c06d3b0 0x7f5d2c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.259+0000 7f5d33709700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2c15af50 con 0x7f5d2c15a9f0 2023-10-06T04:39:46.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.259+0000 7f5d33709700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d2c0cca70 con 0x7f5d2c159a20 2023-10-06T04:39:46.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.259+0000 7f5d33709700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d2c08a080 con 0x7f5d2c06d3b0 2023-10-06T04:39:46.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.259+0000 7f5d314a5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5d2c159a20 0x7f5d2c0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.259+0000 7f5d31ca6700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5d2c15a9f0 0x7f5d2c15d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46632/0 (socket says 172.21.15.112:46632) 2023-10-06T04:39:46.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.260+0000 7f5d31ca6700 1 -- 172.21.15.112:0/2127247757 learned_addr learned my addr 172.21.15.112:0/2127247757 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:46.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.260+0000 7f5d30ca4700 1 --2- 172.21.15.112:0/2127247757 >> v2:172.21.15.179:3300/0 conn(0x7f5d2c06d3b0 0x7f5d2c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.260+0000 7f5d314a5700 1 -- 172.21.15.112:0/2127247757 >> v2:172.21.15.179:3300/0 conn(0x7f5d2c06d3b0 msgr2=0x7f5d2c0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:46.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.260+0000 7f5d314a5700 1 --2- 172.21.15.112:0/2127247757 >> v2:172.21.15.179:3300/0 conn(0x7f5d2c06d3b0 0x7f5d2c0cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.260+0000 7f5d314a5700 1 -- 172.21.15.112:0/2127247757 >> v1:172.21.15.112:6789/0 conn(0x7f5d2c15a9f0 legacy=0x7f5d2c15d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.260+0000 7f5d23fff700 1 -- 172.21.15.112:0/2127247757 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392953570 0 0) 0x7f5d2c15af50 con 0x7f5d2c15a9f0 2023-10-06T04:39:46.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.260+0000 7f5d314a5700 1 -- 172.21.15.112:0/2127247757 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2c0cae50 con 0x7f5d2c159a20 2023-10-06T04:39:46.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.260+0000 7f5d314a5700 1 --2- 172.21.15.112:0/2127247757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d2c159a20 0x7f5d2c0cb7f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c08ac00 tx=0x7f5d28009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283c3a42733bda3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:46.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.260+0000 7f5d23fff700 1 -- 172.21.15.112:0/2127247757 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800e070 con 0x7f5d2c159a20 2023-10-06T04:39:46.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.260+0000 7f5d23fff700 1 -- 172.21.15.112:0/2127247757 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2800bbf0 con 0x7f5d2c159a20 2023-10-06T04:39:46.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.260+0000 7f5d23fff700 1 -- 172.21.15.112:0/2127247757 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d28012430 con 0x7f5d2c159a20 2023-10-06T04:39:46.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.261+0000 7f5d33709700 1 -- 172.21.15.112:0/2127247757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d2c159a20 msgr2=0x7f5d2c0cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.261+0000 7f5d33709700 1 --2- 172.21.15.112:0/2127247757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d2c159a20 0x7f5d2c0cb7f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c08ac00 tx=0x7f5d28009780 comp rx=0 tx=0).stop 2023-10-06T04:39:46.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.261+0000 7f5d33709700 1 -- 172.21.15.112:0/2127247757 shutdown_connections 2023-10-06T04:39:46.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.261+0000 7f5d33709700 1 --2- 172.21.15.112:0/2127247757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d2c159a20 0x7f5d2c0cb7f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.261+0000 7f5d33709700 1 --2- 172.21.15.112:0/2127247757 >> v2:172.21.15.179:3300/0 conn(0x7f5d2c06d3b0 0x7f5d2c0cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.261+0000 7f5d33709700 1 -- 172.21.15.112:0/2127247757 >> 172.21.15.112:0/2127247757 conn(0x7f5d2c06cfb0 msgr2=0x7f5d2c0d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:46.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.261+0000 7f5d33709700 1 -- 172.21.15.112:0/2127247757 shutdown_connections 2023-10-06T04:39:46.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.261+0000 7f5d33709700 1 -- 172.21.15.112:0/2127247757 wait complete. 2023-10-06T04:39:46.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.262+0000 7f5d33709700 1 Processor -- start 2023-10-06T04:39:46.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.262+0000 7f5d33709700 1 -- start start 2023-10-06T04:39:46.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d33709700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d2c06d3b0 0x7f5d2c0b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d33709700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d2c159a20 0x7f5d2c0b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d33709700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d2c15a9f0 0x7f5d2c146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d33709700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c0b3d50 con 0x7f5d2c159a20 2023-10-06T04:39:46.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d33709700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c0b4c70 con 0x7f5d2c06d3b0 2023-10-06T04:39:46.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d33709700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c0b4340 con 0x7f5d2c15a9f0 2023-10-06T04:39:46.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d30ca4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d2c159a20 0x7f5d2c0b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d30ca4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d2c159a20 0x7f5d2c0b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34354/0 (socket says 172.21.15.112:34354) 2023-10-06T04:39:46.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d30ca4700 1 -- 172.21.15.112:0/1710717476 learned_addr learned my addr 172.21.15.112:0/1710717476 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:46.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d314a5700 1 --2- 172.21.15.112:0/1710717476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d2c06d3b0 0x7f5d2c0b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d31ca6700 1 --2- 172.21.15.112:0/1710717476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d2c15a9f0 0x7f5d2c146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d30ca4700 1 -- 172.21.15.112:0/1710717476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d2c15a9f0 msgr2=0x7f5d2c146db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d30ca4700 1 --2- 172.21.15.112:0/1710717476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d2c15a9f0 0x7f5d2c146db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d30ca4700 1 -- 172.21.15.112:0/1710717476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d2c06d3b0 msgr2=0x7f5d2c0b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d30ca4700 1 --2- 172.21.15.112:0/1710717476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d2c06d3b0 0x7f5d2c0b62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d30ca4700 1 -- 172.21.15.112:0/1710717476 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d28009a20 con 0x7f5d2c159a20 2023-10-06T04:39:46.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d31ca6700 1 --2- 172.21.15.112:0/1710717476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d2c15a9f0 0x7f5d2c146db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:46.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d30ca4700 1 --2- 172.21.15.112:0/1710717476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d2c159a20 0x7f5d2c0b3810 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00c880 tx=0x7f5d1c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:46.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d217fa700 1 -- 172.21.15.112:0/1710717476 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c011600 con 0x7f5d2c159a20 2023-10-06T04:39:46.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d217fa700 1 -- 172.21.15.112:0/1710717476 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c011780 con 0x7f5d2c159a20 2023-10-06T04:39:46.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d33709700 1 -- 172.21.15.112:0/1710717476 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2c0b4620 con 0x7f5d2c159a20 2023-10-06T04:39:46.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.263+0000 7f5d217fa700 1 -- 172.21.15.112:0/1710717476 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c011b40 con 0x7f5d2c159a20 2023-10-06T04:39:46.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.264+0000 7f5d33709700 1 -- 172.21.15.112:0/1710717476 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2c1472f0 con 0x7f5d2c159a20 2023-10-06T04:39:46.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.264+0000 7f5d33709700 1 -- 172.21.15.112:0/1710717476 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2c0b4ac0 con 0x7f5d2c159a20 2023-10-06T04:39:46.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.265+0000 7f5d217fa700 1 -- 172.21.15.112:0/1710717476 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d1c010350 con 0x7f5d2c159a20 2023-10-06T04:39:46.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.265+0000 7f5d217fa700 1 --2- 172.21.15.112:0/1710717476 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5d10066f30 0x7f5d100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.265+0000 7f5d217fa700 1 -- 172.21.15.112:0/1710717476 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5d1c084440 con 0x7f5d2c159a20 2023-10-06T04:39:46.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.265+0000 7f5d314a5700 1 --2- 172.21.15.112:0/1710717476 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5d10066f30 0x7f5d100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.266+0000 7f5d314a5700 1 --2- 172.21.15.112:0/1710717476 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5d10066f30 0x7f5d100693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009de0 tx=0x7f5d28019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:46.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.269+0000 7f5d217fa700 1 -- 172.21.15.112:0/1710717476 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d1c051550 con 0x7f5d2c159a20 2023-10-06T04:39:46.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.455+0000 7f5d33709700 1 -- 172.21.15.112:0/1710717476 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d2c06ec80 con 0x7f5d2c159a20 2023-10-06T04:39:46.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.456+0000 7f5d217fa700 1 -- 172.21.15.112:0/1710717476 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d1c054b70 con 0x7f5d2c159a20 2023-10-06T04:39:46.458 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-10-06T04:39:46.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.458+0000 7f5d33709700 1 -- 172.21.15.112:0/1710717476 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5d10066f30 msgr2=0x7f5d100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.458+0000 7f5d33709700 1 --2- 172.21.15.112:0/1710717476 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5d10066f30 0x7f5d100693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009de0 tx=0x7f5d28019000 comp rx=0 tx=0).stop 2023-10-06T04:39:46.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.458+0000 7f5d33709700 1 -- 172.21.15.112:0/1710717476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d2c159a20 msgr2=0x7f5d2c0b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.458+0000 7f5d33709700 1 --2- 172.21.15.112:0/1710717476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d2c159a20 0x7f5d2c0b3810 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00c880 tx=0x7f5d1c008040 comp rx=0 tx=0).stop 2023-10-06T04:39:46.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.458+0000 7f5d33709700 1 -- 172.21.15.112:0/1710717476 shutdown_connections 2023-10-06T04:39:46.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.458+0000 7f5d33709700 1 --2- 172.21.15.112:0/1710717476 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5d10066f30 0x7f5d100693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.458+0000 7f5d33709700 1 --2- 172.21.15.112:0/1710717476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d2c15a9f0 0x7f5d2c146db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.458+0000 7f5d33709700 1 --2- 172.21.15.112:0/1710717476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d2c06d3b0 0x7f5d2c0b62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.458+0000 7f5d33709700 1 --2- 172.21.15.112:0/1710717476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d2c159a20 0x7f5d2c0b3810 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.458+0000 7f5d33709700 1 -- 172.21.15.112:0/1710717476 >> 172.21.15.112:0/1710717476 conn(0x7f5d2c06cfb0 msgr2=0x7f5d2c0ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:46.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.458+0000 7f5d33709700 1 -- 172.21.15.112:0/1710717476 shutdown_connections 2023-10-06T04:39:46.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.458+0000 7f5d33709700 1 -- 172.21.15.112:0/1710717476 wait complete. 2023-10-06T04:39:46.472 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:46.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.586+0000 7fc252cd1700 1 Processor -- start 2023-10-06T04:39:46.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.586+0000 7fc252cd1700 1 -- start start 2023-10-06T04:39:46.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.587+0000 7fc252cd1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc24c06e030 0x7fc24c06ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.587+0000 7fc252cd1700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24c06e400 0x7fc24c06b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.587+0000 7fc252cd1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc24c159b20 con 0x7fc24c0aced0 2023-10-06T04:39:46.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.587+0000 7fc252cd1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24c06bf80 con 0x7fc24c06e030 2023-10-06T04:39:46.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.587+0000 7fc252cd1700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c0ada60 con 0x7fc24c06e400 2023-10-06T04:39:46.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.587+0000 7fc250a6d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc24c06e030 0x7fc24c06ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.587+0000 7fc250a6d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc24c06e030 0x7fc24c06ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34368/0 (socket says 172.21.15.112:34368) 2023-10-06T04:39:46.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.587+0000 7fc250a6d700 1 -- 172.21.15.112:0/1252263812 learned_addr learned my addr 172.21.15.112:0/1252263812 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:46.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.587+0000 7fc24bfff700 1 --2- 172.21.15.112:0/1252263812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24c06e400 0x7fc24c06b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.587+0000 7fc250a6d700 1 -- 172.21.15.112:0/1252263812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24c06e400 msgr2=0x7fc24c06b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:46.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.587+0000 7fc250a6d700 1 --2- 172.21.15.112:0/1252263812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24c06e400 0x7fc24c06b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.587+0000 7fc250a6d700 1 -- 172.21.15.112:0/1252263812 >> v1:172.21.15.112:6789/0 conn(0x7fc24c0aced0 legacy=0x7fc24c0ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.587+0000 7fc250a6d700 1 -- 172.21.15.112:0/1252263812 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24c0aca40 con 0x7fc24c06e030 2023-10-06T04:39:46.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.587+0000 7fc24bfff700 1 --2- 172.21.15.112:0/1252263812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24c06e400 0x7fc24c06b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:46.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.587+0000 7fc250a6d700 1 --2- 172.21.15.112:0/1252263812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc24c06e030 0x7fc24c06ae00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc2400099e0 tx=0x7fc240009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f781c7527486a55d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:46.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.588+0000 7fc24b7fe700 1 -- 172.21.15.112:0/1252263812 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24000b820 con 0x7fc24c06e030 2023-10-06T04:39:46.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.588+0000 7fc24b7fe700 1 -- 172.21.15.112:0/1252263812 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24000b980 con 0x7fc24c06e030 2023-10-06T04:39:46.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.588+0000 7fc24b7fe700 1 -- 172.21.15.112:0/1252263812 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24000bd20 con 0x7fc24c06e030 2023-10-06T04:39:46.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.588+0000 7fc252cd1700 1 -- 172.21.15.112:0/1252263812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc24c06e030 msgr2=0x7fc24c06ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.588+0000 7fc252cd1700 1 --2- 172.21.15.112:0/1252263812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc24c06e030 0x7fc24c06ae00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc2400099e0 tx=0x7fc240009250 comp rx=0 tx=0).stop 2023-10-06T04:39:46.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.588+0000 7fc252cd1700 1 -- 172.21.15.112:0/1252263812 shutdown_connections 2023-10-06T04:39:46.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.588+0000 7fc252cd1700 1 --2- 172.21.15.112:0/1252263812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc24c06e030 0x7fc24c06ae00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.588+0000 7fc252cd1700 1 --2- 172.21.15.112:0/1252263812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24c06e400 0x7fc24c06b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.588+0000 7fc252cd1700 1 -- 172.21.15.112:0/1252263812 >> 172.21.15.112:0/1252263812 conn(0x7fc24c06d230 msgr2=0x7fc24c0af580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:46.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.588+0000 7fc252cd1700 1 -- 172.21.15.112:0/1252263812 shutdown_connections 2023-10-06T04:39:46.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.588+0000 7fc252cd1700 1 -- 172.21.15.112:0/1252263812 wait complete. 2023-10-06T04:39:46.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.589+0000 7fc252cd1700 1 Processor -- start 2023-10-06T04:39:46.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.589+0000 7fc252cd1700 1 -- start start 2023-10-06T04:39:46.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.590+0000 7fc252cd1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc24c06e030 0x7fc24c1510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.590+0000 7fc252cd1700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24c06e400 0x7fc24c153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.590+0000 7fc252cd1700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc24c0aced0 0x7fc24c14fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.590+0000 7fc252cd1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c14f830 con 0x7fc24c06e030 2023-10-06T04:39:46.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.590+0000 7fc252cd1700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c14ec20 con 0x7fc24c0aced0 2023-10-06T04:39:46.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.590+0000 7fc252cd1700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c14ef00 con 0x7fc24c06e400 2023-10-06T04:39:46.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.590+0000 7fc250a6d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc24c06e030 0x7fc24c1510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.590+0000 7fc250a6d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc24c06e030 0x7fc24c1510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34374/0 (socket says 172.21.15.112:34374) 2023-10-06T04:39:46.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.590+0000 7fc250a6d700 1 -- 172.21.15.112:0/4021430605 learned_addr learned my addr 172.21.15.112:0/4021430605 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:46.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.590+0000 7fc250a6d700 1 -- 172.21.15.112:0/4021430605 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24c06e400 msgr2=0x7fc24c153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.590+0000 7fc250a6d700 1 --2- 172.21.15.112:0/4021430605 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24c06e400 0x7fc24c153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.590+0000 7fc250a6d700 1 -- 172.21.15.112:0/4021430605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc24c0aced0 msgr2=0x7fc24c14fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.590+0000 7fc250a6d700 1 --2- 172.21.15.112:0/4021430605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc24c0aced0 0x7fc24c14fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.590+0000 7fc250a6d700 1 -- 172.21.15.112:0/4021430605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2400094f0 con 0x7fc24c06e030 2023-10-06T04:39:46.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.591+0000 7fc250a6d700 1 --2- 172.21.15.112:0/4021430605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc24c06e030 0x7fc24c1510b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc2400090b0 tx=0x7fc240017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:46.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.591+0000 7fc248ff9700 1 -- 172.21.15.112:0/4021430605 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24001d640 con 0x7fc24c06e030 2023-10-06T04:39:46.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.591+0000 7fc248ff9700 1 -- 172.21.15.112:0/4021430605 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc240021070 con 0x7fc24c06e030 2023-10-06T04:39:46.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.591+0000 7fc252cd1700 1 -- 172.21.15.112:0/4021430605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24c14f1e0 con 0x7fc24c06e030 2023-10-06T04:39:46.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.591+0000 7fc248ff9700 1 -- 172.21.15.112:0/4021430605 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24001da10 con 0x7fc24c06e030 2023-10-06T04:39:46.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.591+0000 7fc252cd1700 1 -- 172.21.15.112:0/4021430605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24c1515f0 con 0x7fc24c06e030 2023-10-06T04:39:46.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.592+0000 7fc252cd1700 1 -- 172.21.15.112:0/4021430605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc24c05f230 con 0x7fc24c06e030 2023-10-06T04:39:46.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.592+0000 7fc248ff9700 1 -- 172.21.15.112:0/4021430605 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc24001a430 con 0x7fc24c06e030 2023-10-06T04:39:46.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.592+0000 7fc248ff9700 1 --2- 172.21.15.112:0/4021430605 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc230066f30 0x7fc2300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.593+0000 7fc248ff9700 1 -- 172.21.15.112:0/4021430605 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc240023070 con 0x7fc24c06e030 2023-10-06T04:39:46.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.593+0000 7fc24bfff700 1 --2- 172.21.15.112:0/4021430605 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc230066f30 0x7fc2300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.593+0000 7fc24bfff700 1 --2- 172.21.15.112:0/4021430605 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc230066f30 0x7fc2300693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc238006fd0 tx=0x7fc238008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:46.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.597+0000 7fc248ff9700 1 -- 172.21.15.112:0/4021430605 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2400558b0 con 0x7fc24c06e030 2023-10-06T04:39:46.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.780+0000 7fc252cd1700 1 -- 172.21.15.112:0/4021430605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc24c06b9c0 con 0x7fc24c06e030 2023-10-06T04:39:46.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.781+0000 7fc248ff9700 1 -- 172.21.15.112:0/4021430605 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7fc240058ed0 con 0x7fc24c06e030 2023-10-06T04:39:46.783 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:46.784 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:39:22.637355+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:18.657040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:19.972295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:46.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.783+0000 7fc252cd1700 1 -- 172.21.15.112:0/4021430605 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc230066f30 msgr2=0x7fc2300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.783+0000 7fc252cd1700 1 --2- 172.21.15.112:0/4021430605 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc230066f30 0x7fc2300693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc238006fd0 tx=0x7fc238008040 comp rx=0 tx=0).stop 2023-10-06T04:39:46.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.783+0000 7fc252cd1700 1 -- 172.21.15.112:0/4021430605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc24c06e030 msgr2=0x7fc24c1510b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.783+0000 7fc252cd1700 1 --2- 172.21.15.112:0/4021430605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc24c06e030 0x7fc24c1510b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc2400090b0 tx=0x7fc240017000 comp rx=0 tx=0).stop 2023-10-06T04:39:46.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.783+0000 7fc252cd1700 1 -- 172.21.15.112:0/4021430605 shutdown_connections 2023-10-06T04:39:46.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.783+0000 7fc252cd1700 1 --2- 172.21.15.112:0/4021430605 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc230066f30 0x7fc2300693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.783+0000 7fc252cd1700 1 --2- 172.21.15.112:0/4021430605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc24c0aced0 0x7fc24c14fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.783+0000 7fc252cd1700 1 --2- 172.21.15.112:0/4021430605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc24c06e030 0x7fc24c1510b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.783+0000 7fc252cd1700 1 --2- 172.21.15.112:0/4021430605 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24c06e400 0x7fc24c153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.783+0000 7fc252cd1700 1 -- 172.21.15.112:0/4021430605 >> 172.21.15.112:0/4021430605 conn(0x7fc24c06d230 msgr2=0x7fc24c0cc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:46.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.783+0000 7fc252cd1700 1 -- 172.21.15.112:0/4021430605 shutdown_connections 2023-10-06T04:39:46.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.783+0000 7fc252cd1700 1 -- 172.21.15.112:0/4021430605 wait complete. 2023-10-06T04:39:46.798 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:13.929254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:39:14.321892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:39:18.657040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:39:19.972295+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:39:46.799 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:39:46.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.913+0000 7fa80515c700 1 Processor -- start 2023-10-06T04:39:46.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.913+0000 7fa80515c700 1 -- start start 2023-10-06T04:39:46.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.914+0000 7fa80515c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa800157220 0x7fa8000d0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.914+0000 7fa80515c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8000c7da0 0x7fa8000c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.914+0000 7fa80515c700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8000cab40 con 0x7fa8000d0a70 2023-10-06T04:39:46.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.914+0000 7fa80515c700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8000c81e0 con 0x7fa800157220 2023-10-06T04:39:46.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.914+0000 7fa80515c700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8000cceb0 con 0x7fa8000c7da0 2023-10-06T04:39:46.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.914+0000 7fa7fffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa800157220 0x7fa8000d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.914+0000 7fa80495b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8000c7da0 0x7fa8000c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.914+0000 7fa7ff7fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fa8000d0a70 0x7fa8000c7690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.112:54784/0 (socket says 172.21.15.112:54784) 2023-10-06T04:39:46.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.914+0000 7fa7ff7fe700 1 -- 172.21.15.112:0/3388621112 learned_addr learned my addr 172.21.15.112:0/3388621112 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:46.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.914+0000 7fa7fffff700 1 -- 172.21.15.112:0/3388621112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8000c7da0 msgr2=0x7fa8000c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:46.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.914+0000 7fa7fffff700 1 --2- 172.21.15.112:0/3388621112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8000c7da0 0x7fa8000c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.914+0000 7fa7fffff700 1 -- 172.21.15.112:0/3388621112 >> v1:172.21.15.179:6789/0 conn(0x7fa8000d0a70 legacy=0x7fa8000c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.914+0000 7fa7fffff700 1 -- 172.21.15.112:0/3388621112 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8000d0ee0 con 0x7fa800157220 2023-10-06T04:39:46.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.914+0000 7fa80495b700 1 --2- 172.21.15.112:0/3388621112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8000c7da0 0x7fa8000c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:46.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.914+0000 7fa7feffd700 1 -- 172.21.15.112:0/3388621112 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4082150510 0 0) 0x7fa8000cab40 con 0x7fa8000d0a70 2023-10-06T04:39:46.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.915+0000 7fa7fffff700 1 --2- 172.21.15.112:0/3388621112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa800157220 0x7fa8000d0530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40098e0 tx=0x7fa7f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=408e4eddfb7f6d57 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:46.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.915+0000 7fa7feffd700 1 -- 172.21.15.112:0/3388621112 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400b640 con 0x7fa800157220 2023-10-06T04:39:46.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.915+0000 7fa7feffd700 1 -- 172.21.15.112:0/3388621112 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f400b7a0 con 0x7fa800157220 2023-10-06T04:39:46.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.915+0000 7fa7feffd700 1 -- 172.21.15.112:0/3388621112 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400bb40 con 0x7fa800157220 2023-10-06T04:39:46.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.915+0000 7fa80515c700 1 -- 172.21.15.112:0/3388621112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa800157220 msgr2=0x7fa8000d0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.915+0000 7fa80515c700 1 --2- 172.21.15.112:0/3388621112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa800157220 0x7fa8000d0530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40098e0 tx=0x7fa7f40091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.915+0000 7fa80515c700 1 -- 172.21.15.112:0/3388621112 shutdown_connections 2023-10-06T04:39:46.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.915+0000 7fa80515c700 1 --2- 172.21.15.112:0/3388621112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8000c7da0 0x7fa8000c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.915+0000 7fa80515c700 1 --2- 172.21.15.112:0/3388621112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa800157220 0x7fa8000d0530 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.915+0000 7fa80515c700 1 -- 172.21.15.112:0/3388621112 >> 172.21.15.112:0/3388621112 conn(0x7fa80006c7d0 msgr2=0x7fa80006cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:46.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.915+0000 7fa80515c700 1 -- 172.21.15.112:0/3388621112 shutdown_connections 2023-10-06T04:39:46.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.915+0000 7fa80515c700 1 -- 172.21.15.112:0/3388621112 wait complete. 2023-10-06T04:39:46.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.916+0000 7fa80515c700 1 Processor -- start 2023-10-06T04:39:46.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.917+0000 7fa80515c700 1 -- start start 2023-10-06T04:39:46.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.917+0000 7fa80515c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8000c7da0 0x7fa800155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.917+0000 7fa80515c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8000d0a70 0x7fa80015a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.917+0000 7fa80515c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa800157220 0x7fa80015aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.917+0000 7fa80515c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8001585c0 con 0x7fa8000d0a70 2023-10-06T04:39:46.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.917+0000 7fa80515c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa800158e60 con 0x7fa8000c7da0 2023-10-06T04:39:46.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.917+0000 7fa80515c700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8000c67a0 con 0x7fa800157220 2023-10-06T04:39:46.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.917+0000 7fa7ff7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8000d0a70 0x7fa80015a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.917+0000 7fa7ff7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8000d0a70 0x7fa80015a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34376/0 (socket says 172.21.15.112:34376) 2023-10-06T04:39:46.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.917+0000 7fa7ff7fe700 1 -- 172.21.15.112:0/3427426514 learned_addr learned my addr 172.21.15.112:0/3427426514 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:46.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.918+0000 7fa7fffff700 1 --2- 172.21.15.112:0/3427426514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8000c7da0 0x7fa800155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.918+0000 7fa80495b700 1 --2- 172.21.15.112:0/3427426514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa800157220 0x7fa80015aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.918+0000 7fa7ff7fe700 1 -- 172.21.15.112:0/3427426514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa800157220 msgr2=0x7fa80015aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.918+0000 7fa7ff7fe700 1 --2- 172.21.15.112:0/3427426514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa800157220 0x7fa80015aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.918+0000 7fa7ff7fe700 1 -- 172.21.15.112:0/3427426514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8000c7da0 msgr2=0x7fa800155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:46.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.918+0000 7fa7ff7fe700 1 --2- 172.21.15.112:0/3427426514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8000c7da0 0x7fa800155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:46.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.918+0000 7fa7ff7fe700 1 -- 172.21.15.112:0/3427426514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f8009a20 con 0x7fa8000d0a70 2023-10-06T04:39:46.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.918+0000 7fa7fffff700 1 --2- 172.21.15.112:0/3427426514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8000c7da0 0x7fa800155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:46.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.918+0000 7fa80495b700 1 --2- 172.21.15.112:0/3427426514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa800157220 0x7fa80015aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:46.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.918+0000 7fa7ff7fe700 1 --2- 172.21.15.112:0/3427426514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8000d0a70 0x7fa80015a960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000c610 tx=0x7fa7f0001030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:46.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.918+0000 7fa7e7fff700 1 -- 172.21.15.112:0/3427426514 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0005b80 con 0x7fa8000d0a70 2023-10-06T04:39:46.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.918+0000 7fa7e7fff700 1 -- 172.21.15.112:0/3427426514 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f0005d00 con 0x7fa8000d0a70 2023-10-06T04:39:46.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.918+0000 7fa80515c700 1 -- 172.21.15.112:0/3427426514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f4009420 con 0x7fa8000d0a70 2023-10-06T04:39:46.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.918+0000 7fa7e7fff700 1 -- 172.21.15.112:0/3427426514 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0007320 con 0x7fa8000d0a70 2023-10-06T04:39:46.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.918+0000 7fa80515c700 1 -- 172.21.15.112:0/3427426514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa800158af0 con 0x7fa8000d0a70 2023-10-06T04:39:46.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.919+0000 7fa80515c700 1 -- 172.21.15.112:0/3427426514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80005f230 con 0x7fa8000d0a70 2023-10-06T04:39:46.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.919+0000 7fa7e7fff700 1 -- 172.21.15.112:0/3427426514 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa7f001b3b0 con 0x7fa8000d0a70 2023-10-06T04:39:46.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.920+0000 7fa7e7fff700 1 --2- 172.21.15.112:0/3427426514 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa7ec066f30 0x7fa7ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:46.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.920+0000 7fa7e7fff700 1 -- 172.21.15.112:0/3427426514 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa7f0083bf0 con 0x7fa8000d0a70 2023-10-06T04:39:46.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.920+0000 7fa7fffff700 1 --2- 172.21.15.112:0/3427426514 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa7ec066f30 0x7fa7ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:46.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.920+0000 7fa7fffff700 1 --2- 172.21.15.112:0/3427426514 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa7ec066f30 0x7fa7ec0693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40093f0 tx=0x7fa7f4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:46.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:46.924+0000 7fa7e7fff700 1 -- 172.21.15.112:0/3427426514 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7f0050d00 con 0x7fa8000d0a70 2023-10-06T04:39:47.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.103+0000 7fa80515c700 1 -- 172.21.15.112:0/3427426514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa800158fa0 con 0x7fa8000d0a70 2023-10-06T04:39:47.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.104+0000 7fa7e7fff700 1 -- 172.21.15.112:0/3427426514 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa7f0017070 con 0x7fa8000d0a70 2023-10-06T04:39:47.106 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-10-06T04:39:47.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.106+0000 7fa80515c700 1 -- 172.21.15.112:0/3427426514 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa7ec066f30 msgr2=0x7fa7ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:47.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.106+0000 7fa80515c700 1 --2- 172.21.15.112:0/3427426514 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa7ec066f30 0x7fa7ec0693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40093f0 tx=0x7fa7f4017000 comp rx=0 tx=0).stop 2023-10-06T04:39:47.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.106+0000 7fa80515c700 1 -- 172.21.15.112:0/3427426514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8000d0a70 msgr2=0x7fa80015a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:47.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.106+0000 7fa80515c700 1 --2- 172.21.15.112:0/3427426514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8000d0a70 0x7fa80015a960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000c610 tx=0x7fa7f0001030 comp rx=0 tx=0).stop 2023-10-06T04:39:47.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.106+0000 7fa80515c700 1 -- 172.21.15.112:0/3427426514 shutdown_connections 2023-10-06T04:39:47.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.106+0000 7fa80515c700 1 --2- 172.21.15.112:0/3427426514 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa7ec066f30 0x7fa7ec0693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.106+0000 7fa80515c700 1 --2- 172.21.15.112:0/3427426514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa800157220 0x7fa80015aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.106+0000 7fa80515c700 1 --2- 172.21.15.112:0/3427426514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8000c7da0 0x7fa800155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.106+0000 7fa80515c700 1 --2- 172.21.15.112:0/3427426514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8000d0a70 0x7fa80015a960 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.106+0000 7fa80515c700 1 -- 172.21.15.112:0/3427426514 >> 172.21.15.112:0/3427426514 conn(0x7fa80006c7d0 msgr2=0x7fa8000cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:47.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.106+0000 7fa80515c700 1 -- 172.21.15.112:0/3427426514 shutdown_connections 2023-10-06T04:39:47.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.106+0000 7fa80515c700 1 -- 172.21.15.112:0/3427426514 wait complete. 2023-10-06T04:39:47.120 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:39:47.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.235+0000 7fdcc5277700 1 Processor -- start 2023-10-06T04:39:47.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.235+0000 7fdcc5277700 1 -- start start 2023-10-06T04:39:47.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.236+0000 7fdcc5277700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdcc00cbf00 0x7fdcc015b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:47.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.236+0000 7fdcc5277700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdcc006d3b0 0x7fdcc015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:47.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.236+0000 7fdcc5277700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc015af50 con 0x7fdcc0159a20 2023-10-06T04:39:47.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.236+0000 7fdcc5277700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc00cca70 con 0x7fdcc006d3b0 2023-10-06T04:39:47.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.236+0000 7fdcc5277700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc008a080 con 0x7fdcc00cbf00 2023-10-06T04:39:47.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.236+0000 7fdcbf7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdcc006d3b0 0x7fdcc015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:47.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.236+0000 7fdcbeffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fdcc0159a20 0x7fdcc00cb7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46654/0 (socket says 172.21.15.112:46654) 2023-10-06T04:39:47.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.236+0000 7fdcbeffd700 1 -- 172.21.15.112:0/1514252158 learned_addr learned my addr 172.21.15.112:0/1514252158 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:47.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.236+0000 7fdcb67fc700 1 --2- 172.21.15.112:0/1514252158 >> v2:172.21.15.179:3300/0 conn(0x7fdcc00cbf00 0x7fdcc015b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:47.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.236+0000 7fdcbf7fe700 1 -- 172.21.15.112:0/1514252158 >> v2:172.21.15.179:3300/0 conn(0x7fdcc00cbf00 msgr2=0x7fdcc015b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:47.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.236+0000 7fdcbf7fe700 1 --2- 172.21.15.112:0/1514252158 >> v2:172.21.15.179:3300/0 conn(0x7fdcc00cbf00 0x7fdcc015b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.236+0000 7fdcbf7fe700 1 -- 172.21.15.112:0/1514252158 >> v1:172.21.15.112:6789/0 conn(0x7fdcc0159a20 legacy=0x7fdcc00cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:47.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.236+0000 7fdcbe7fc700 1 -- 172.21.15.112:0/1514252158 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925713366 0 0) 0x7fdcc015af50 con 0x7fdcc0159a20 2023-10-06T04:39:47.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.237+0000 7fdcbf7fe700 1 -- 172.21.15.112:0/1514252158 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc00cae50 con 0x7fdcc006d3b0 2023-10-06T04:39:47.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.237+0000 7fdcbf7fe700 1 --2- 172.21.15.112:0/1514252158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcc006d3b0 0x7fdcc015bc50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdcc008ac00 tx=0x7fdcb8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2944ad8c92a9bdbe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:47.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.237+0000 7fdcbe7fc700 1 -- 172.21.15.112:0/1514252158 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb800e070 con 0x7fdcc006d3b0 2023-10-06T04:39:47.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.237+0000 7fdcbe7fc700 1 -- 172.21.15.112:0/1514252158 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb800bc30 con 0x7fdcc006d3b0 2023-10-06T04:39:47.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.237+0000 7fdcbe7fc700 1 -- 172.21.15.112:0/1514252158 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8012430 con 0x7fdcc006d3b0 2023-10-06T04:39:47.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.237+0000 7fdcc5277700 1 -- 172.21.15.112:0/1514252158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcc006d3b0 msgr2=0x7fdcc015bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:47.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.237+0000 7fdcc5277700 1 --2- 172.21.15.112:0/1514252158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcc006d3b0 0x7fdcc015bc50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdcc008ac00 tx=0x7fdcb8009780 comp rx=0 tx=0).stop 2023-10-06T04:39:47.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.237+0000 7fdcc5277700 1 -- 172.21.15.112:0/1514252158 shutdown_connections 2023-10-06T04:39:47.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.237+0000 7fdcc5277700 1 --2- 172.21.15.112:0/1514252158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcc006d3b0 0x7fdcc015bc50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.237+0000 7fdcc5277700 1 --2- 172.21.15.112:0/1514252158 >> v2:172.21.15.179:3300/0 conn(0x7fdcc00cbf00 0x7fdcc015b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.237+0000 7fdcc5277700 1 -- 172.21.15.112:0/1514252158 >> 172.21.15.112:0/1514252158 conn(0x7fdcc006cfb0 msgr2=0x7fdcc00d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:47.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.237+0000 7fdcc5277700 1 -- 172.21.15.112:0/1514252158 shutdown_connections 2023-10-06T04:39:47.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.237+0000 7fdcc5277700 1 -- 172.21.15.112:0/1514252158 wait complete. 2023-10-06T04:39:47.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.239+0000 7fdcc5277700 1 Processor -- start 2023-10-06T04:39:47.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.239+0000 7fdcc5277700 1 -- start start 2023-10-06T04:39:47.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.239+0000 7fdcc5277700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcc006d3b0 0x7fdcc014f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:47.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.239+0000 7fdcc5277700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcc00cbf00 0x7fdcc00b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:47.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.239+0000 7fdcc5277700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcc0159a20 0x7fdcc00b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:47.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.239+0000 7fdcc5277700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc00b5500 con 0x7fdcc0159a20 2023-10-06T04:39:47.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.239+0000 7fdcc5277700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc014fa60 con 0x7fdcc006d3b0 2023-10-06T04:39:47.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.239+0000 7fdcc5277700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc00b66d0 con 0x7fdcc00cbf00 2023-10-06T04:39:47.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.239+0000 7fdcbf7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcc0159a20 0x7fdcc00b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:47.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.239+0000 7fdcbf7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcc0159a20 0x7fdcc00b2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34398/0 (socket says 172.21.15.112:34398) 2023-10-06T04:39:47.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.239+0000 7fdcbf7fe700 1 -- 172.21.15.112:0/373793452 learned_addr learned my addr 172.21.15.112:0/373793452 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:47.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.240+0000 7fdcbf7fe700 1 -- 172.21.15.112:0/373793452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcc00cbf00 msgr2=0x7fdcc00b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:47.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.240+0000 7fdcb67fc700 1 --2- 172.21.15.112:0/373793452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcc00cbf00 0x7fdcc00b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:47.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.240+0000 7fdcbeffd700 1 --2- 172.21.15.112:0/373793452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcc006d3b0 0x7fdcc014f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:47.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.240+0000 7fdcbf7fe700 1 --2- 172.21.15.112:0/373793452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcc00cbf00 0x7fdcc00b26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.240+0000 7fdcbf7fe700 1 -- 172.21.15.112:0/373793452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcc006d3b0 msgr2=0x7fdcc014f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:47.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.240+0000 7fdcbf7fe700 1 --2- 172.21.15.112:0/373793452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcc006d3b0 0x7fdcc014f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.240+0000 7fdcbf7fe700 1 -- 172.21.15.112:0/373793452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb8009a20 con 0x7fdcc0159a20 2023-10-06T04:39:47.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.240+0000 7fdcbf7fe700 1 --2- 172.21.15.112:0/373793452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcc0159a20 0x7fdcc00b2bf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdcc008ab00 tx=0x7fdcb8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:47.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.240+0000 7fdcb77fe700 1 -- 172.21.15.112:0/373793452 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8012e60 con 0x7fdcc0159a20 2023-10-06T04:39:47.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.240+0000 7fdcb77fe700 1 -- 172.21.15.112:0/373793452 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb801d630 con 0x7fdcc0159a20 2023-10-06T04:39:47.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.240+0000 7fdcb77fe700 1 -- 172.21.15.112:0/373793452 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb801d9f0 con 0x7fdcc0159a20 2023-10-06T04:39:47.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.240+0000 7fdcc5277700 1 -- 172.21.15.112:0/373793452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc015deb0 con 0x7fdcc0159a20 2023-10-06T04:39:47.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.240+0000 7fdcc5277700 1 -- 172.21.15.112:0/373793452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc015e470 con 0x7fdcc0159a20 2023-10-06T04:39:47.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.241+0000 7fdcc5277700 1 -- 172.21.15.112:0/373793452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc005f230 con 0x7fdcc0159a20 2023-10-06T04:39:47.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.241+0000 7fdcb77fe700 1 -- 172.21.15.112:0/373793452 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdcb8024070 con 0x7fdcc0159a20 2023-10-06T04:39:47.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.242+0000 7fdcb77fe700 1 --2- 172.21.15.112:0/373793452 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fdca0066f30 0x7fdca00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:47.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.242+0000 7fdcb77fe700 1 -- 172.21.15.112:0/373793452 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdcb8086ed0 con 0x7fdcc0159a20 2023-10-06T04:39:47.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.242+0000 7fdcbeffd700 1 --2- 172.21.15.112:0/373793452 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fdca0066f30 0x7fdca00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:47.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.242+0000 7fdcbeffd700 1 --2- 172.21.15.112:0/373793452 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fdca0066f30 0x7fdca00693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0001750 tx=0x7fdcb0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:47.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.246+0000 7fdcb77fe700 1 -- 172.21.15.112:0/373793452 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdcb8053fe0 con 0x7fdcc0159a20 2023-10-06T04:39:47.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.427+0000 7fdcc5277700 1 -- 172.21.15.112:0/373793452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdcc00cb0f0 con 0x7fdcc0159a20 2023-10-06T04:39:47.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.428+0000 7fdcb77fe700 1 -- 172.21.15.112:0/373793452 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdcb802c020 con 0x7fdcc0159a20 2023-10-06T04:39:47.430 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-10-06T04:39:47.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.430+0000 7fdcc5277700 1 -- 172.21.15.112:0/373793452 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fdca0066f30 msgr2=0x7fdca00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:47.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.430+0000 7fdcc5277700 1 --2- 172.21.15.112:0/373793452 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fdca0066f30 0x7fdca00693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0001750 tx=0x7fdcb0009040 comp rx=0 tx=0).stop 2023-10-06T04:39:47.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.430+0000 7fdcc5277700 1 -- 172.21.15.112:0/373793452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcc0159a20 msgr2=0x7fdcc00b2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:47.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.430+0000 7fdcc5277700 1 --2- 172.21.15.112:0/373793452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcc0159a20 0x7fdcc00b2bf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdcc008ab00 tx=0x7fdcb8019000 comp rx=0 tx=0).stop 2023-10-06T04:39:47.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.430+0000 7fdcc5277700 1 -- 172.21.15.112:0/373793452 shutdown_connections 2023-10-06T04:39:47.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.430+0000 7fdcc5277700 1 --2- 172.21.15.112:0/373793452 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fdca0066f30 0x7fdca00693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.430+0000 7fdcc5277700 1 --2- 172.21.15.112:0/373793452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcc0159a20 0x7fdcc00b2bf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.430+0000 7fdcc5277700 1 --2- 172.21.15.112:0/373793452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcc006d3b0 0x7fdcc014f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.430+0000 7fdcc5277700 1 --2- 172.21.15.112:0/373793452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcc00cbf00 0x7fdcc00b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.430+0000 7fdcc5277700 1 -- 172.21.15.112:0/373793452 >> 172.21.15.112:0/373793452 conn(0x7fdcc006cfb0 msgr2=0x7fdcc006ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:47.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.430+0000 7fdcc5277700 1 -- 172.21.15.112:0/373793452 shutdown_connections 2023-10-06T04:39:47.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.430+0000 7fdcc5277700 1 -- 172.21.15.112:0/373793452 wait complete. 2023-10-06T04:39:47.444 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:39:47.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.561+0000 7f2f92e81700 1 Processor -- start 2023-10-06T04:39:47.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.561+0000 7f2f92e81700 1 -- start start 2023-10-06T04:39:47.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.562+0000 7f2f92e81700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f8c1575b0 0x7f2f8c15be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:47.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.562+0000 7f2f92e81700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2f8c157980 0x7f2f8c0cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:47.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.562+0000 7f2f92e81700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f8c0cd6d0 con 0x7f2f8c0ce0a0 2023-10-06T04:39:47.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.562+0000 7f2f92e81700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8c0ccac0 con 0x7f2f8c157980 2023-10-06T04:39:47.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.562+0000 7f2f92e81700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0ccda0 con 0x7f2f8c1575b0 2023-10-06T04:39:47.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.562+0000 7f2f90c1d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f8c1575b0 0x7f2f8c15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:47.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.562+0000 7f2f8bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2f8c157980 0x7f2f8c0cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:47.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.562+0000 7f2f90c1d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f8c1575b0 0x7f2f8c15be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.112:39522/0 (socket says 172.21.15.112:39522) 2023-10-06T04:39:47.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.562+0000 7f2f90c1d700 1 -- 172.21.15.112:0/3793417831 learned_addr learned my addr 172.21.15.112:0/3793417831 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:47.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.562+0000 7f2f90c1d700 1 -- 172.21.15.112:0/3793417831 >> v2:172.21.15.179:3300/0 conn(0x7f2f8c157980 msgr2=0x7f2f8c0cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:47.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.562+0000 7f2f90c1d700 1 --2- 172.21.15.112:0/3793417831 >> v2:172.21.15.179:3300/0 conn(0x7f2f8c157980 0x7f2f8c0cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.562+0000 7f2f90c1d700 1 -- 172.21.15.112:0/3793417831 >> v1:172.21.15.179:6789/0 conn(0x7f2f8c0ce0a0 legacy=0x7f2f8c0b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:47.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.562+0000 7f2f90c1d700 1 -- 172.21.15.112:0/3793417831 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c0cd080 con 0x7f2f8c1575b0 2023-10-06T04:39:47.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.563+0000 7f2f90c1d700 1 --2- 172.21.15.112:0/3793417831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f8c1575b0 0x7f2f8c15be00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009f20 tx=0x7f2f84009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5372810ab7234a60 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:47.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.563+0000 7f2f8b7fe700 1 -- 172.21.15.112:0/3793417831 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8400e070 con 0x7f2f8c1575b0 2023-10-06T04:39:47.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.563+0000 7f2f8b7fe700 1 -- 172.21.15.112:0/3793417831 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8400b9d0 con 0x7f2f8c1575b0 2023-10-06T04:39:47.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.563+0000 7f2f8b7fe700 1 -- 172.21.15.112:0/3793417831 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f840092e0 con 0x7f2f8c1575b0 2023-10-06T04:39:47.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.563+0000 7f2f92e81700 1 -- 172.21.15.112:0/3793417831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f8c1575b0 msgr2=0x7f2f8c15be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:47.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.563+0000 7f2f92e81700 1 --2- 172.21.15.112:0/3793417831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f8c1575b0 0x7f2f8c15be00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009f20 tx=0x7f2f84009840 comp rx=0 tx=0).stop 2023-10-06T04:39:47.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.563+0000 7f2f92e81700 1 -- 172.21.15.112:0/3793417831 shutdown_connections 2023-10-06T04:39:47.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.563+0000 7f2f92e81700 1 --2- 172.21.15.112:0/3793417831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f8c1575b0 0x7f2f8c15be00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.563+0000 7f2f92e81700 1 --2- 172.21.15.112:0/3793417831 >> v2:172.21.15.179:3300/0 conn(0x7f2f8c157980 0x7f2f8c0cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.563+0000 7f2f92e81700 1 -- 172.21.15.112:0/3793417831 >> 172.21.15.112:0/3793417831 conn(0x7f2f8c0631f0 msgr2=0x7f2f8c0635f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:47.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.563+0000 7f2f92e81700 1 -- 172.21.15.112:0/3793417831 shutdown_connections 2023-10-06T04:39:47.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.563+0000 7f2f92e81700 1 -- 172.21.15.112:0/3793417831 wait complete. 2023-10-06T04:39:47.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.564+0000 7f2f92e81700 1 Processor -- start 2023-10-06T04:39:47.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.565+0000 7f2f92e81700 1 -- start start 2023-10-06T04:39:47.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.565+0000 7f2f92e81700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f8c0ce0a0 0x7f2f8c0c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:47.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.565+0000 7f2f92e81700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f8c1575b0 0x7f2f8c16b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:47.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.565+0000 7f2f92e81700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f8c157980 0x7f2f8c1671e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:47.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.565+0000 7f2f92e81700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0ca9e0 con 0x7f2f8c1575b0 2023-10-06T04:39:47.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.565+0000 7f2f92e81700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c142ef0 con 0x7f2f8c157980 2023-10-06T04:39:47.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.565+0000 7f2f92e81700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0ca140 con 0x7f2f8c0ce0a0 2023-10-06T04:39:47.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.565+0000 7f2f8bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f8c1575b0 0x7f2f8c16b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:47.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.565+0000 7f2f8bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f8c1575b0 0x7f2f8c16b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34410/0 (socket says 172.21.15.112:34410) 2023-10-06T04:39:47.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.565+0000 7f2f8bfff700 1 -- 172.21.15.112:0/1390833297 learned_addr learned my addr 172.21.15.112:0/1390833297 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:47.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.566+0000 7f2f90c1d700 1 --2- 172.21.15.112:0/1390833297 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f8c0ce0a0 0x7f2f8c0c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:47.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.566+0000 7f2f9141e700 1 --2- 172.21.15.112:0/1390833297 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f8c157980 0x7f2f8c1671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:47.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.566+0000 7f2f8bfff700 1 -- 172.21.15.112:0/1390833297 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f8c0ce0a0 msgr2=0x7f2f8c0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:47.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.566+0000 7f2f8bfff700 1 --2- 172.21.15.112:0/1390833297 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f8c0ce0a0 0x7f2f8c0c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.566+0000 7f2f8bfff700 1 -- 172.21.15.112:0/1390833297 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f8c157980 msgr2=0x7f2f8c1671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:47.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.566+0000 7f2f8bfff700 1 --2- 172.21.15.112:0/1390833297 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f8c157980 0x7f2f8c1671e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.566+0000 7f2f8bfff700 1 -- 172.21.15.112:0/1390833297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f84009ae0 con 0x7f2f8c1575b0 2023-10-06T04:39:47.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.566+0000 7f2f8bfff700 1 --2- 172.21.15.112:0/1390833297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f8c1575b0 0x7f2f8c16b4f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000ec80 tx=0x7f2f800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:47.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.566+0000 7f2f88ff9700 1 -- 172.21.15.112:0/1390833297 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8000c850 con 0x7f2f8c1575b0 2023-10-06T04:39:47.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.566+0000 7f2f88ff9700 1 -- 172.21.15.112:0/1390833297 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8000c9b0 con 0x7f2f8c1575b0 2023-10-06T04:39:47.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.566+0000 7f2f92e81700 1 -- 172.21.15.112:0/1390833297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8c0ca420 con 0x7f2f8c1575b0 2023-10-06T04:39:47.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.566+0000 7f2f88ff9700 1 -- 172.21.15.112:0/1390833297 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8000cd50 con 0x7f2f8c1575b0 2023-10-06T04:39:47.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.566+0000 7f2f92e81700 1 -- 172.21.15.112:0/1390833297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8c0c9de0 con 0x7f2f8c1575b0 2023-10-06T04:39:47.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.567+0000 7f2f92e81700 1 -- 172.21.15.112:0/1390833297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8c1430a0 con 0x7f2f8c1575b0 2023-10-06T04:39:47.573 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.567+0000 7f2f88ff9700 1 -- 172.21.15.112:0/1390833297 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f80013680 con 0x7f2f8c1575b0 2023-10-06T04:39:47.573 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.568+0000 7f2f88ff9700 1 --2- 172.21.15.112:0/1390833297 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2f78066f30 0x7f2f780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:47.573 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.568+0000 7f2f88ff9700 1 -- 172.21.15.112:0/1390833297 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2f800848b0 con 0x7f2f8c1575b0 2023-10-06T04:39:47.573 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.568+0000 7f2f90c1d700 1 --2- 172.21.15.112:0/1390833297 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2f78066f30 0x7f2f780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:47.573 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.568+0000 7f2f90c1d700 1 --2- 172.21.15.112:0/1390833297 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2f78066f30 0x7f2f780693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009880 tx=0x7f2f84018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:47.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.572+0000 7f2f88ff9700 1 -- 172.21.15.112:0/1390833297 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f8c1430a0 con 0x7f2f8c1575b0 2023-10-06T04:39:47.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.752+0000 7f2f92e81700 1 -- 172.21.15.112:0/1390833297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2f8c142cc0 con 0x7f2f8c1575b0 2023-10-06T04:39:47.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.753+0000 7f2f88ff9700 1 -- 172.21.15.112:0/1390833297 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2f800519c0 con 0x7f2f8c1575b0 2023-10-06T04:39:47.755 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-10-06T04:39:47.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.755+0000 7f2f92e81700 1 -- 172.21.15.112:0/1390833297 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2f78066f30 msgr2=0x7f2f780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.755+0000 7f2f92e81700 1 --2- 172.21.15.112:0/1390833297 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2f78066f30 0x7f2f780693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009880 tx=0x7f2f84018000 comp rx=0 tx=0).stop 2023-10-06T04:39:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.755+0000 7f2f92e81700 1 -- 172.21.15.112:0/1390833297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f8c1575b0 msgr2=0x7f2f8c16b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.755+0000 7f2f92e81700 1 --2- 172.21.15.112:0/1390833297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f8c1575b0 0x7f2f8c16b4f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000ec80 tx=0x7f2f800091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.755+0000 7f2f92e81700 1 -- 172.21.15.112:0/1390833297 shutdown_connections 2023-10-06T04:39:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.755+0000 7f2f92e81700 1 --2- 172.21.15.112:0/1390833297 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2f78066f30 0x7f2f780693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.755+0000 7f2f92e81700 1 --2- 172.21.15.112:0/1390833297 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f8c157980 0x7f2f8c1671e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.755+0000 7f2f92e81700 1 --2- 172.21.15.112:0/1390833297 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f8c0ce0a0 0x7f2f8c0c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.755+0000 7f2f92e81700 1 --2- 172.21.15.112:0/1390833297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f8c1575b0 0x7f2f8c16b4f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.755+0000 7f2f92e81700 1 -- 172.21.15.112:0/1390833297 >> 172.21.15.112:0/1390833297 conn(0x7f2f8c0631f0 msgr2=0x7f2f8c0b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.755+0000 7f2f92e81700 1 -- 172.21.15.112:0/1390833297 shutdown_connections 2023-10-06T04:39:47.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.755+0000 7f2f92e81700 1 -- 172.21.15.112:0/1390833297 wait complete. 2023-10-06T04:39:47.770 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:39:47.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.884+0000 7f4d72f41700 1 Processor -- start 2023-10-06T04:39:47.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.884+0000 7f4d72f41700 1 -- start start 2023-10-06T04:39:47.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.885+0000 7f4d72f41700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4d6c06d3b0 0x7f4d6c15dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:47.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.885+0000 7f4d72f41700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d6c15e140 0x7f4d6c0b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:47.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.885+0000 7f4d72f41700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6c0af860 con 0x7f4d6c159850 2023-10-06T04:39:47.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.885+0000 7f4d72f41700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d6c0afb40 con 0x7f4d6c06d3b0 2023-10-06T04:39:47.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.885+0000 7f4d72f41700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c0afe20 con 0x7f4d6c15e140 2023-10-06T04:39:47.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.885+0000 7f4d63fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4d6c06d3b0 0x7f4d6c15dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:47.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.885+0000 7f4d63fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4d6c06d3b0 0x7f4d6c15dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34420/0 (socket says 172.21.15.112:34420) 2023-10-06T04:39:47.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.885+0000 7f4d63fff700 1 -- 172.21.15.112:0/1076245284 learned_addr learned my addr 172.21.15.112:0/1076245284 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:47.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.885+0000 7f4d714de700 1 --2- 172.21.15.112:0/1076245284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d6c15e140 0x7f4d6c0b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:47.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.885+0000 7f4d63fff700 1 -- 172.21.15.112:0/1076245284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d6c15e140 msgr2=0x7f4d6c0b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:47.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.885+0000 7f4d63fff700 1 --2- 172.21.15.112:0/1076245284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d6c15e140 0x7f4d6c0b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.885+0000 7f4d63fff700 1 -- 172.21.15.112:0/1076245284 >> v1:172.21.15.179:6789/0 conn(0x7f4d6c159850 legacy=0x7f4d6c15d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:47.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.885+0000 7f4d63fff700 1 -- 172.21.15.112:0/1076245284 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c0b0100 con 0x7f4d6c06d3b0 2023-10-06T04:39:47.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.886+0000 7f4d63fff700 1 --2- 172.21.15.112:0/1076245284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d6c06d3b0 0x7f4d6c15dc00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0099b0 tx=0x7f4d5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60aebef35e689a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:47.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.886+0000 7f4d637fe700 1 -- 172.21.15.112:0/1076245284 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c00b860 con 0x7f4d6c06d3b0 2023-10-06T04:39:47.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.886+0000 7f4d637fe700 1 -- 172.21.15.112:0/1076245284 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c00b9c0 con 0x7f4d6c06d3b0 2023-10-06T04:39:47.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.886+0000 7f4d637fe700 1 -- 172.21.15.112:0/1076245284 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c00bd60 con 0x7f4d6c06d3b0 2023-10-06T04:39:47.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.886+0000 7f4d72f41700 1 -- 172.21.15.112:0/1076245284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d6c06d3b0 msgr2=0x7f4d6c15dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:47.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.886+0000 7f4d72f41700 1 --2- 172.21.15.112:0/1076245284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d6c06d3b0 0x7f4d6c15dc00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0099b0 tx=0x7f4d5c009250 comp rx=0 tx=0).stop 2023-10-06T04:39:47.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.886+0000 7f4d72f41700 1 -- 172.21.15.112:0/1076245284 shutdown_connections 2023-10-06T04:39:47.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.886+0000 7f4d72f41700 1 --2- 172.21.15.112:0/1076245284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d6c15e140 0x7f4d6c0b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.886+0000 7f4d72f41700 1 --2- 172.21.15.112:0/1076245284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d6c06d3b0 0x7f4d6c15dc00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.886+0000 7f4d72f41700 1 -- 172.21.15.112:0/1076245284 >> 172.21.15.112:0/1076245284 conn(0x7f4d6c06cfb0 msgr2=0x7f4d6c0ad450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:47.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.886+0000 7f4d72f41700 1 -- 172.21.15.112:0/1076245284 shutdown_connections 2023-10-06T04:39:47.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.886+0000 7f4d72f41700 1 -- 172.21.15.112:0/1076245284 wait complete. 2023-10-06T04:39:47.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.887+0000 7f4d72f41700 1 Processor -- start 2023-10-06T04:39:47.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.888+0000 7f4d72f41700 1 -- start start 2023-10-06T04:39:47.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.888+0000 7f4d72f41700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d6c06d3b0 0x7f4d6c150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:47.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.888+0000 7f4d72f41700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d6c159850 0x7f4d6c0cf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:47.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.888+0000 7f4d72f41700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d6c15e140 0x7f4d6c06edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:47.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.888+0000 7f4d72f41700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c0cfa70 con 0x7f4d6c06d3b0 2023-10-06T04:39:47.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.888+0000 7f4d72f41700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c0cfd50 con 0x7f4d6c15e140 2023-10-06T04:39:47.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.888+0000 7f4d72f41700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c0d0030 con 0x7f4d6c159850 2023-10-06T04:39:47.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.888+0000 7f4d70cdd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d6c06d3b0 0x7f4d6c150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:47.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.888+0000 7f4d70cdd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d6c06d3b0 0x7f4d6c150160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34422/0 (socket says 172.21.15.112:34422) 2023-10-06T04:39:47.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.888+0000 7f4d70cdd700 1 -- 172.21.15.112:0/3816630658 learned_addr learned my addr 172.21.15.112:0/3816630658 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:47.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.889+0000 7f4d714de700 1 --2- 172.21.15.112:0/3816630658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d6c15e140 0x7f4d6c06edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:47.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.889+0000 7f4d63fff700 1 --2- 172.21.15.112:0/3816630658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d6c159850 0x7f4d6c0cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:47.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.889+0000 7f4d70cdd700 1 -- 172.21.15.112:0/3816630658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d6c159850 msgr2=0x7f4d6c0cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:47.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.889+0000 7f4d70cdd700 1 --2- 172.21.15.112:0/3816630658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d6c159850 0x7f4d6c0cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.889+0000 7f4d70cdd700 1 -- 172.21.15.112:0/3816630658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d6c15e140 msgr2=0x7f4d6c06edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:47.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.889+0000 7f4d70cdd700 1 --2- 172.21.15.112:0/3816630658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d6c15e140 0x7f4d6c06edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:47.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.889+0000 7f4d70cdd700 1 -- 172.21.15.112:0/3816630658 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c0094f0 con 0x7f4d6c06d3b0 2023-10-06T04:39:47.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.889+0000 7f4d70cdd700 1 --2- 172.21.15.112:0/3816630658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d6c06d3b0 0x7f4d6c150160 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800cd30 tx=0x7f4d68001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:47.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.889+0000 7f4d60ff9700 1 -- 172.21.15.112:0/3816630658 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6800ab70 con 0x7f4d6c06d3b0 2023-10-06T04:39:47.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.889+0000 7f4d60ff9700 1 -- 172.21.15.112:0/3816630658 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6800acf0 con 0x7f4d6c06d3b0 2023-10-06T04:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.889+0000 7f4d72f41700 1 -- 172.21.15.112:0/3816630658 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6c0d0310 con 0x7f4d6c06d3b0 2023-10-06T04:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.889+0000 7f4d60ff9700 1 -- 172.21.15.112:0/3816630658 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68012670 con 0x7f4d6c06d3b0 2023-10-06T04:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.889+0000 7f4d72f41700 1 -- 172.21.15.112:0/3816630658 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6c09b6c0 con 0x7f4d6c06d3b0 2023-10-06T04:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.890+0000 7f4d72f41700 1 -- 172.21.15.112:0/3816630658 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6c0d0500 con 0x7f4d6c06d3b0 2023-10-06T04:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.890+0000 7f4d60ff9700 1 -- 172.21.15.112:0/3816630658 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d68012aa0 con 0x7f4d6c06d3b0 2023-10-06T04:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.891+0000 7f4d60ff9700 1 --2- 172.21.15.112:0/3816630658 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4d58066f30 0x7f4d580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.891+0000 7f4d60ff9700 1 -- 172.21.15.112:0/3816630658 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4d68084ee0 con 0x7f4d6c06d3b0 2023-10-06T04:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.891+0000 7f4d63fff700 1 --2- 172.21.15.112:0/3816630658 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4d58066f30 0x7f4d580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:47.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.891+0000 7f4d63fff700 1 --2- 172.21.15.112:0/3816630658 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4d58066f30 0x7f4d580693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0099b0 tx=0x7f4d5c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:47.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:47.895+0000 7f4d60ff9700 1 -- 172.21.15.112:0/3816630658 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d68051f50 con 0x7f4d6c06d3b0 2023-10-06T04:39:48.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.076+0000 7f4d72f41700 1 -- 172.21.15.112:0/3816630658 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d6c05f230 con 0x7f4d6c06d3b0 2023-10-06T04:39:48.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.076+0000 7f4d60ff9700 1 -- 172.21.15.112:0/3816630658 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4d6800ae60 con 0x7f4d6c06d3b0 2023-10-06T04:39:48.078 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-10-06T04:39:48.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.078+0000 7f4d72f41700 1 -- 172.21.15.112:0/3816630658 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4d58066f30 msgr2=0x7f4d580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.078+0000 7f4d72f41700 1 --2- 172.21.15.112:0/3816630658 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4d58066f30 0x7f4d580693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0099b0 tx=0x7f4d5c017000 comp rx=0 tx=0).stop 2023-10-06T04:39:48.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.078+0000 7f4d72f41700 1 -- 172.21.15.112:0/3816630658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d6c06d3b0 msgr2=0x7f4d6c150160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.078+0000 7f4d72f41700 1 --2- 172.21.15.112:0/3816630658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d6c06d3b0 0x7f4d6c150160 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800cd30 tx=0x7f4d68001ba0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.078+0000 7f4d72f41700 1 -- 172.21.15.112:0/3816630658 shutdown_connections 2023-10-06T04:39:48.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.078+0000 7f4d72f41700 1 --2- 172.21.15.112:0/3816630658 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4d58066f30 0x7f4d580693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.078+0000 7f4d72f41700 1 --2- 172.21.15.112:0/3816630658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d6c15e140 0x7f4d6c06edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.078+0000 7f4d72f41700 1 --2- 172.21.15.112:0/3816630658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d6c06d3b0 0x7f4d6c150160 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.078+0000 7f4d72f41700 1 --2- 172.21.15.112:0/3816630658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d6c159850 0x7f4d6c0cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.078+0000 7f4d72f41700 1 -- 172.21.15.112:0/3816630658 >> 172.21.15.112:0/3816630658 conn(0x7f4d6c06cfb0 msgr2=0x7f4d6c0b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:48.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.078+0000 7f4d72f41700 1 -- 172.21.15.112:0/3816630658 shutdown_connections 2023-10-06T04:39:48.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.078+0000 7f4d72f41700 1 -- 172.21.15.112:0/3816630658 wait complete. 2023-10-06T04:39:48.092 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:48.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.203+0000 7f52e0e3f700 1 Processor -- start 2023-10-06T04:39:48.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.203+0000 7f52e0e3f700 1 -- start start 2023-10-06T04:39:48.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.204+0000 7f52e0e3f700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f52dc159d50 0x7f52dc0b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.204+0000 7f52e0e3f700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52dc15a120 0x7f52dc0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.204+0000 7f52e0e3f700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52dc0cd740 con 0x7f52dc0b0e70 2023-10-06T04:39:48.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.204+0000 7f52e0e3f700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52dc0ccb30 con 0x7f52dc159d50 2023-10-06T04:39:48.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.204+0000 7f52e0e3f700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc0cce10 con 0x7f52dc15a120 2023-10-06T04:39:48.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.204+0000 7f52dad9d700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f52dc0b0e70 0x7f52dc06db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.112:45480/0 (socket says 172.21.15.112:45480) 2023-10-06T04:39:48.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.204+0000 7f52da59c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f52dc159d50 0x7f52dc0b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.204+0000 7f52dad9d700 1 -- 172.21.15.112:0/836081120 learned_addr learned my addr 172.21.15.112:0/836081120 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:48.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.204+0000 7f52d9d9b700 1 --2- 172.21.15.112:0/836081120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52dc15a120 0x7f52dc0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.205+0000 7f52da59c700 1 -- 172.21.15.112:0/836081120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52dc15a120 msgr2=0x7f52dc0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:48.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.205+0000 7f52da59c700 1 --2- 172.21.15.112:0/836081120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52dc15a120 0x7f52dc0cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.205+0000 7f52da59c700 1 -- 172.21.15.112:0/836081120 >> v1:172.21.15.179:6789/0 conn(0x7f52dc0b0e70 legacy=0x7f52dc06db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.205+0000 7f52da59c700 1 -- 172.21.15.112:0/836081120 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc0cd0f0 con 0x7f52dc159d50 2023-10-06T04:39:48.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.205+0000 7f52da59c700 1 --2- 172.21.15.112:0/836081120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52dc159d50 0x7f52dc0b3040 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f52cc009e60 tx=0x7f52cc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4678c394aafed54f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:48.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.205+0000 7f52d959a700 1 -- 172.21.15.112:0/836081120 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00e070 con 0x7f52dc159d50 2023-10-06T04:39:48.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.205+0000 7f52d959a700 1 -- 172.21.15.112:0/836081120 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc00bb60 con 0x7f52dc159d50 2023-10-06T04:39:48.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.205+0000 7f52d959a700 1 -- 172.21.15.112:0/836081120 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc012430 con 0x7f52dc159d50 2023-10-06T04:39:48.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.206+0000 7f52e0e3f700 1 -- 172.21.15.112:0/836081120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52dc159d50 msgr2=0x7f52dc0b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.206+0000 7f52e0e3f700 1 --2- 172.21.15.112:0/836081120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52dc159d50 0x7f52dc0b3040 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f52cc009e60 tx=0x7f52cc009780 comp rx=0 tx=0).stop 2023-10-06T04:39:48.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.206+0000 7f52e0e3f700 1 -- 172.21.15.112:0/836081120 shutdown_connections 2023-10-06T04:39:48.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.206+0000 7f52e0e3f700 1 --2- 172.21.15.112:0/836081120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52dc159d50 0x7f52dc0b3040 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.206+0000 7f52e0e3f700 1 --2- 172.21.15.112:0/836081120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52dc15a120 0x7f52dc0cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.206+0000 7f52e0e3f700 1 -- 172.21.15.112:0/836081120 >> 172.21.15.112:0/836081120 conn(0x7f52dc099b60 msgr2=0x7f52dc06cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:48.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.206+0000 7f52e0e3f700 1 -- 172.21.15.112:0/836081120 shutdown_connections 2023-10-06T04:39:48.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.206+0000 7f52e0e3f700 1 -- 172.21.15.112:0/836081120 wait complete. 2023-10-06T04:39:48.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.207+0000 7f52e0e3f700 1 Processor -- start 2023-10-06T04:39:48.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.207+0000 7f52e0e3f700 1 -- start start 2023-10-06T04:39:48.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52e0e3f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52dc0b0e70 0x7f52dc14dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52e0e3f700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52dc159d50 0x7f52dc09f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52e0e3f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52dc15a120 0x7f52dc06db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52e0e3f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc0a0100 con 0x7f52dc0b0e70 2023-10-06T04:39:48.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52e0e3f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc1560c0 con 0x7f52dc15a120 2023-10-06T04:39:48.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52e0e3f700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc1563a0 con 0x7f52dc159d50 2023-10-06T04:39:48.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52da59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52dc0b0e70 0x7f52dc14dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52da59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52dc0b0e70 0x7f52dc14dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34324/0 (socket says 172.21.15.112:34324) 2023-10-06T04:39:48.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52da59c700 1 -- 172.21.15.112:0/1031457297 learned_addr learned my addr 172.21.15.112:0/1031457297 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:48.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52dad9d700 1 --2- 172.21.15.112:0/1031457297 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52dc15a120 0x7f52dc06db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52d9d9b700 1 --2- 172.21.15.112:0/1031457297 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52dc159d50 0x7f52dc09f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52da59c700 1 -- 172.21.15.112:0/1031457297 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52dc159d50 msgr2=0x7f52dc09f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52da59c700 1 --2- 172.21.15.112:0/1031457297 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52dc159d50 0x7f52dc09f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52da59c700 1 -- 172.21.15.112:0/1031457297 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52dc15a120 msgr2=0x7f52dc06db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52da59c700 1 --2- 172.21.15.112:0/1031457297 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52dc15a120 0x7f52dc06db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52da59c700 1 -- 172.21.15.112:0/1031457297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc009a20 con 0x7f52dc0b0e70 2023-10-06T04:39:48.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52d9d9b700 1 --2- 172.21.15.112:0/1031457297 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52dc159d50 0x7f52dc09f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:48.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52da59c700 1 --2- 172.21.15.112:0/1031457297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52dc0b0e70 0x7f52dc14dd20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f52dc0b0380 tx=0x7f52cc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:48.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52ca7fc700 1 -- 172.21.15.112:0/1031457297 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc012d70 con 0x7f52dc0b0e70 2023-10-06T04:39:48.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52ca7fc700 1 -- 172.21.15.112:0/1031457297 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc027470 con 0x7f52dc0b0e70 2023-10-06T04:39:48.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52e0e3f700 1 -- 172.21.15.112:0/1031457297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52dc156680 con 0x7f52dc0b0e70 2023-10-06T04:39:48.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52ca7fc700 1 -- 172.21.15.112:0/1031457297 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc027830 con 0x7f52dc0b0e70 2023-10-06T04:39:48.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.208+0000 7f52e0e3f700 1 -- 172.21.15.112:0/1031457297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52dc156c40 con 0x7f52dc0b0e70 2023-10-06T04:39:48.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.209+0000 7f52e0e3f700 1 -- 172.21.15.112:0/1031457297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52dc157200 con 0x7f52dc0b0e70 2023-10-06T04:39:48.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.210+0000 7f52ca7fc700 1 -- 172.21.15.112:0/1031457297 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52cc024070 con 0x7f52dc0b0e70 2023-10-06T04:39:48.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.210+0000 7f52ca7fc700 1 --2- 172.21.15.112:0/1031457297 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f52bc066f30 0x7f52bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.210+0000 7f52ca7fc700 1 -- 172.21.15.112:0/1031457297 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f52cc086c50 con 0x7f52dc0b0e70 2023-10-06T04:39:48.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.210+0000 7f52d9d9b700 1 --2- 172.21.15.112:0/1031457297 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f52bc066f30 0x7f52bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.210+0000 7f52d9d9b700 1 --2- 172.21.15.112:0/1031457297 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f52bc066f30 0x7f52bc0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f52dc064090 tx=0x7f52d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:48.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.214+0000 7f52ca7fc700 1 -- 172.21.15.112:0/1031457297 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52cc08c020 con 0x7f52dc0b0e70 2023-10-06T04:39:48.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.397+0000 7f52e0e3f700 1 -- 172.21.15.112:0/1031457297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52dc156fb0 con 0x7f52dc0b0e70 2023-10-06T04:39:48.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.398+0000 7f52ca7fc700 1 -- 172.21.15.112:0/1031457297 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f52cc053d60 con 0x7f52dc0b0e70 2023-10-06T04:39:48.400 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:48.401 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:39:22.637355+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:18.657040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:19.972295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:48.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.400+0000 7f52e0e3f700 1 -- 172.21.15.112:0/1031457297 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f52bc066f30 msgr2=0x7f52bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.400+0000 7f52e0e3f700 1 --2- 172.21.15.112:0/1031457297 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f52bc066f30 0x7f52bc0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f52dc064090 tx=0x7f52d0008040 comp rx=0 tx=0).stop 2023-10-06T04:39:48.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.400+0000 7f52e0e3f700 1 -- 172.21.15.112:0/1031457297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52dc0b0e70 msgr2=0x7f52dc14dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.400+0000 7f52e0e3f700 1 --2- 172.21.15.112:0/1031457297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52dc0b0e70 0x7f52dc14dd20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f52dc0b0380 tx=0x7f52cc019000 comp rx=0 tx=0).stop 2023-10-06T04:39:48.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.400+0000 7f52e0e3f700 1 -- 172.21.15.112:0/1031457297 shutdown_connections 2023-10-06T04:39:48.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.400+0000 7f52e0e3f700 1 --2- 172.21.15.112:0/1031457297 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f52bc066f30 0x7f52bc0693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.400+0000 7f52e0e3f700 1 --2- 172.21.15.112:0/1031457297 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52dc15a120 0x7f52dc06db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.400+0000 7f52e0e3f700 1 --2- 172.21.15.112:0/1031457297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52dc0b0e70 0x7f52dc14dd20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.400+0000 7f52e0e3f700 1 --2- 172.21.15.112:0/1031457297 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52dc159d50 0x7f52dc09f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.400+0000 7f52e0e3f700 1 -- 172.21.15.112:0/1031457297 >> 172.21.15.112:0/1031457297 conn(0x7f52dc099b60 msgr2=0x7f52dc0cff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:48.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.400+0000 7f52e0e3f700 1 -- 172.21.15.112:0/1031457297 shutdown_connections 2023-10-06T04:39:48.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.400+0000 7f52e0e3f700 1 -- 172.21.15.112:0/1031457297 wait complete. 2023-10-06T04:39:48.415 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:13.929254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:39:14.321892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:39:18.657040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:39:19.972295+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:39:48.416 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:39:48.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.535+0000 7f1b56a52700 1 Processor -- start 2023-10-06T04:39:48.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.535+0000 7f1b56a52700 1 -- start start 2023-10-06T04:39:48.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.536+0000 7f1b56a52700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1b50159a20 0x7f1b500cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.536+0000 7f1b56a52700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b5015c720 0x7f1b500cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.536+0000 7f1b56a52700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b5015af50 con 0x7f1b5006d3b0 2023-10-06T04:39:48.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.536+0000 7f1b56a52700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b500cca70 con 0x7f1b50159a20 2023-10-06T04:39:48.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.536+0000 7f1b56a52700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5008a080 con 0x7f1b5015c720 2023-10-06T04:39:48.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.536+0000 7f1b4ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1b50159a20 0x7f1b500cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.536+0000 7f1b54fef700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b5015c720 0x7f1b500cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.536+0000 7f1b4ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1b50159a20 0x7f1b500cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.112:36914/0 (socket says 172.21.15.112:36914) 2023-10-06T04:39:48.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.536+0000 7f1b4ffff700 1 -- 172.21.15.112:0/2118781415 learned_addr learned my addr 172.21.15.112:0/2118781415 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:48.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.536+0000 7f1b4f7fe700 1 --1- 172.21.15.112:0/2118781415 >> v1:172.21.15.179:6789/0 conn(0x7f1b5006d3b0 0x7f1b5015d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.112:45482/0 (socket says 172.21.15.112:45482) 2023-10-06T04:39:48.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.537+0000 7f1b54fef700 1 -- 172.21.15.112:0/2118781415 >> v2:172.21.15.179:3300/0 conn(0x7f1b50159a20 msgr2=0x7f1b500cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:48.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.537+0000 7f1b54fef700 1 --2- 172.21.15.112:0/2118781415 >> v2:172.21.15.179:3300/0 conn(0x7f1b50159a20 0x7f1b500cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.537+0000 7f1b54fef700 1 -- 172.21.15.112:0/2118781415 >> v1:172.21.15.179:6789/0 conn(0x7f1b5006d3b0 legacy=0x7f1b5015d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.537+0000 7f1b54fef700 1 -- 172.21.15.112:0/2118781415 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b500cae50 con 0x7f1b5015c720 2023-10-06T04:39:48.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.537+0000 7f1b4ffff700 1 --2- 172.21.15.112:0/2118781415 >> v2:172.21.15.179:3300/0 conn(0x7f1b50159a20 0x7f1b500cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:48.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.537+0000 7f1b54fef700 1 --2- 172.21.15.112:0/2118781415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b5015c720 0x7f1b500cbd30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009e60 tx=0x7f1b48009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=382ec8c82e456063 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:48.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.537+0000 7f1b4effd700 1 -- 172.21.15.112:0/2118781415 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4800e070 con 0x7f1b5015c720 2023-10-06T04:39:48.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.537+0000 7f1b4effd700 1 -- 172.21.15.112:0/2118781415 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4800bb60 con 0x7f1b5015c720 2023-10-06T04:39:48.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.537+0000 7f1b4effd700 1 -- 172.21.15.112:0/2118781415 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b48012430 con 0x7f1b5015c720 2023-10-06T04:39:48.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.537+0000 7f1b56a52700 1 -- 172.21.15.112:0/2118781415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b5015c720 msgr2=0x7f1b500cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.537+0000 7f1b56a52700 1 --2- 172.21.15.112:0/2118781415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b5015c720 0x7f1b500cbd30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009e60 tx=0x7f1b48009780 comp rx=0 tx=0).stop 2023-10-06T04:39:48.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.538+0000 7f1b56a52700 1 -- 172.21.15.112:0/2118781415 shutdown_connections 2023-10-06T04:39:48.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.538+0000 7f1b56a52700 1 --2- 172.21.15.112:0/2118781415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b5015c720 0x7f1b500cbd30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.538+0000 7f1b56a52700 1 --2- 172.21.15.112:0/2118781415 >> v2:172.21.15.179:3300/0 conn(0x7f1b50159a20 0x7f1b500cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.538+0000 7f1b56a52700 1 -- 172.21.15.112:0/2118781415 >> 172.21.15.112:0/2118781415 conn(0x7f1b5006cfb0 msgr2=0x7f1b500d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:48.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.538+0000 7f1b56a52700 1 -- 172.21.15.112:0/2118781415 shutdown_connections 2023-10-06T04:39:48.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.538+0000 7f1b56a52700 1 -- 172.21.15.112:0/2118781415 wait complete. 2023-10-06T04:39:48.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.539+0000 7f1b56a52700 1 Processor -- start 2023-10-06T04:39:48.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.539+0000 7f1b56a52700 1 -- start start 2023-10-06T04:39:48.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.539+0000 7f1b56a52700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b5006d3b0 0x7f1b5016b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.539+0000 7f1b56a52700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b50159a20 0x7f1b500aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.539+0000 7f1b56a52700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b5015c720 0x7f1b500b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.539+0000 7f1b56a52700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5016b4f0 con 0x7f1b50159a20 2023-10-06T04:39:48.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.539+0000 7f1b56a52700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5016bca0 con 0x7f1b5006d3b0 2023-10-06T04:39:48.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.539+0000 7f1b56a52700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b500b38b0 con 0x7f1b5015c720 2023-10-06T04:39:48.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.540+0000 7f1b4f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b50159a20 0x7f1b500aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.540+0000 7f1b4f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b50159a20 0x7f1b500aecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34334/0 (socket says 172.21.15.112:34334) 2023-10-06T04:39:48.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.540+0000 7f1b4f7fe700 1 -- 172.21.15.112:0/495451895 learned_addr learned my addr 172.21.15.112:0/495451895 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:48.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.540+0000 7f1b54fef700 1 --2- 172.21.15.112:0/495451895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b5015c720 0x7f1b500b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.540+0000 7f1b4ffff700 1 --2- 172.21.15.112:0/495451895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b5006d3b0 0x7f1b5016b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.540+0000 7f1b4f7fe700 1 -- 172.21.15.112:0/495451895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b5015c720 msgr2=0x7f1b500b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.540+0000 7f1b4f7fe700 1 --2- 172.21.15.112:0/495451895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b5015c720 0x7f1b500b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.540+0000 7f1b4f7fe700 1 -- 172.21.15.112:0/495451895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b5006d3b0 msgr2=0x7f1b5016b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.540+0000 7f1b4f7fe700 1 --2- 172.21.15.112:0/495451895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b5006d3b0 0x7f1b5016b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.540+0000 7f1b4f7fe700 1 -- 172.21.15.112:0/495451895 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b400094f0 con 0x7f1b50159a20 2023-10-06T04:39:48.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.540+0000 7f1b4f7fe700 1 --2- 172.21.15.112:0/495451895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b50159a20 0x7f1b500aecd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400c790 tx=0x7f1b44007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:48.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.540+0000 7f1b37fff700 1 -- 172.21.15.112:0/495451895 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44005a70 con 0x7f1b50159a20 2023-10-06T04:39:48.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.540+0000 7f1b37fff700 1 -- 172.21.15.112:0/495451895 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b44005bf0 con 0x7f1b50159a20 2023-10-06T04:39:48.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.540+0000 7f1b56a52700 1 -- 172.21.15.112:0/495451895 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b48009a20 con 0x7f1b50159a20 2023-10-06T04:39:48.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.540+0000 7f1b37fff700 1 -- 172.21.15.112:0/495451895 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b440070d0 con 0x7f1b50159a20 2023-10-06T04:39:48.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.540+0000 7f1b56a52700 1 -- 172.21.15.112:0/495451895 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b500b4150 con 0x7f1b50159a20 2023-10-06T04:39:48.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.541+0000 7f1b56a52700 1 -- 172.21.15.112:0/495451895 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b5005f230 con 0x7f1b50159a20 2023-10-06T04:39:48.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.542+0000 7f1b37fff700 1 -- 172.21.15.112:0/495451895 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b44007480 con 0x7f1b50159a20 2023-10-06T04:39:48.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.542+0000 7f1b37fff700 1 --2- 172.21.15.112:0/495451895 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1b3c066f30 0x7f1b3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.542+0000 7f1b37fff700 1 -- 172.21.15.112:0/495451895 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1b44083ac0 con 0x7f1b50159a20 2023-10-06T04:39:48.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.542+0000 7f1b4ffff700 1 --2- 172.21.15.112:0/495451895 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1b3c066f30 0x7f1b3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.543+0000 7f1b4ffff700 1 --2- 172.21.15.112:0/495451895 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1b3c066f30 0x7f1b3c0693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1b40006d20 tx=0x7f1b40009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:48.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.546+0000 7f1b37fff700 1 -- 172.21.15.112:0/495451895 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b44050bd0 con 0x7f1b50159a20 2023-10-06T04:39:48.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.728+0000 7f1b56a52700 1 -- 172.21.15.112:0/495451895 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1b500cb0f0 con 0x7f1b50159a20 2023-10-06T04:39:48.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.729+0000 7f1b37fff700 1 -- 172.21.15.112:0/495451895 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1b44083e60 con 0x7f1b50159a20 2023-10-06T04:39:48.732 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-10-06T04:39:48.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.731+0000 7f1b56a52700 1 -- 172.21.15.112:0/495451895 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1b3c066f30 msgr2=0x7f1b3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.731+0000 7f1b56a52700 1 --2- 172.21.15.112:0/495451895 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1b3c066f30 0x7f1b3c0693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1b40006d20 tx=0x7f1b40009250 comp rx=0 tx=0).stop 2023-10-06T04:39:48.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.731+0000 7f1b56a52700 1 -- 172.21.15.112:0/495451895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b50159a20 msgr2=0x7f1b500aecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.731+0000 7f1b56a52700 1 --2- 172.21.15.112:0/495451895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b50159a20 0x7f1b500aecd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400c790 tx=0x7f1b44007f40 comp rx=0 tx=0).stop 2023-10-06T04:39:48.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.731+0000 7f1b56a52700 1 -- 172.21.15.112:0/495451895 shutdown_connections 2023-10-06T04:39:48.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.731+0000 7f1b56a52700 1 --2- 172.21.15.112:0/495451895 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1b3c066f30 0x7f1b3c0693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.731+0000 7f1b56a52700 1 --2- 172.21.15.112:0/495451895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b5015c720 0x7f1b500b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.731+0000 7f1b56a52700 1 --2- 172.21.15.112:0/495451895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b5006d3b0 0x7f1b5016b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.731+0000 7f1b56a52700 1 --2- 172.21.15.112:0/495451895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b50159a20 0x7f1b500aecd0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.731+0000 7f1b56a52700 1 -- 172.21.15.112:0/495451895 >> 172.21.15.112:0/495451895 conn(0x7f1b5006cfb0 msgr2=0x7f1b501531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:48.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.731+0000 7f1b56a52700 1 -- 172.21.15.112:0/495451895 shutdown_connections 2023-10-06T04:39:48.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.731+0000 7f1b56a52700 1 -- 172.21.15.112:0/495451895 wait complete. 2023-10-06T04:39:48.745 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:39:48.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.864+0000 7f1a38dc9700 1 Processor -- start 2023-10-06T04:39:48.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.864+0000 7f1a38dc9700 1 -- start start 2023-10-06T04:39:48.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.865+0000 7f1a38dc9700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a34157220 0x7f1a340d0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.865+0000 7f1a38dc9700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1a340d0a70 0x7f1a340c7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.865+0000 7f1a38dc9700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a340cab40 con 0x7f1a340c7bd0 2023-10-06T04:39:48.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.865+0000 7f1a38dc9700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a340cceb0 con 0x7f1a340d0a70 2023-10-06T04:39:48.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.865+0000 7f1a38dc9700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a340cd100 con 0x7f1a34157220 2023-10-06T04:39:48.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.865+0000 7f1a32ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1a340d0a70 0x7f1a340c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.865+0000 7f1a337fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a34157220 0x7f1a340d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.865+0000 7f1a32ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1a340d0a70 0x7f1a340c7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.112:36930/0 (socket says 172.21.15.112:36930) 2023-10-06T04:39:48.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.865+0000 7f1a32ffd700 1 -- 172.21.15.112:0/3682958681 learned_addr learned my addr 172.21.15.112:0/3682958681 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:48.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.866+0000 7f1a32ffd700 1 -- 172.21.15.112:0/3682958681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a34157220 msgr2=0x7f1a340d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:48.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.866+0000 7f1a32ffd700 1 --2- 172.21.15.112:0/3682958681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a34157220 0x7f1a340d0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.866+0000 7f1a32ffd700 1 -- 172.21.15.112:0/3682958681 >> v1:172.21.15.179:6789/0 conn(0x7f1a340c7bd0 legacy=0x7f1a3415d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.866+0000 7f1a32ffd700 1 -- 172.21.15.112:0/3682958681 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a340d0ee0 con 0x7f1a340d0a70 2023-10-06T04:39:48.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.866+0000 7f1a337fe700 1 --2- 172.21.15.112:0/3682958681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a34157220 0x7f1a340d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:48.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.866+0000 7f1a32ffd700 1 --2- 172.21.15.112:0/3682958681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a340d0a70 0x7f1a340c7690 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1a24009990 tx=0x7f1a24009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c6bc4571ca4638 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:48.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.866+0000 7f1a327fc700 1 -- 172.21.15.112:0/3682958681 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a24009e80 con 0x7f1a340d0a70 2023-10-06T04:39:48.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.866+0000 7f1a327fc700 1 -- 172.21.15.112:0/3682958681 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a24005c10 con 0x7f1a340d0a70 2023-10-06T04:39:48.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.866+0000 7f1a327fc700 1 -- 172.21.15.112:0/3682958681 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2400b650 con 0x7f1a340d0a70 2023-10-06T04:39:48.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.867+0000 7f1a38dc9700 1 -- 172.21.15.112:0/3682958681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a340d0a70 msgr2=0x7f1a340c7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.867+0000 7f1a38dc9700 1 --2- 172.21.15.112:0/3682958681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a340d0a70 0x7f1a340c7690 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1a24009990 tx=0x7f1a24009220 comp rx=0 tx=0).stop 2023-10-06T04:39:48.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.867+0000 7f1a38dc9700 1 -- 172.21.15.112:0/3682958681 shutdown_connections 2023-10-06T04:39:48.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.867+0000 7f1a38dc9700 1 --2- 172.21.15.112:0/3682958681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a34157220 0x7f1a340d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.867+0000 7f1a38dc9700 1 --2- 172.21.15.112:0/3682958681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a340d0a70 0x7f1a340c7690 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.867+0000 7f1a38dc9700 1 -- 172.21.15.112:0/3682958681 >> 172.21.15.112:0/3682958681 conn(0x7f1a3406c7d0 msgr2=0x7f1a3406cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:48.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.867+0000 7f1a38dc9700 1 -- 172.21.15.112:0/3682958681 shutdown_connections 2023-10-06T04:39:48.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.867+0000 7f1a38dc9700 1 -- 172.21.15.112:0/3682958681 wait complete. 2023-10-06T04:39:48.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.868+0000 7f1a38dc9700 1 Processor -- start 2023-10-06T04:39:48.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.868+0000 7f1a38dc9700 1 -- start start 2023-10-06T04:39:48.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a38dc9700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a340c7bd0 0x7f1a340c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a38dc9700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a340d0a70 0x7f1a34151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a38dc9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a34157220 0x7f1a340c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a38dc9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3415cc30 con 0x7f1a34157220 2023-10-06T04:39:48.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a38dc9700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a34159db0 con 0x7f1a340c7bd0 2023-10-06T04:39:48.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a38dc9700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3415c050 con 0x7f1a340d0a70 2023-10-06T04:39:48.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a33fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a34157220 0x7f1a340c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a33fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a34157220 0x7f1a340c5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34344/0 (socket says 172.21.15.112:34344) 2023-10-06T04:39:48.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a33fff700 1 -- 172.21.15.112:0/3743401205 learned_addr learned my addr 172.21.15.112:0/3743401205 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:48.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a337fe700 1 --2- 172.21.15.112:0/3743401205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a340c7bd0 0x7f1a340c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a32ffd700 1 --2- 172.21.15.112:0/3743401205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a340d0a70 0x7f1a34151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a33fff700 1 -- 172.21.15.112:0/3743401205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a340d0a70 msgr2=0x7f1a34151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a33fff700 1 --2- 172.21.15.112:0/3743401205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a340d0a70 0x7f1a34151db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a33fff700 1 -- 172.21.15.112:0/3743401205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a340c7bd0 msgr2=0x7f1a340c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:48.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a33fff700 1 --2- 172.21.15.112:0/3743401205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a340c7bd0 0x7f1a340c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:48.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a33fff700 1 -- 172.21.15.112:0/3743401205 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a28009420 con 0x7f1a34157220 2023-10-06T04:39:48.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a33fff700 1 --2- 172.21.15.112:0/3743401205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a34157220 0x7f1a340c5a80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00c840 tx=0x7f1a2c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:48.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a1b7fe700 1 -- 172.21.15.112:0/3743401205 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c012630 con 0x7f1a34157220 2023-10-06T04:39:48.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a1b7fe700 1 -- 172.21.15.112:0/3743401205 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2c0127b0 con 0x7f1a34157220 2023-10-06T04:39:48.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a38dc9700 1 -- 172.21.15.112:0/3743401205 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a24009480 con 0x7f1a34157220 2023-10-06T04:39:48.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a1b7fe700 1 -- 172.21.15.112:0/3743401205 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c012b70 con 0x7f1a34157220 2023-10-06T04:39:48.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.869+0000 7f1a38dc9700 1 -- 172.21.15.112:0/3743401205 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a3415c370 con 0x7f1a34157220 2023-10-06T04:39:48.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.870+0000 7f1a38dc9700 1 -- 172.21.15.112:0/3743401205 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a3406e510 con 0x7f1a34157220 2023-10-06T04:39:48.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.871+0000 7f1a1b7fe700 1 -- 172.21.15.112:0/3743401205 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a2c003030 con 0x7f1a34157220 2023-10-06T04:39:48.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.871+0000 7f1a1b7fe700 1 --2- 172.21.15.112:0/3743401205 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1a20066f30 0x7f1a200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:48.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.871+0000 7f1a1b7fe700 1 -- 172.21.15.112:0/3743401205 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1a2c084650 con 0x7f1a34157220 2023-10-06T04:39:48.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.871+0000 7f1a337fe700 1 --2- 172.21.15.112:0/3743401205 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1a20066f30 0x7f1a200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:48.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.872+0000 7f1a337fe700 1 --2- 172.21.15.112:0/3743401205 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1a20066f30 0x7f1a200693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1a280093f0 tx=0x7f1a28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:48.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:48.875+0000 7f1a1b7fe700 1 -- 172.21.15.112:0/3743401205 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a2c051760 con 0x7f1a34157220 2023-10-06T04:39:49.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.059+0000 7f1a38dc9700 1 -- 172.21.15.112:0/3743401205 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a3415c630 con 0x7f1a34157220 2023-10-06T04:39:49.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.059+0000 7f1a1b7fe700 1 -- 172.21.15.112:0/3743401205 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1a2c054d80 con 0x7f1a34157220 2023-10-06T04:39:49.061 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-10-06T04:39:49.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.061+0000 7f1a38dc9700 1 -- 172.21.15.112:0/3743401205 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1a20066f30 msgr2=0x7f1a200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:49.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.061+0000 7f1a38dc9700 1 --2- 172.21.15.112:0/3743401205 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1a20066f30 0x7f1a200693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1a280093f0 tx=0x7f1a28008040 comp rx=0 tx=0).stop 2023-10-06T04:39:49.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.061+0000 7f1a38dc9700 1 -- 172.21.15.112:0/3743401205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a34157220 msgr2=0x7f1a340c5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:49.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.061+0000 7f1a38dc9700 1 --2- 172.21.15.112:0/3743401205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a34157220 0x7f1a340c5a80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00c840 tx=0x7f1a2c001670 comp rx=0 tx=0).stop 2023-10-06T04:39:49.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.061+0000 7f1a38dc9700 1 -- 172.21.15.112:0/3743401205 shutdown_connections 2023-10-06T04:39:49.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.061+0000 7f1a38dc9700 1 --2- 172.21.15.112:0/3743401205 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1a20066f30 0x7f1a200693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.061+0000 7f1a38dc9700 1 --2- 172.21.15.112:0/3743401205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a34157220 0x7f1a340c5a80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.061+0000 7f1a38dc9700 1 --2- 172.21.15.112:0/3743401205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a340c7bd0 0x7f1a340c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.061+0000 7f1a38dc9700 1 --2- 172.21.15.112:0/3743401205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a340d0a70 0x7f1a34151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.061+0000 7f1a38dc9700 1 -- 172.21.15.112:0/3743401205 >> 172.21.15.112:0/3743401205 conn(0x7f1a3406c7d0 msgr2=0x7f1a340cacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:49.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.061+0000 7f1a38dc9700 1 -- 172.21.15.112:0/3743401205 shutdown_connections 2023-10-06T04:39:49.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.061+0000 7f1a38dc9700 1 -- 172.21.15.112:0/3743401205 wait complete. 2023-10-06T04:39:49.076 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:39:49.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.190+0000 7f8c3126d700 1 Processor -- start 2023-10-06T04:39:49.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.190+0000 7f8c3126d700 1 -- start start 2023-10-06T04:39:49.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.191+0000 7f8c3126d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8c2c157980 0x7f8c2c0cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:49.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.191+0000 7f8c3126d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8c2c0ce0a0 0x7f8c2c0b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:49.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.191+0000 7f8c3126d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c0cd6d0 con 0x7f8c2c1575b0 2023-10-06T04:39:49.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.191+0000 7f8c3126d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c2c0ccac0 con 0x7f8c2c157980 2023-10-06T04:39:49.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.191+0000 7f8c3126d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c2c0ccda0 con 0x7f8c2c0ce0a0 2023-10-06T04:39:49.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.191+0000 7f8c227fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8c2c157980 0x7f8c2c0cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:49.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.191+0000 7f8c2affd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8c2c1575b0 0x7f8c2c15be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:37490/0 (socket says 172.21.15.112:37490) 2023-10-06T04:39:49.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.191+0000 7f8c2affd700 1 -- 172.21.15.112:0/4168320673 learned_addr learned my addr 172.21.15.112:0/4168320673 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:49.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.191+0000 7f8c2b7fe700 1 --2- 172.21.15.112:0/4168320673 >> v2:172.21.15.179:3300/0 conn(0x7f8c2c0ce0a0 0x7f8c2c0b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:49.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.191+0000 7f8c227fc700 1 -- 172.21.15.112:0/4168320673 >> v2:172.21.15.179:3300/0 conn(0x7f8c2c0ce0a0 msgr2=0x7f8c2c0b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:49.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.191+0000 7f8c227fc700 1 --2- 172.21.15.112:0/4168320673 >> v2:172.21.15.179:3300/0 conn(0x7f8c2c0ce0a0 0x7f8c2c0b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.191+0000 7f8c227fc700 1 -- 172.21.15.112:0/4168320673 >> v1:172.21.15.112:6789/0 conn(0x7f8c2c1575b0 legacy=0x7f8c2c15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:49.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.191+0000 7f8c2a7fc700 1 -- 172.21.15.112:0/4168320673 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726792087 0 0) 0x7f8c2c0cd6d0 con 0x7f8c2c1575b0 2023-10-06T04:39:49.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.191+0000 7f8c227fc700 1 -- 172.21.15.112:0/4168320673 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c0cd080 con 0x7f8c2c157980 2023-10-06T04:39:49.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.191+0000 7f8c2b7fe700 1 --2- 172.21.15.112:0/4168320673 >> v2:172.21.15.179:3300/0 conn(0x7f8c2c0ce0a0 0x7f8c2c0b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:49.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.192+0000 7f8c227fc700 1 --2- 172.21.15.112:0/4168320673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c2c157980 0x7f8c2c0cdb60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c157e20 tx=0x7f8c140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a59c8a8efc7f73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:49.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.192+0000 7f8c2a7fc700 1 -- 172.21.15.112:0/4168320673 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1400b6b0 con 0x7f8c2c157980 2023-10-06T04:39:49.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.192+0000 7f8c2a7fc700 1 -- 172.21.15.112:0/4168320673 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1400b810 con 0x7f8c2c157980 2023-10-06T04:39:49.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.192+0000 7f8c2a7fc700 1 -- 172.21.15.112:0/4168320673 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1400bbb0 con 0x7f8c2c157980 2023-10-06T04:39:49.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.192+0000 7f8c3126d700 1 -- 172.21.15.112:0/4168320673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c2c157980 msgr2=0x7f8c2c0cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:49.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.192+0000 7f8c3126d700 1 --2- 172.21.15.112:0/4168320673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c2c157980 0x7f8c2c0cdb60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c157e20 tx=0x7f8c140091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.192+0000 7f8c3126d700 1 -- 172.21.15.112:0/4168320673 shutdown_connections 2023-10-06T04:39:49.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.192+0000 7f8c3126d700 1 --2- 172.21.15.112:0/4168320673 >> v2:172.21.15.179:3300/0 conn(0x7f8c2c0ce0a0 0x7f8c2c0b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.192+0000 7f8c3126d700 1 --2- 172.21.15.112:0/4168320673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c2c157980 0x7f8c2c0cdb60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.192+0000 7f8c3126d700 1 -- 172.21.15.112:0/4168320673 >> 172.21.15.112:0/4168320673 conn(0x7f8c2c0631f0 msgr2=0x7f8c2c0635f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:49.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.192+0000 7f8c3126d700 1 -- 172.21.15.112:0/4168320673 shutdown_connections 2023-10-06T04:39:49.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.192+0000 7f8c3126d700 1 -- 172.21.15.112:0/4168320673 wait complete. 2023-10-06T04:39:49.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.193+0000 7f8c3126d700 1 Processor -- start 2023-10-06T04:39:49.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.194+0000 7f8c3126d700 1 -- start start 2023-10-06T04:39:49.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.194+0000 7f8c3126d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c2c0ce0a0 0x7f8c2c0af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:49.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.194+0000 7f8c3126d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c2c1575b0 0x7f8c2c0c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:49.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.194+0000 7f8c3126d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c2c157980 0x7f8c2c0c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:49.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.194+0000 7f8c3126d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0afdb0 con 0x7f8c2c1575b0 2023-10-06T04:39:49.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.194+0000 7f8c3126d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0c98e0 con 0x7f8c2c0ce0a0 2023-10-06T04:39:49.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.194+0000 7f8c3126d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0c8a10 con 0x7f8c2c157980 2023-10-06T04:39:49.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.194+0000 7f8c227fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c2c1575b0 0x7f8c2c0c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:49.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.194+0000 7f8c227fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c2c1575b0 0x7f8c2c0c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34352/0 (socket says 172.21.15.112:34352) 2023-10-06T04:39:49.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.194+0000 7f8c227fc700 1 -- 172.21.15.112:0/2360193307 learned_addr learned my addr 172.21.15.112:0/2360193307 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:49.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.195+0000 7f8c2affd700 1 --2- 172.21.15.112:0/2360193307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c2c0ce0a0 0x7f8c2c0af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:49.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.195+0000 7f8c2b7fe700 1 --2- 172.21.15.112:0/2360193307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c2c157980 0x7f8c2c0c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:49.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.195+0000 7f8c227fc700 1 -- 172.21.15.112:0/2360193307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c2c157980 msgr2=0x7f8c2c0c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:49.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.195+0000 7f8c227fc700 1 --2- 172.21.15.112:0/2360193307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c2c157980 0x7f8c2c0c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.195+0000 7f8c227fc700 1 -- 172.21.15.112:0/2360193307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c2c0ce0a0 msgr2=0x7f8c2c0af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:49.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.195+0000 7f8c227fc700 1 --2- 172.21.15.112:0/2360193307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c2c0ce0a0 0x7f8c2c0af870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.195+0000 7f8c227fc700 1 -- 172.21.15.112:0/2360193307 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c14009420 con 0x7f8c2c1575b0 2023-10-06T04:39:49.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.195+0000 7f8c227fc700 1 --2- 172.21.15.112:0/2360193307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c2c1575b0 0x7f8c2c0c84d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0b47e0 tx=0x7f8c14017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:49.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.195+0000 7f8c237fe700 1 -- 172.21.15.112:0/2360193307 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c14011420 con 0x7f8c2c1575b0 2023-10-06T04:39:49.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.195+0000 7f8c237fe700 1 -- 172.21.15.112:0/2360193307 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c140115a0 con 0x7f8c2c1575b0 2023-10-06T04:39:49.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.195+0000 7f8c237fe700 1 -- 172.21.15.112:0/2360193307 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c14011960 con 0x7f8c2c1575b0 2023-10-06T04:39:49.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.195+0000 7f8c3126d700 1 -- 172.21.15.112:0/2360193307 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2c0c8cd0 con 0x7f8c2c1575b0 2023-10-06T04:39:49.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.195+0000 7f8c3126d700 1 -- 172.21.15.112:0/2360193307 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2c0c9290 con 0x7f8c2c1575b0 2023-10-06T04:39:49.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.196+0000 7f8c3126d700 1 -- 172.21.15.112:0/2360193307 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2c0c9a70 con 0x7f8c2c1575b0 2023-10-06T04:39:49.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.196+0000 7f8c237fe700 1 -- 172.21.15.112:0/2360193307 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c14011d50 con 0x7f8c2c1575b0 2023-10-06T04:39:49.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.197+0000 7f8c237fe700 1 --2- 172.21.15.112:0/2360193307 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8c0c066f30 0x7f8c0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:49.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.197+0000 7f8c237fe700 1 -- 172.21.15.112:0/2360193307 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8c14086120 con 0x7f8c2c1575b0 2023-10-06T04:39:49.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.197+0000 7f8c2affd700 1 --2- 172.21.15.112:0/2360193307 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8c0c066f30 0x7f8c0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:49.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.197+0000 7f8c2affd700 1 --2- 172.21.15.112:0/2360193307 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8c0c066f30 0x7f8c0c0693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0011e0 tx=0x7f8c1c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:49.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.201+0000 7f8c237fe700 1 -- 172.21.15.112:0/2360193307 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c14053230 con 0x7f8c2c1575b0 2023-10-06T04:39:49.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.384+0000 7f8c3126d700 1 -- 172.21.15.112:0/2360193307 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8c2c0cd360 con 0x7f8c2c1575b0 2023-10-06T04:39:49.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.384+0000 7f8c237fe700 1 -- 172.21.15.112:0/2360193307 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8c14056850 con 0x7f8c2c1575b0 2023-10-06T04:39:49.387 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-10-06T04:39:49.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.387+0000 7f8c3126d700 1 -- 172.21.15.112:0/2360193307 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8c0c066f30 msgr2=0x7f8c0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:49.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.387+0000 7f8c3126d700 1 --2- 172.21.15.112:0/2360193307 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8c0c066f30 0x7f8c0c0693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0011e0 tx=0x7f8c1c009040 comp rx=0 tx=0).stop 2023-10-06T04:39:49.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.387+0000 7f8c3126d700 1 -- 172.21.15.112:0/2360193307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c2c1575b0 msgr2=0x7f8c2c0c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:49.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.387+0000 7f8c3126d700 1 --2- 172.21.15.112:0/2360193307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c2c1575b0 0x7f8c2c0c84d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0b47e0 tx=0x7f8c14017000 comp rx=0 tx=0).stop 2023-10-06T04:39:49.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.387+0000 7f8c3126d700 1 -- 172.21.15.112:0/2360193307 shutdown_connections 2023-10-06T04:39:49.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.387+0000 7f8c3126d700 1 --2- 172.21.15.112:0/2360193307 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8c0c066f30 0x7f8c0c0693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.387+0000 7f8c3126d700 1 --2- 172.21.15.112:0/2360193307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c2c157980 0x7f8c2c0c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.387+0000 7f8c3126d700 1 --2- 172.21.15.112:0/2360193307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c2c0ce0a0 0x7f8c2c0af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.387+0000 7f8c3126d700 1 --2- 172.21.15.112:0/2360193307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c2c1575b0 0x7f8c2c0c84d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.387+0000 7f8c3126d700 1 -- 172.21.15.112:0/2360193307 >> 172.21.15.112:0/2360193307 conn(0x7f8c2c0631f0 msgr2=0x7f8c2c0b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:49.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.387+0000 7f8c3126d700 1 -- 172.21.15.112:0/2360193307 shutdown_connections 2023-10-06T04:39:49.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.387+0000 7f8c3126d700 1 -- 172.21.15.112:0/2360193307 wait complete. 2023-10-06T04:39:49.401 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:39:49.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.516+0000 7fea66037700 1 Processor -- start 2023-10-06T04:39:49.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.516+0000 7fea66037700 1 -- start start 2023-10-06T04:39:49.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.516+0000 7fea66037700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fea60159a20 0x7fea600cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:49.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.517+0000 7fea66037700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fea6006d3b0 0x7fea600cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:49.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.517+0000 7fea66037700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6015af50 con 0x7fea6015a9f0 2023-10-06T04:39:49.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.517+0000 7fea66037700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea600cca70 con 0x7fea60159a20 2023-10-06T04:39:49.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.517+0000 7fea66037700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6008a080 con 0x7fea6006d3b0 2023-10-06T04:39:49.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.517+0000 7fea5f7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fea60159a20 0x7fea600cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:49.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.517+0000 7fea5ffff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fea6015a9f0 0x7fea6015d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:37494/0 (socket says 172.21.15.112:37494) 2023-10-06T04:39:49.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.517+0000 7fea5ffff700 1 -- 172.21.15.112:0/328642430 learned_addr learned my addr 172.21.15.112:0/328642430 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:49.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.517+0000 7fea5effd700 1 --2- 172.21.15.112:0/328642430 >> v2:172.21.15.179:3300/0 conn(0x7fea6006d3b0 0x7fea600cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:49.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.517+0000 7fea5f7fe700 1 -- 172.21.15.112:0/328642430 >> v2:172.21.15.179:3300/0 conn(0x7fea6006d3b0 msgr2=0x7fea600cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:49.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.517+0000 7fea5f7fe700 1 --2- 172.21.15.112:0/328642430 >> v2:172.21.15.179:3300/0 conn(0x7fea6006d3b0 0x7fea600cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.517+0000 7fea5f7fe700 1 -- 172.21.15.112:0/328642430 >> v1:172.21.15.112:6789/0 conn(0x7fea6015a9f0 legacy=0x7fea6015d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:49.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.517+0000 7fea5f7fe700 1 -- 172.21.15.112:0/328642430 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea600cae50 con 0x7fea60159a20 2023-10-06T04:39:49.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.517+0000 7fea5e7fc700 1 -- 172.21.15.112:0/328642430 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449196515 0 0) 0x7fea6015af50 con 0x7fea6015a9f0 2023-10-06T04:39:49.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.517+0000 7fea5f7fe700 1 --2- 172.21.15.112:0/328642430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea60159a20 0x7fea600cb7f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fea6008ac00 tx=0x7fea500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe87da0b97dd02b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:49.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.517+0000 7fea5e7fc700 1 -- 172.21.15.112:0/328642430 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50009e80 con 0x7fea60159a20 2023-10-06T04:39:49.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.517+0000 7fea5e7fc700 1 -- 172.21.15.112:0/328642430 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5000b820 con 0x7fea60159a20 2023-10-06T04:39:49.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.517+0000 7fea5e7fc700 1 -- 172.21.15.112:0/328642430 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5000bba0 con 0x7fea60159a20 2023-10-06T04:39:49.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.518+0000 7fea66037700 1 -- 172.21.15.112:0/328642430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea60159a20 msgr2=0x7fea600cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:49.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.518+0000 7fea66037700 1 --2- 172.21.15.112:0/328642430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea60159a20 0x7fea600cb7f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fea6008ac00 tx=0x7fea500091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.518+0000 7fea66037700 1 -- 172.21.15.112:0/328642430 shutdown_connections 2023-10-06T04:39:49.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.518+0000 7fea66037700 1 --2- 172.21.15.112:0/328642430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea60159a20 0x7fea600cb7f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.518+0000 7fea66037700 1 --2- 172.21.15.112:0/328642430 >> v2:172.21.15.179:3300/0 conn(0x7fea6006d3b0 0x7fea600cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.518+0000 7fea66037700 1 -- 172.21.15.112:0/328642430 >> 172.21.15.112:0/328642430 conn(0x7fea6006cfb0 msgr2=0x7fea600d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:49.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.518+0000 7fea66037700 1 -- 172.21.15.112:0/328642430 shutdown_connections 2023-10-06T04:39:49.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.518+0000 7fea66037700 1 -- 172.21.15.112:0/328642430 wait complete. 2023-10-06T04:39:49.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.519+0000 7fea66037700 1 Processor -- start 2023-10-06T04:39:49.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.519+0000 7fea66037700 1 -- start start 2023-10-06T04:39:49.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.520+0000 7fea66037700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea6006d3b0 0x7fea600b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:49.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.520+0000 7fea66037700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea60159a20 0x7fea600b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:49.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.520+0000 7fea66037700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea6015a9f0 0x7fea60146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:49.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.520+0000 7fea66037700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea600b3d50 con 0x7fea6015a9f0 2023-10-06T04:39:49.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.520+0000 7fea66037700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea600b4c70 con 0x7fea60159a20 2023-10-06T04:39:49.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.520+0000 7fea66037700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea600b4340 con 0x7fea6006d3b0 2023-10-06T04:39:49.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.520+0000 7fea5ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea6015a9f0 0x7fea60146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:49.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.520+0000 7fea5ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea6015a9f0 0x7fea60146db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34370/0 (socket says 172.21.15.112:34370) 2023-10-06T04:39:49.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.520+0000 7fea5ffff700 1 -- 172.21.15.112:0/2136220037 learned_addr learned my addr 172.21.15.112:0/2136220037 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:49.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.520+0000 7fea5effd700 1 --2- 172.21.15.112:0/2136220037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea60159a20 0x7fea600b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:49.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.520+0000 7fea5f7fe700 1 --2- 172.21.15.112:0/2136220037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea6006d3b0 0x7fea600b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:49.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.520+0000 7fea5ffff700 1 -- 172.21.15.112:0/2136220037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea6006d3b0 msgr2=0x7fea600b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:49.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.520+0000 7fea5ffff700 1 --2- 172.21.15.112:0/2136220037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea6006d3b0 0x7fea600b62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.520+0000 7fea5ffff700 1 -- 172.21.15.112:0/2136220037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea60159a20 msgr2=0x7fea600b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:49.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.520+0000 7fea5ffff700 1 --2- 172.21.15.112:0/2136220037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea60159a20 0x7fea600b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.520+0000 7fea5ffff700 1 -- 172.21.15.112:0/2136220037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea50009420 con 0x7fea6015a9f0 2023-10-06T04:39:49.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.520+0000 7fea5f7fe700 1 --2- 172.21.15.112:0/2136220037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea6006d3b0 0x7fea600b62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:49.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.520+0000 7fea5ffff700 1 --2- 172.21.15.112:0/2136220037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea6015a9f0 0x7fea60146db0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fea5800cbf0 tx=0x7fea580019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:49.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.521+0000 7fea477fe700 1 -- 172.21.15.112:0/2136220037 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5800a910 con 0x7fea6015a9f0 2023-10-06T04:39:49.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.521+0000 7fea477fe700 1 -- 172.21.15.112:0/2136220037 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5800aa70 con 0x7fea6015a9f0 2023-10-06T04:39:49.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.521+0000 7fea477fe700 1 -- 172.21.15.112:0/2136220037 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5800ae30 con 0x7fea6015a9f0 2023-10-06T04:39:49.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.521+0000 7fea66037700 1 -- 172.21.15.112:0/2136220037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea600b4620 con 0x7fea6015a9f0 2023-10-06T04:39:49.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.521+0000 7fea66037700 1 -- 172.21.15.112:0/2136220037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea601472f0 con 0x7fea6015a9f0 2023-10-06T04:39:49.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.522+0000 7fea66037700 1 -- 172.21.15.112:0/2136220037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea600b4ac0 con 0x7fea6015a9f0 2023-10-06T04:39:49.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.522+0000 7fea477fe700 1 -- 172.21.15.112:0/2136220037 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea58007300 con 0x7fea6015a9f0 2023-10-06T04:39:49.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.522+0000 7fea477fe700 1 --2- 172.21.15.112:0/2136220037 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fea4c066f30 0x7fea4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:49.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.522+0000 7fea477fe700 1 -- 172.21.15.112:0/2136220037 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fea58084ab0 con 0x7fea6015a9f0 2023-10-06T04:39:49.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.522+0000 7fea5f7fe700 1 --2- 172.21.15.112:0/2136220037 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fea4c066f30 0x7fea4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:49.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.523+0000 7fea5f7fe700 1 --2- 172.21.15.112:0/2136220037 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fea4c066f30 0x7fea4c0693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fea500093f0 tx=0x7fea50017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:49.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.527+0000 7fea477fe700 1 -- 172.21.15.112:0/2136220037 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea58051bc0 con 0x7fea6015a9f0 2023-10-06T04:39:49.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.710+0000 7fea66037700 1 -- 172.21.15.112:0/2136220037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fea600b4de0 con 0x7fea6015a9f0 2023-10-06T04:39:49.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.710+0000 7fea477fe700 1 -- 172.21.15.112:0/2136220037 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fea580551e0 con 0x7fea6015a9f0 2023-10-06T04:39:49.713 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-10-06T04:39:49.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.712+0000 7fea66037700 1 -- 172.21.15.112:0/2136220037 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fea4c066f30 msgr2=0x7fea4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:49.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.712+0000 7fea66037700 1 --2- 172.21.15.112:0/2136220037 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fea4c066f30 0x7fea4c0693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fea500093f0 tx=0x7fea50017000 comp rx=0 tx=0).stop 2023-10-06T04:39:49.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.712+0000 7fea66037700 1 -- 172.21.15.112:0/2136220037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea6015a9f0 msgr2=0x7fea60146db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:49.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.712+0000 7fea66037700 1 --2- 172.21.15.112:0/2136220037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea6015a9f0 0x7fea60146db0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fea5800cbf0 tx=0x7fea580019b0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.712+0000 7fea66037700 1 -- 172.21.15.112:0/2136220037 shutdown_connections 2023-10-06T04:39:49.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.712+0000 7fea66037700 1 --2- 172.21.15.112:0/2136220037 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fea4c066f30 0x7fea4c0693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.712+0000 7fea66037700 1 --2- 172.21.15.112:0/2136220037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea6015a9f0 0x7fea60146db0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.712+0000 7fea66037700 1 --2- 172.21.15.112:0/2136220037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea6006d3b0 0x7fea600b62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.712+0000 7fea66037700 1 --2- 172.21.15.112:0/2136220037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea60159a20 0x7fea600b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.712+0000 7fea66037700 1 -- 172.21.15.112:0/2136220037 >> 172.21.15.112:0/2136220037 conn(0x7fea6006cfb0 msgr2=0x7fea600ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:49.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.712+0000 7fea66037700 1 -- 172.21.15.112:0/2136220037 shutdown_connections 2023-10-06T04:39:49.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.712+0000 7fea66037700 1 -- 172.21.15.112:0/2136220037 wait complete. 2023-10-06T04:39:49.795 INFO:tasks.cephfs_test_runner:Starting test: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2023-10-06T04:39:49.796 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2023-10-06T04:39:49.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.908+0000 7ff78f867700 1 Processor -- start 2023-10-06T04:39:49.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.908+0000 7ff78f867700 1 -- start start 2023-10-06T04:39:49.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.909+0000 7ff78f867700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff788159d50 0x7ff7880b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:49.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.909+0000 7ff78f867700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff78815a120 0x7ff7880cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:49.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.909+0000 7ff78f867700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7880cd740 con 0x7ff7880b0e70 2023-10-06T04:39:49.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.909+0000 7ff78f867700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7880ccb30 con 0x7ff788159d50 2023-10-06T04:39:49.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.909+0000 7ff78f867700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7880cce10 con 0x7ff78815a120 2023-10-06T04:39:49.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.909+0000 7ff78d603700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff788159d50 0x7ff7880b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:49.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.909+0000 7ff78d603700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff788159d50 0x7ff7880b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34382/0 (socket says 172.21.15.112:34382) 2023-10-06T04:39:49.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.909+0000 7ff78d603700 1 -- 172.21.15.112:0/1376011750 learned_addr learned my addr 172.21.15.112:0/1376011750 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:49.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.909+0000 7ff78ce02700 1 --2- 172.21.15.112:0/1376011750 >> v2:172.21.15.179:3300/0 conn(0x7ff78815a120 0x7ff7880cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:49.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.909+0000 7ff78d603700 1 -- 172.21.15.112:0/1376011750 >> v2:172.21.15.179:3300/0 conn(0x7ff78815a120 msgr2=0x7ff7880cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:49.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.909+0000 7ff78d603700 1 --2- 172.21.15.112:0/1376011750 >> v2:172.21.15.179:3300/0 conn(0x7ff78815a120 0x7ff7880cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.909+0000 7ff78d603700 1 -- 172.21.15.112:0/1376011750 >> v1:172.21.15.179:6789/0 conn(0x7ff7880b0e70 legacy=0x7ff7880b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:49.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.909+0000 7ff78d603700 1 -- 172.21.15.112:0/1376011750 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7880cd0f0 con 0x7ff788159d50 2023-10-06T04:39:49.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.909+0000 7ff78d603700 1 --2- 172.21.15.112:0/1376011750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff788159d50 0x7ff7880b3040 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff788088c80 tx=0x7ff778009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea39c7e7c60301cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:49.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.909+0000 7ff787fff700 1 -- 172.21.15.112:0/1376011750 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77800e070 con 0x7ff788159d50 2023-10-06T04:39:49.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.910+0000 7ff787fff700 1 -- 172.21.15.112:0/1376011750 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77800ba50 con 0x7ff788159d50 2023-10-06T04:39:49.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.910+0000 7ff787fff700 1 -- 172.21.15.112:0/1376011750 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7780092e0 con 0x7ff788159d50 2023-10-06T04:39:49.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.910+0000 7ff78f867700 1 -- 172.21.15.112:0/1376011750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff788159d50 msgr2=0x7ff7880b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:49.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.910+0000 7ff78f867700 1 --2- 172.21.15.112:0/1376011750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff788159d50 0x7ff7880b3040 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff788088c80 tx=0x7ff778009840 comp rx=0 tx=0).stop 2023-10-06T04:39:49.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.910+0000 7ff78f867700 1 -- 172.21.15.112:0/1376011750 shutdown_connections 2023-10-06T04:39:49.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.910+0000 7ff78f867700 1 --2- 172.21.15.112:0/1376011750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff788159d50 0x7ff7880b3040 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.910+0000 7ff78f867700 1 --2- 172.21.15.112:0/1376011750 >> v2:172.21.15.179:3300/0 conn(0x7ff78815a120 0x7ff7880cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.910+0000 7ff78f867700 1 -- 172.21.15.112:0/1376011750 >> 172.21.15.112:0/1376011750 conn(0x7ff788099b60 msgr2=0x7ff78806cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:49.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.910+0000 7ff78f867700 1 -- 172.21.15.112:0/1376011750 shutdown_connections 2023-10-06T04:39:49.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.910+0000 7ff78f867700 1 -- 172.21.15.112:0/1376011750 wait complete. 2023-10-06T04:39:49.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.911+0000 7ff78f867700 1 Processor -- start 2023-10-06T04:39:49.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.911+0000 7ff78f867700 1 -- start start 2023-10-06T04:39:49.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.912+0000 7ff78f867700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7880b0e70 0x7ff78816e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:49.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.912+0000 7ff78f867700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff788159d50 0x7ff788154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:49.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.912+0000 7ff78f867700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff78815a120 0x7ff78815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:49.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.912+0000 7ff78f867700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7880b5e00 con 0x7ff7880b0e70 2023-10-06T04:39:49.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.912+0000 7ff78f867700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78816b4a0 con 0x7ff788159d50 2023-10-06T04:39:49.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.912+0000 7ff78f867700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78816ea40 con 0x7ff78815a120 2023-10-06T04:39:49.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.912+0000 7ff78d603700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7880b0e70 0x7ff78816e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:49.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.912+0000 7ff78d603700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7880b0e70 0x7ff78816e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34394/0 (socket says 172.21.15.112:34394) 2023-10-06T04:39:49.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.912+0000 7ff78d603700 1 -- 172.21.15.112:0/2494124466 learned_addr learned my addr 172.21.15.112:0/2494124466 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:49.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.913+0000 7ff78d603700 1 -- 172.21.15.112:0/2494124466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff78815a120 msgr2=0x7ff78815fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:49.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.913+0000 7ff78ce02700 1 --2- 172.21.15.112:0/2494124466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff788159d50 0x7ff788154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:49.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.913+0000 7ff78de04700 1 --2- 172.21.15.112:0/2494124466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff78815a120 0x7ff78815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:49.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.913+0000 7ff78d603700 1 --2- 172.21.15.112:0/2494124466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff78815a120 0x7ff78815fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.913+0000 7ff78d603700 1 -- 172.21.15.112:0/2494124466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff788159d50 msgr2=0x7ff788154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:49.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.913+0000 7ff78d603700 1 --2- 172.21.15.112:0/2494124466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff788159d50 0x7ff788154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:49.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.913+0000 7ff78d603700 1 -- 172.21.15.112:0/2494124466 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff778009ae0 con 0x7ff7880b0e70 2023-10-06T04:39:49.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.913+0000 7ff78ce02700 1 --2- 172.21.15.112:0/2494124466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff788159d50 0x7ff788154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:49.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.913+0000 7ff78de04700 1 --2- 172.21.15.112:0/2494124466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff78815a120 0x7ff78815fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:49.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.913+0000 7ff78d603700 1 --2- 172.21.15.112:0/2494124466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7880b0e70 0x7ff78816e500 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff778009fd0 tx=0x7ff778018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:49.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.913+0000 7ff7857fa700 1 -- 172.21.15.112:0/2494124466 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff778008a80 con 0x7ff7880b0e70 2023-10-06T04:39:49.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.913+0000 7ff7857fa700 1 -- 172.21.15.112:0/2494124466 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff778008be0 con 0x7ff7880b0e70 2023-10-06T04:39:49.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.913+0000 7ff7857fa700 1 -- 172.21.15.112:0/2494124466 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff778026460 con 0x7ff7880b0e70 2023-10-06T04:39:49.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.913+0000 7ff78f867700 1 -- 172.21.15.112:0/2494124466 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78816a890 con 0x7ff7880b0e70 2023-10-06T04:39:49.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.913+0000 7ff78f867700 1 -- 172.21.15.112:0/2494124466 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78816ae50 con 0x7ff7880b0e70 2023-10-06T04:39:49.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.914+0000 7ff78f867700 1 -- 172.21.15.112:0/2494124466 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78805f230 con 0x7ff7880b0e70 2023-10-06T04:39:49.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.914+0000 7ff7857fa700 1 -- 172.21.15.112:0/2494124466 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff778003040 con 0x7ff7880b0e70 2023-10-06T04:39:49.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.915+0000 7ff7857fa700 1 --2- 172.21.15.112:0/2494124466 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff774066f30 0x7ff7740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:49.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.915+0000 7ff78ce02700 1 --2- 172.21.15.112:0/2494124466 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff774066f30 0x7ff7740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:49.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.915+0000 7ff7857fa700 1 -- 172.21.15.112:0/2494124466 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff7780862f0 con 0x7ff7880b0e70 2023-10-06T04:39:49.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.915+0000 7ff78ce02700 1 --2- 172.21.15.112:0/2494124466 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff774066f30 0x7ff7740693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff77c006fd0 tx=0x7ff77c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:49.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:49.919+0000 7ff7857fa700 1 -- 172.21.15.112:0/2494124466 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff778053400 con 0x7ff7880b0e70 2023-10-06T04:39:50.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.178+0000 7ff78f867700 1 -- 172.21.15.112:0/2494124466 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) v1 -- 0x7ff7880b67f0 con 0x7ff7880b0e70 2023-10-06T04:39:50.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.782+0000 7ff7857fa700 1 -- 172.21.15.112:0/2494124466 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v47) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff778056a20 con 0x7ff7880b0e70 2023-10-06T04:39:50.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.784+0000 7ff78f867700 1 -- 172.21.15.112:0/2494124466 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff774066f30 msgr2=0x7ff7740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:50.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.784+0000 7ff78f867700 1 --2- 172.21.15.112:0/2494124466 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff774066f30 0x7ff7740693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff77c006fd0 tx=0x7ff77c008040 comp rx=0 tx=0).stop 2023-10-06T04:39:50.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.784+0000 7ff78f867700 1 -- 172.21.15.112:0/2494124466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7880b0e70 msgr2=0x7ff78816e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:50.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.784+0000 7ff78f867700 1 --2- 172.21.15.112:0/2494124466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7880b0e70 0x7ff78816e500 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff778009fd0 tx=0x7ff778018000 comp rx=0 tx=0).stop 2023-10-06T04:39:50.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.784+0000 7ff78f867700 1 -- 172.21.15.112:0/2494124466 shutdown_connections 2023-10-06T04:39:50.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.784+0000 7ff78f867700 1 --2- 172.21.15.112:0/2494124466 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff774066f30 0x7ff7740693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:50.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.784+0000 7ff78f867700 1 --2- 172.21.15.112:0/2494124466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff78815a120 0x7ff78815fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:50.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.784+0000 7ff78f867700 1 --2- 172.21.15.112:0/2494124466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7880b0e70 0x7ff78816e500 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:50.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.784+0000 7ff78f867700 1 --2- 172.21.15.112:0/2494124466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff788159d50 0x7ff788154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:50.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.784+0000 7ff78f867700 1 -- 172.21.15.112:0/2494124466 >> 172.21.15.112:0/2494124466 conn(0x7ff788099b60 msgr2=0x7ff78806f200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:50.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.784+0000 7ff78f867700 1 -- 172.21.15.112:0/2494124466 shutdown_connections 2023-10-06T04:39:50.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.785+0000 7ff78f867700 1 -- 172.21.15.112:0/2494124466 wait complete. 2023-10-06T04:39:50.799 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T04:39:50.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.914+0000 7f0747ca6700 1 Processor -- start 2023-10-06T04:39:50.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.914+0000 7f0747ca6700 1 -- start start 2023-10-06T04:39:50.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.915+0000 7f0747ca6700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f07400c90b0 0x7f07400b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:50.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.915+0000 7f0747ca6700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07400b3370 0x7f074006c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:50.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.915+0000 7f0747ca6700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0740159e40 con 0x7f07400c9480 2023-10-06T04:39:50.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.915+0000 7f0747ca6700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074006bc80 con 0x7f07400c90b0 2023-10-06T04:39:50.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.915+0000 7f0747ca6700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074006c110 con 0x7f07400b3370 2023-10-06T04:39:50.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.915+0000 7f0746243700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f07400c9480 0x7f0740067b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:37510/0 (socket says 172.21.15.112:37510) 2023-10-06T04:39:50.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.915+0000 7f0746243700 1 -- 172.21.15.112:0/2382607801 learned_addr learned my addr 172.21.15.112:0/2382607801 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:50.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0744a40700 1 -- 172.21.15.112:0/2382607801 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770056609 0 0) 0x7f0738001490 con 0x7f07400c9480 2023-10-06T04:39:50.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0744a40700 1 -- 172.21.15.112:0/2382607801 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f072c003570 con 0x7f07400c9480 2023-10-06T04:39:50.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0745a42700 1 --2- 172.21.15.112:0/2382607801 >> v2:172.21.15.179:3300/0 conn(0x7f07400c90b0 0x7f07400b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:50.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0745241700 1 --2- 172.21.15.112:0/2382607801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07400b3370 0x7f074006c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:50.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0744a40700 1 -- 172.21.15.112:0/2382607801 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4097313167 0 0) 0x7f072c003570 con 0x7f07400c9480 2023-10-06T04:39:50.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0744a40700 1 -- 172.21.15.112:0/2382607801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07400b3370 msgr2=0x7f074006c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:50.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0744a40700 1 --2- 172.21.15.112:0/2382607801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07400b3370 0x7f074006c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:50.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0744a40700 1 -- 172.21.15.112:0/2382607801 >> v2:172.21.15.179:3300/0 conn(0x7f07400c90b0 msgr2=0x7f07400b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:50.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0744a40700 1 --2- 172.21.15.112:0/2382607801 >> v2:172.21.15.179:3300/0 conn(0x7f07400c90b0 0x7f07400b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:50.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0744a40700 1 -- 172.21.15.112:0/2382607801 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074006b070 con 0x7f07400c9480 2023-10-06T04:39:50.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0744a40700 1 -- 172.21.15.112:0/2382607801 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f0738001980 con 0x7f07400c9480 2023-10-06T04:39:50.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0744a40700 1 -- 172.21.15.112:0/2382607801 >> v1:172.21.15.112:6789/0 conn(0x7f07400c9480 legacy=0x7f0740067b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:50.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0744a40700 1 --2- 172.21.15.112:0/2382607801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f072c003a60 0x7f072c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:50.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0744a40700 1 --2- 172.21.15.112:0/2382607801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07400b3370 0x7f072c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:50.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0744a40700 1 --2- 172.21.15.112:0/2382607801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f072c004d50 0x7f072c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:50.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0744a40700 1 -- 172.21.15.112:0/2382607801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074006bc80 con 0x7f072c003a60 2023-10-06T04:39:50.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0744a40700 1 -- 172.21.15.112:0/2382607801 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074006c110 con 0x7f072c004d50 2023-10-06T04:39:50.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0744a40700 1 -- 172.21.15.112:0/2382607801 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072c00bb90 con 0x7f07400b3370 2023-10-06T04:39:50.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0745a42700 1 --2- 172.21.15.112:0/2382607801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f072c003a60 0x7f072c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:50.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0745241700 1 --2- 172.21.15.112:0/2382607801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07400b3370 0x7f072c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:50.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0746243700 1 --2- 172.21.15.112:0/2382607801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f072c004d50 0x7f072c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:50.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0745a42700 1 -- 172.21.15.112:0/2382607801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07400b3370 msgr2=0x7f072c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:50.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0745a42700 1 --2- 172.21.15.112:0/2382607801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07400b3370 0x7f072c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:50.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0745a42700 1 -- 172.21.15.112:0/2382607801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f072c004d50 msgr2=0x7f072c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:50.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0745a42700 1 --2- 172.21.15.112:0/2382607801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f072c004d50 0x7f072c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:50.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.916+0000 7f0745a42700 1 -- 172.21.15.112:0/2382607801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072c003570 con 0x7f072c003a60 2023-10-06T04:39:50.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.917+0000 7f0745a42700 1 --2- 172.21.15.112:0/2382607801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f072c003a60 0x7f072c003e70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f073c00bb90 tx=0x7f073c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45259c4fbbdd2b01 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:50.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.917+0000 7f0744a40700 1 -- 172.21.15.112:0/2382607801 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c00d5d0 con 0x7f072c003a60 2023-10-06T04:39:50.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.917+0000 7f0744a40700 1 -- 172.21.15.112:0/2382607801 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073c00d730 con 0x7f072c003a60 2023-10-06T04:39:50.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.917+0000 7f0744a40700 1 -- 172.21.15.112:0/2382607801 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c00daf0 con 0x7f072c003a60 2023-10-06T04:39:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.917+0000 7f0747ca6700 1 -- 172.21.15.112:0/2382607801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f072c003a60 msgr2=0x7f072c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.917+0000 7f0747ca6700 1 --2- 172.21.15.112:0/2382607801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f072c003a60 0x7f072c003e70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f073c00bb90 tx=0x7f073c008040 comp rx=0 tx=0).stop 2023-10-06T04:39:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.917+0000 7f0746243700 1 -- 172.21.15.112:0/2382607801 reap_dead start 2023-10-06T04:39:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.917+0000 7f0747ca6700 1 -- 172.21.15.112:0/2382607801 shutdown_connections 2023-10-06T04:39:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.917+0000 7f0747ca6700 1 -- 172.21.15.112:0/2382607801 >> 172.21.15.112:0/2382607801 conn(0x7f074006e360 msgr2=0x7f07400af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.917+0000 7f0747ca6700 1 -- 172.21.15.112:0/2382607801 shutdown_connections 2023-10-06T04:39:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.917+0000 7f0747ca6700 1 -- 172.21.15.112:0/2382607801 wait complete. 2023-10-06T04:39:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.918+0000 7f0747ca6700 1 Processor -- start 2023-10-06T04:39:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.918+0000 7f0747ca6700 1 -- start start 2023-10-06T04:39:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.919+0000 7f0747ca6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f072c003a60 0x7f074015d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.919+0000 7f0747ca6700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07401549a0 0x7f07400cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.919+0000 7f0747ca6700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0740154ee0 0x7f0740153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.919+0000 7f0747ca6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07401557a0 con 0x7f072c003a60 2023-10-06T04:39:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.919+0000 7f0747ca6700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074015d890 con 0x7f0740154ee0 2023-10-06T04:39:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.919+0000 7f0747ca6700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074016ceb0 con 0x7f07401549a0 2023-10-06T04:39:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.919+0000 7f0745a42700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f072c003a60 0x7f074015d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.919+0000 7f0745a42700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f072c003a60 0x7f074015d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34418/0 (socket says 172.21.15.112:34418) 2023-10-06T04:39:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.919+0000 7f0745a42700 1 -- 172.21.15.112:0/1824861506 learned_addr learned my addr 172.21.15.112:0/1824861506 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.919+0000 7f0745241700 1 --2- 172.21.15.112:0/1824861506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07401549a0 0x7f07400cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.919+0000 7f0746243700 1 --2- 172.21.15.112:0/1824861506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0740154ee0 0x7f0740153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.919+0000 7f0745a42700 1 -- 172.21.15.112:0/1824861506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07401549a0 msgr2=0x7f07400cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.919+0000 7f0745a42700 1 --2- 172.21.15.112:0/1824861506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07401549a0 0x7f07400cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.919+0000 7f0745a42700 1 -- 172.21.15.112:0/1824861506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0740154ee0 msgr2=0x7f0740153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:50.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.919+0000 7f0745a42700 1 --2- 172.21.15.112:0/1824861506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0740154ee0 0x7f0740153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:50.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.919+0000 7f0745a42700 1 -- 172.21.15.112:0/1824861506 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074016d190 con 0x7f072c003a60 2023-10-06T04:39:50.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.920+0000 7f0745a42700 1 --2- 172.21.15.112:0/1824861506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f072c003a60 0x7f074015d350 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f073c006fd0 tx=0x7f073c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:50.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.920+0000 7f0735ffb700 1 -- 172.21.15.112:0/1824861506 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c014790 con 0x7f072c003a60 2023-10-06T04:39:50.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.920+0000 7f0735ffb700 1 -- 172.21.15.112:0/1824861506 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073c014930 con 0x7f072c003a60 2023-10-06T04:39:50.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.920+0000 7f0747ca6700 1 -- 172.21.15.112:0/1824861506 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074016d470 con 0x7f072c003a60 2023-10-06T04:39:50.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.920+0000 7f0735ffb700 1 -- 172.21.15.112:0/1824861506 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c014cf0 con 0x7f072c003a60 2023-10-06T04:39:50.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.920+0000 7f0747ca6700 1 -- 172.21.15.112:0/1824861506 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074016da30 con 0x7f072c003a60 2023-10-06T04:39:50.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.921+0000 7f0747ca6700 1 -- 172.21.15.112:0/1824861506 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07400cb3d0 con 0x7f072c003a60 2023-10-06T04:39:50.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.921+0000 7f0735ffb700 1 -- 172.21.15.112:0/1824861506 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f073c01d610 con 0x7f072c003a60 2023-10-06T04:39:50.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.922+0000 7f0735ffb700 1 --2- 172.21.15.112:0/1824861506 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0724066f30 0x7f07240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:50.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.922+0000 7f0745241700 1 --2- 172.21.15.112:0/1824861506 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0724066f30 0x7f07240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:50.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.922+0000 7f0735ffb700 1 -- 172.21.15.112:0/1824861506 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f073c085e00 con 0x7f072c003a60 2023-10-06T04:39:50.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.922+0000 7f0745241700 1 --2- 172.21.15.112:0/1824861506 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0724066f30 0x7f07240693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0740160fa0 tx=0x7f0730008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:50.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:50.926+0000 7f0735ffb700 1 -- 172.21.15.112:0/1824861506 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f073c052fd0 con 0x7f072c003a60 2023-10-06T04:39:51.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.107+0000 7f0747ca6700 1 -- 172.21.15.112:0/1824861506 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f074005f230 con 0x7f072c003a60 2023-10-06T04:39:51.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.111+0000 7f0735ffb700 1 -- 172.21.15.112:0/1824861506 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f073c02c0c0 con 0x7f072c003a60 2023-10-06T04:39:51.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.113+0000 7f0747ca6700 1 -- 172.21.15.112:0/1824861506 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0724066f30 msgr2=0x7f07240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.113+0000 7f0747ca6700 1 --2- 172.21.15.112:0/1824861506 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0724066f30 0x7f07240693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0740160fa0 tx=0x7f0730008040 comp rx=0 tx=0).stop 2023-10-06T04:39:51.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.113+0000 7f0747ca6700 1 -- 172.21.15.112:0/1824861506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f072c003a60 msgr2=0x7f074015d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.113+0000 7f0747ca6700 1 --2- 172.21.15.112:0/1824861506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f072c003a60 0x7f074015d350 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f073c006fd0 tx=0x7f073c01b000 comp rx=0 tx=0).stop 2023-10-06T04:39:51.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.113+0000 7f0747ca6700 1 -- 172.21.15.112:0/1824861506 shutdown_connections 2023-10-06T04:39:51.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.113+0000 7f0747ca6700 1 --2- 172.21.15.112:0/1824861506 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0724066f30 0x7f07240693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.113+0000 7f0747ca6700 1 --2- 172.21.15.112:0/1824861506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0740154ee0 0x7f0740153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.113+0000 7f0747ca6700 1 --2- 172.21.15.112:0/1824861506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f072c003a60 0x7f074015d350 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.113+0000 7f0747ca6700 1 --2- 172.21.15.112:0/1824861506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07401549a0 0x7f07400cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.113+0000 7f0747ca6700 1 -- 172.21.15.112:0/1824861506 >> 172.21.15.112:0/1824861506 conn(0x7f074006e360 msgr2=0x7f07400b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:51.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.113+0000 7f0747ca6700 1 -- 172.21.15.112:0/1824861506 shutdown_connections 2023-10-06T04:39:51.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.113+0000 7f0747ca6700 1 -- 172.21.15.112:0/1824861506 wait complete. 2023-10-06T04:39:51.127 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T04:39:51.127 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:39:51.171 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:39:51.215 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T04:39:51.215 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T04:39:51.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:51.215 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-06T04:39:51.246 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-10-06T04:39:51.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:51.246 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T04:39:51.302 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T04:39:51.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:51.302 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-06T04:39:51.341 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-10-06T04:39:51.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:51.341 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T04:39:51.398 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-06T04:39:51.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:51.398 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-06T04:39:51.437 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-10-06T04:39:51.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:51.437 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T04:39:51.492 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-06T04:39:51.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:39:51.492 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-06T04:39:51.530 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-10-06T04:39:51.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:39:51.531 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T04:39:51.586 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T04:39:51.587 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:39:51.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.698+0000 7f74af59e700 1 Processor -- start 2023-10-06T04:39:51.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.698+0000 7f74af59e700 1 -- start start 2023-10-06T04:39:51.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.699+0000 7f74af59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f74b00ad3d0 0x7f74b00cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.699+0000 7f74af59e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b00ccc30 con 0x7f74b00d1430 2023-10-06T04:39:51.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.699+0000 7f74af59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b00c60f0 con 0x7f74b00ce690 2023-10-06T04:39:51.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.699+0000 7f74af59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b006d630 con 0x7f74b00ad3d0 2023-10-06T04:39:51.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.699+0000 7f74aed9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f74b00d1430 0x7f74b00c6580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:37522/0 (socket says 172.21.15.112:37522) 2023-10-06T04:39:51.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.699+0000 7f74aed9d700 1 -- 172.21.15.112:0/3865544620 learned_addr learned my addr 172.21.15.112:0/3865544620 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:51.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.699+0000 7f74add9b700 1 --2- 172.21.15.112:0/3865544620 >> v2:172.21.15.179:3300/0 conn(0x7f74b00ad3d0 0x7f74b00cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.699+0000 7f74ad59a700 1 -- 172.21.15.112:0/3865544620 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467947970 0 0) 0x7f74b00ccc30 con 0x7f74b00d1430 2023-10-06T04:39:51.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.699+0000 7f74ad59a700 1 -- 172.21.15.112:0/3865544620 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7498003570 con 0x7f74b00d1430 2023-10-06T04:39:51.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74ad59a700 1 -- 172.21.15.112:0/3865544620 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4168708626 0 0) 0x7f74b00c60f0 con 0x7f74b00ce690 2023-10-06T04:39:51.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74ad59a700 1 -- 172.21.15.112:0/3865544620 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74b00ccc30 con 0x7f74b00ce690 2023-10-06T04:39:51.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74ad59a700 1 -- 172.21.15.112:0/3865544620 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3108950736 0 0) 0x7f7498003570 con 0x7f74b00d1430 2023-10-06T04:39:51.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74ad59a700 1 -- 172.21.15.112:0/3865544620 >> v2:172.21.15.179:3300/0 conn(0x7f74b00ad3d0 msgr2=0x7f74b00cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:51.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74ad59a700 1 --2- 172.21.15.112:0/3865544620 >> v2:172.21.15.179:3300/0 conn(0x7f74b00ad3d0 0x7f74b00cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74ad59a700 1 -- 172.21.15.112:0/3865544620 >> v1:172.21.15.179:6789/0 conn(0x7f74b00ce690 legacy=0x7f74b0159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74ad59a700 1 -- 172.21.15.112:0/3865544620 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b00c57c0 con 0x7f74b00d1430 2023-10-06T04:39:51.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74ad59a700 1 -- 172.21.15.112:0/3865544620 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f74a80017f0 con 0x7f74b00d1430 2023-10-06T04:39:51.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74ad59a700 1 -- 172.21.15.112:0/3865544620 >> v1:172.21.15.112:6789/0 conn(0x7f74b00d1430 legacy=0x7f74b00c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74ad59a700 1 --2- 172.21.15.112:0/3865544620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7498003c40 0x7f7498004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74ad59a700 1 --2- 172.21.15.112:0/3865544620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7498004810 0x7f7498004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74ad59a700 1 --2- 172.21.15.112:0/3865544620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7498005210 0x7f749800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74ad59a700 1 -- 172.21.15.112:0/3865544620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b006d630 con 0x7f7498004810 2023-10-06T04:39:51.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74ad59a700 1 -- 172.21.15.112:0/3865544620 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749800c1b0 con 0x7f7498003c40 2023-10-06T04:39:51.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74ad59a700 1 -- 172.21.15.112:0/3865544620 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749800c370 con 0x7f7498005210 2023-10-06T04:39:51.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74add9b700 1 --2- 172.21.15.112:0/3865544620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7498004810 0x7f7498004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74ae59c700 1 --2- 172.21.15.112:0/3865544620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7498003c40 0x7f7498004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74aed9d700 1 --2- 172.21.15.112:0/3865544620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7498005210 0x7f749800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74add9b700 1 -- 172.21.15.112:0/3865544620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7498005210 msgr2=0x7f749800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:51.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74add9b700 1 --2- 172.21.15.112:0/3865544620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7498005210 0x7f749800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74add9b700 1 -- 172.21.15.112:0/3865544620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7498003c40 msgr2=0x7f7498004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:51.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74add9b700 1 --2- 172.21.15.112:0/3865544620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7498003c40 0x7f7498004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74aed9d700 1 -- 172.21.15.112:0/3865544620 reap_dead start 2023-10-06T04:39:51.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74add9b700 1 -- 172.21.15.112:0/3865544620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7498003570 con 0x7f7498004810 2023-10-06T04:39:51.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74ae59c700 1 --2- 172.21.15.112:0/3865544620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7498003c40 0x7f7498004030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:51.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74add9b700 1 --2- 172.21.15.112:0/3865544620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7498004810 0x7f7498004c80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f74a4006f00 tx=0x7f74a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92469cef6aba4d51 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:51.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74ad59a700 1 -- 172.21.15.112:0/3865544620 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a400e6e0 con 0x7f7498004810 2023-10-06T04:39:51.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74ad59a700 1 -- 172.21.15.112:0/3865544620 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a400e840 con 0x7f7498004810 2023-10-06T04:39:51.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.700+0000 7f74ad59a700 1 -- 172.21.15.112:0/3865544620 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a400ec00 con 0x7f7498004810 2023-10-06T04:39:51.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.701+0000 7f74af59e700 1 -- 172.21.15.112:0/3865544620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7498004810 msgr2=0x7f7498004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.701+0000 7f74af59e700 1 --2- 172.21.15.112:0/3865544620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7498004810 0x7f7498004c80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f74a4006f00 tx=0x7f74a40091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.701+0000 7f74af59e700 1 -- 172.21.15.112:0/3865544620 shutdown_connections 2023-10-06T04:39:51.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.701+0000 7f74af59e700 1 --2- 172.21.15.112:0/3865544620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7498004810 0x7f7498004c80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.701+0000 7f74af59e700 1 -- 172.21.15.112:0/3865544620 >> 172.21.15.112:0/3865544620 conn(0x7f74b006cfb0 msgr2=0x7f74b00d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:51.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.701+0000 7f74af59e700 1 -- 172.21.15.112:0/3865544620 shutdown_connections 2023-10-06T04:39:51.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.701+0000 7f74af59e700 1 -- 172.21.15.112:0/3865544620 wait complete. 2023-10-06T04:39:51.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.702+0000 7f74af59e700 1 Processor -- start 2023-10-06T04:39:51.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.702+0000 7f74af59e700 1 -- start start 2023-10-06T04:39:51.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.703+0000 7f74af59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7498004810 0x7f74b00b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.703+0000 7f74af59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74b00b0c60 0x7f74b015fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.703+0000 7f74af59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74b0160000 0x7f74b00b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.703+0000 7f74af59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b016a200 con 0x7f74b0160000 2023-10-06T04:39:51.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.703+0000 7f74af59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b0169bf0 con 0x7f7498004810 2023-10-06T04:39:51.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.703+0000 7f74af59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00b1170 con 0x7f74b00b0c60 2023-10-06T04:39:51.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.703+0000 7f74aed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74b0160000 0x7f74b00b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.703+0000 7f74aed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74b0160000 0x7f74b00b2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34442/0 (socket says 172.21.15.112:34442) 2023-10-06T04:39:51.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.703+0000 7f74aed9d700 1 -- 172.21.15.112:0/3217626432 learned_addr learned my addr 172.21.15.112:0/3217626432 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:51.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.703+0000 7f74ae59c700 1 --2- 172.21.15.112:0/3217626432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7498004810 0x7f74b00b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.703+0000 7f74add9b700 1 --2- 172.21.15.112:0/3217626432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74b00b0c60 0x7f74b015fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.703+0000 7f74aed9d700 1 -- 172.21.15.112:0/3217626432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74b00b0c60 msgr2=0x7f74b015fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.703+0000 7f74aed9d700 1 --2- 172.21.15.112:0/3217626432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74b00b0c60 0x7f74b015fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.703+0000 7f74aed9d700 1 -- 172.21.15.112:0/3217626432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7498004810 msgr2=0x7f74b00b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.703+0000 7f74aed9d700 1 --2- 172.21.15.112:0/3217626432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7498004810 0x7f74b00b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.703+0000 7f74aed9d700 1 -- 172.21.15.112:0/3217626432 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b0169e90 con 0x7f74b0160000 2023-10-06T04:39:51.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.703+0000 7f74aed9d700 1 --2- 172.21.15.112:0/3217626432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74b0160000 0x7f74b00b2960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f74b008b0f0 tx=0x7f74a8001370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:51.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.704+0000 7f749e7fc700 1 -- 172.21.15.112:0/3217626432 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8007b50 con 0x7f74b0160000 2023-10-06T04:39:51.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.704+0000 7f749e7fc700 1 -- 172.21.15.112:0/3217626432 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a800ebc0 con 0x7f74b0160000 2023-10-06T04:39:51.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.704+0000 7f74af59e700 1 -- 172.21.15.112:0/3217626432 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b00b1450 con 0x7f74b0160000 2023-10-06T04:39:51.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.704+0000 7f749e7fc700 1 -- 172.21.15.112:0/3217626432 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8013420 con 0x7f74b0160000 2023-10-06T04:39:51.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.704+0000 7f74af59e700 1 -- 172.21.15.112:0/3217626432 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b00b2ea0 con 0x7f74b0160000 2023-10-06T04:39:51.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.704+0000 7f74af59e700 1 -- 172.21.15.112:0/3217626432 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b0169a50 con 0x7f74b0160000 2023-10-06T04:39:51.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.705+0000 7f749e7fc700 1 -- 172.21.15.112:0/3217626432 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74a8013790 con 0x7f74b0160000 2023-10-06T04:39:51.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.705+0000 7f749e7fc700 1 --2- 172.21.15.112:0/3217626432 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7490066f30 0x7f74900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:51.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.705+0000 7f749e7fc700 1 -- 172.21.15.112:0/3217626432 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f74a8084a70 con 0x7f74b0160000 2023-10-06T04:39:51.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.705+0000 7f74ae59c700 1 --2- 172.21.15.112:0/3217626432 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7490066f30 0x7f74900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:51.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.706+0000 7f74ae59c700 1 --2- 172.21.15.112:0/3217626432 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7490066f30 0x7f74900693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f74a0000c00 tx=0x7f74a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:51.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.709+0000 7f749e7fc700 1 -- 172.21.15.112:0/3217626432 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74b0169a50 con 0x7f74b0160000 2023-10-06T04:39:51.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.935+0000 7f74af59e700 1 -- 172.21.15.112:0/3217626432 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74b0169a50 con 0x7f74b0160000 2023-10-06T04:39:51.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.936+0000 7f749e7fc700 1 -- 172.21.15.112:0/3217626432 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f74b0169a50 con 0x7f74b0160000 2023-10-06T04:39:51.938 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:51.939 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1694304040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1694304040},{"type":"v1","addr":"172.21.15.112:6837","nonce":1694304040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3750383657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3750383657},{"type":"v1","addr":"172.21.15.112:6835","nonce":3750383657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2217480877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2217480877},{"type":"v1","addr":"172.21.15.179:6834","nonce":2217480877}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:39:21.015278+0000","modified":"2023-10-06T04:39:24.651029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/140836226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":140836226},{"type":"v1","addr":"172.21.15.179:6835","nonce":140836226}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:39:51.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.938+0000 7f74af59e700 1 -- 172.21.15.112:0/3217626432 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7490066f30 msgr2=0x7f74900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.938+0000 7f74af59e700 1 --2- 172.21.15.112:0/3217626432 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7490066f30 0x7f74900693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f74a0000c00 tx=0x7f74a0009040 comp rx=0 tx=0).stop 2023-10-06T04:39:51.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.938+0000 7f74af59e700 1 -- 172.21.15.112:0/3217626432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74b0160000 msgr2=0x7f74b00b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:51.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.938+0000 7f74af59e700 1 --2- 172.21.15.112:0/3217626432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74b0160000 0x7f74b00b2960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f74b008b0f0 tx=0x7f74a8001370 comp rx=0 tx=0).stop 2023-10-06T04:39:51.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.938+0000 7f74af59e700 1 -- 172.21.15.112:0/3217626432 shutdown_connections 2023-10-06T04:39:51.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.938+0000 7f74af59e700 1 --2- 172.21.15.112:0/3217626432 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7490066f30 0x7f74900693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.938+0000 7f74af59e700 1 --2- 172.21.15.112:0/3217626432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74b0160000 0x7f74b00b2960 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.938+0000 7f74af59e700 1 --2- 172.21.15.112:0/3217626432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7498004810 0x7f74b00b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.938+0000 7f74af59e700 1 --2- 172.21.15.112:0/3217626432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74b00b0c60 0x7f74b015fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:51.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.938+0000 7f74af59e700 1 -- 172.21.15.112:0/3217626432 >> 172.21.15.112:0/3217626432 conn(0x7f74b006cfb0 msgr2=0x7f74b00cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:51.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.938+0000 7f74af59e700 1 -- 172.21.15.112:0/3217626432 shutdown_connections 2023-10-06T04:39:51.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:51.938+0000 7f74af59e700 1 -- 172.21.15.112:0/3217626432 wait complete. 2023-10-06T04:39:51.942 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 7 2023-10-06T04:39:51.953 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:52.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.064+0000 7f8ee2d5d700 1 Processor -- start 2023-10-06T04:39:52.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.064+0000 7f8ee2d5d700 1 -- start start 2023-10-06T04:39:52.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.065+0000 7f8ee2d5d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8edc067eb0 0x7f8edc068350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.065+0000 7f8ee2d5d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8edc15b500 con 0x7f8edc159010 2023-10-06T04:39:52.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.065+0000 7f8ee2d5d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8edc15b7e0 con 0x7f8edc15aa00 2023-10-06T04:39:52.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.065+0000 7f8ee2d5d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8edc068890 con 0x7f8edc067eb0 2023-10-06T04:39:52.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.065+0000 7f8ed3fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8edc067eb0 0x7f8edc068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.065+0000 7f8ee12fa700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8edc159010 0x7f8edc1593e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:37536/0 (socket says 172.21.15.112:37536) 2023-10-06T04:39:52.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.065+0000 7f8ee12fa700 1 -- 172.21.15.112:0/2737827342 learned_addr learned my addr 172.21.15.112:0/2737827342 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:52.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.066+0000 7f8ed3fff700 1 -- 172.21.15.112:0/2737827342 >> v1:172.21.15.179:6789/0 conn(0x7f8edc15aa00 legacy=0x7f8edc1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:52.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.066+0000 7f8ed3fff700 1 -- 172.21.15.112:0/2737827342 >> v1:172.21.15.112:6789/0 conn(0x7f8edc159010 legacy=0x7f8edc1593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.066+0000 7f8ed3fff700 1 -- 172.21.15.112:0/2737827342 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc15bac0 con 0x7f8edc067eb0 2023-10-06T04:39:52.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.066+0000 7f8ed37fe700 1 -- 172.21.15.112:0/2737827342 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289787299 0 0) 0x7f8edc15b500 con 0x7f8edc159010 2023-10-06T04:39:52.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.066+0000 7f8ed3fff700 1 --2- 172.21.15.112:0/2737827342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8edc067eb0 0x7f8edc068350 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc0098e0 tx=0x7f8ecc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c209b66c0f2b56be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:52.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.066+0000 7f8ed37fe700 1 -- 172.21.15.112:0/2737827342 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc009e80 con 0x7f8edc067eb0 2023-10-06T04:39:52.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.066+0000 7f8ed37fe700 1 -- 172.21.15.112:0/2737827342 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc00b820 con 0x7f8edc067eb0 2023-10-06T04:39:52.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.066+0000 7f8ed37fe700 1 -- 172.21.15.112:0/2737827342 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc00bba0 con 0x7f8edc067eb0 2023-10-06T04:39:52.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.067+0000 7f8ee2d5d700 1 -- 172.21.15.112:0/2737827342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8edc067eb0 msgr2=0x7f8edc068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.067+0000 7f8ee2d5d700 1 --2- 172.21.15.112:0/2737827342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8edc067eb0 0x7f8edc068350 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc0098e0 tx=0x7f8ecc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.067+0000 7f8ee2d5d700 1 -- 172.21.15.112:0/2737827342 shutdown_connections 2023-10-06T04:39:52.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.067+0000 7f8ee2d5d700 1 --2- 172.21.15.112:0/2737827342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8edc067eb0 0x7f8edc068350 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.067+0000 7f8ee2d5d700 1 -- 172.21.15.112:0/2737827342 >> 172.21.15.112:0/2737827342 conn(0x7f8edc0ce5e0 msgr2=0x7f8edc0ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:52.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.067+0000 7f8ee2d5d700 1 -- 172.21.15.112:0/2737827342 shutdown_connections 2023-10-06T04:39:52.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.067+0000 7f8ee2d5d700 1 -- 172.21.15.112:0/2737827342 wait complete. 2023-10-06T04:39:52.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.068+0000 7f8ee2d5d700 1 Processor -- start 2023-10-06T04:39:52.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.068+0000 7f8ee2d5d700 1 -- start start 2023-10-06T04:39:52.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ee2d5d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8edc067eb0 0x7f8edc155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ee2d5d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8edc159010 0x7f8edc0c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ee2d5d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8edc15aa00 0x7f8edc167d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ee2d5d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc0ad660 con 0x7f8edc159010 2023-10-06T04:39:52.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ee2d5d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc0c48c0 con 0x7f8edc067eb0 2023-10-06T04:39:52.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ee2d5d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc0b3fe0 con 0x7f8edc15aa00 2023-10-06T04:39:52.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ed3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8edc159010 0x7f8edc0c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ed3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8edc159010 0x7f8edc0c4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34452/0 (socket says 172.21.15.112:34452) 2023-10-06T04:39:52.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ed3fff700 1 -- 172.21.15.112:0/3338527223 learned_addr learned my addr 172.21.15.112:0/3338527223 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:52.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ee12fa700 1 --2- 172.21.15.112:0/3338527223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8edc15aa00 0x7f8edc167d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ee0af9700 1 --2- 172.21.15.112:0/3338527223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8edc067eb0 0x7f8edc155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ed3fff700 1 -- 172.21.15.112:0/3338527223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8edc15aa00 msgr2=0x7f8edc167d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ed3fff700 1 --2- 172.21.15.112:0/3338527223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8edc15aa00 0x7f8edc167d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ed3fff700 1 -- 172.21.15.112:0/3338527223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8edc067eb0 msgr2=0x7f8edc155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ed3fff700 1 --2- 172.21.15.112:0/3338527223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8edc067eb0 0x7f8edc155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ed3fff700 1 -- 172.21.15.112:0/3338527223 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc009420 con 0x7f8edc159010 2023-10-06T04:39:52.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ee0af9700 1 --2- 172.21.15.112:0/3338527223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8edc067eb0 0x7f8edc155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:52.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ed3fff700 1 --2- 172.21.15.112:0/3338527223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8edc159010 0x7f8edc0c4380 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8edc071020 tx=0x7f8ecc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:52.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ed0ff9700 1 -- 172.21.15.112:0/3338527223 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc00b990 con 0x7f8edc159010 2023-10-06T04:39:52.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ed0ff9700 1 -- 172.21.15.112:0/3338527223 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc020070 con 0x7f8edc159010 2023-10-06T04:39:52.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ed0ff9700 1 -- 172.21.15.112:0/3338527223 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc01b6a0 con 0x7f8edc159010 2023-10-06T04:39:52.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ee2d5d700 1 -- 172.21.15.112:0/3338527223 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8edc0b3cb0 con 0x7f8edc159010 2023-10-06T04:39:52.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.069+0000 7f8ee2d5d700 1 -- 172.21.15.112:0/3338527223 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8edc0ad840 con 0x7f8edc159010 2023-10-06T04:39:52.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.070+0000 7f8ee2d5d700 1 -- 172.21.15.112:0/3338527223 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8edc0c4b80 con 0x7f8edc159010 2023-10-06T04:39:52.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.070+0000 7f8ed0ff9700 1 -- 172.21.15.112:0/3338527223 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ecc022030 con 0x7f8edc159010 2023-10-06T04:39:52.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.071+0000 7f8ed0ff9700 1 --2- 172.21.15.112:0/3338527223 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8ec8066f30 0x7f8ec80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.071+0000 7f8ed0ff9700 1 -- 172.21.15.112:0/3338527223 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8ecc0866a0 con 0x7f8edc159010 2023-10-06T04:39:52.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.071+0000 7f8ee0af9700 1 --2- 172.21.15.112:0/3338527223 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8ec8066f30 0x7f8ec80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.071+0000 7f8ee0af9700 1 --2- 172.21.15.112:0/3338527223 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8ec8066f30 0x7f8ec80693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8001370 tx=0x7f8ed8009680 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:52.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.075+0000 7f8ed0ff9700 1 -- 172.21.15.112:0/3338527223 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ecc0537b0 con 0x7f8edc159010 2023-10-06T04:39:52.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.259+0000 7f8ee2d5d700 1 -- 172.21.15.112:0/3338527223 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8edc0c4b80 con 0x7f8edc159010 2023-10-06T04:39:52.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.260+0000 7f8ed0ff9700 1 -- 172.21.15.112:0/3338527223 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f8ecc056dd0 con 0x7f8edc159010 2023-10-06T04:39:52.263 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:52.263 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:39:22.637355+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:18.657040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:19.972295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:52.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.263+0000 7f8ee2d5d700 1 -- 172.21.15.112:0/3338527223 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8ec8066f30 msgr2=0x7f8ec80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.263+0000 7f8ee2d5d700 1 --2- 172.21.15.112:0/3338527223 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8ec8066f30 0x7f8ec80693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8001370 tx=0x7f8ed8009680 comp rx=0 tx=0).stop 2023-10-06T04:39:52.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.263+0000 7f8ee2d5d700 1 -- 172.21.15.112:0/3338527223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8edc159010 msgr2=0x7f8edc0c4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.263+0000 7f8ee2d5d700 1 --2- 172.21.15.112:0/3338527223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8edc159010 0x7f8edc0c4380 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8edc071020 tx=0x7f8ecc016000 comp rx=0 tx=0).stop 2023-10-06T04:39:52.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.263+0000 7f8ee2d5d700 1 -- 172.21.15.112:0/3338527223 shutdown_connections 2023-10-06T04:39:52.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.263+0000 7f8ee2d5d700 1 --2- 172.21.15.112:0/3338527223 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8ec8066f30 0x7f8ec80693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.263+0000 7f8ee2d5d700 1 --2- 172.21.15.112:0/3338527223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8edc15aa00 0x7f8edc167d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.263+0000 7f8ee2d5d700 1 --2- 172.21.15.112:0/3338527223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8edc067eb0 0x7f8edc155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.263+0000 7f8ee2d5d700 1 --2- 172.21.15.112:0/3338527223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8edc159010 0x7f8edc0c4380 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.263+0000 7f8ee2d5d700 1 -- 172.21.15.112:0/3338527223 >> 172.21.15.112:0/3338527223 conn(0x7f8edc0ce5e0 msgr2=0x7f8edc156e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:52.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.263+0000 7f8ee2d5d700 1 -- 172.21.15.112:0/3338527223 shutdown_connections 2023-10-06T04:39:52.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.263+0000 7f8ee2d5d700 1 -- 172.21.15.112:0/3338527223 wait complete. 2023-10-06T04:39:52.277 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:13.929254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:39:14.321892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:39:18.657040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:39:19.972295+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:39:52.277 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:39:52.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.392+0000 7f7742e1c700 1 Processor -- start 2023-10-06T04:39:52.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.392+0000 7f7742e1c700 1 -- start start 2023-10-06T04:39:52.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.393+0000 7f7742e1c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f773c0cbf00 0x7f773c15b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.393+0000 7f7742e1c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f773c15af50 con 0x7f773c159a20 2023-10-06T04:39:52.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.393+0000 7f7742e1c700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f773c0cae50 con 0x7f773c06d3b0 2023-10-06T04:39:52.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.393+0000 7f7742e1c700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773c0cca70 con 0x7f773c0cbf00 2023-10-06T04:39:52.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.393+0000 7f7740bb8700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f773c159a20 0x7f773c0cb7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:37548/0 (socket says 172.21.15.112:37548) 2023-10-06T04:39:52.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.393+0000 7f7740bb8700 1 -- 172.21.15.112:0/466587989 learned_addr learned my addr 172.21.15.112:0/466587989 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:52.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.393+0000 7f7733fff700 1 --2- 172.21.15.112:0/466587989 >> v2:172.21.15.112:3300/0 conn(0x7f773c0cbf00 0x7f773c15b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.393+0000 7f77337fe700 1 -- 172.21.15.112:0/466587989 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1189579982 0 0) 0x7f773c15af50 con 0x7f773c159a20 2023-10-06T04:39:52.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.393+0000 7f77337fe700 1 -- 172.21.15.112:0/466587989 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7724003570 con 0x7f773c159a20 2023-10-06T04:39:52.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.393+0000 7f7733fff700 1 -- 172.21.15.112:0/466587989 >> v1:172.21.15.179:6789/0 conn(0x7f773c06d3b0 legacy=0x7f773c15bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.393+0000 7f7733fff700 1 -- 172.21.15.112:0/466587989 >> v1:172.21.15.112:6789/0 conn(0x7f773c159a20 legacy=0x7f773c0cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.394+0000 7f7733fff700 1 -- 172.21.15.112:0/466587989 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c0cb0f0 con 0x7f773c0cbf00 2023-10-06T04:39:52.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.394+0000 7f7733fff700 1 --2- 172.21.15.112:0/466587989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f773c0cbf00 0x7f773c15b710 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f772c0098e0 tx=0x7f772c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11811c9aa0f5a7c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:52.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.394+0000 7f77337fe700 1 -- 172.21.15.112:0/466587989 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c00b640 con 0x7f773c0cbf00 2023-10-06T04:39:52.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.394+0000 7f77337fe700 1 -- 172.21.15.112:0/466587989 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772c00b7a0 con 0x7f773c0cbf00 2023-10-06T04:39:52.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.394+0000 7f77337fe700 1 -- 172.21.15.112:0/466587989 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c00bb40 con 0x7f773c0cbf00 2023-10-06T04:39:52.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.394+0000 7f7742e1c700 1 -- 172.21.15.112:0/466587989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f773c0cbf00 msgr2=0x7f773c15b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.394+0000 7f7742e1c700 1 --2- 172.21.15.112:0/466587989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f773c0cbf00 0x7f773c15b710 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f772c0098e0 tx=0x7f772c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.394+0000 7f7742e1c700 1 -- 172.21.15.112:0/466587989 shutdown_connections 2023-10-06T04:39:52.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.394+0000 7f7742e1c700 1 --2- 172.21.15.112:0/466587989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f773c0cbf00 0x7f773c15b710 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.394+0000 7f7742e1c700 1 -- 172.21.15.112:0/466587989 >> 172.21.15.112:0/466587989 conn(0x7f773c06cfb0 msgr2=0x7f773c0d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:52.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.394+0000 7f7742e1c700 1 -- 172.21.15.112:0/466587989 shutdown_connections 2023-10-06T04:39:52.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.394+0000 7f7742e1c700 1 -- 172.21.15.112:0/466587989 wait complete. 2023-10-06T04:39:52.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.395+0000 7f7742e1c700 1 Processor -- start 2023-10-06T04:39:52.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.396+0000 7f7742e1c700 1 -- start start 2023-10-06T04:39:52.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.396+0000 7f7742e1c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f773c06d3b0 0x7f773c06e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.396+0000 7f7742e1c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f773c0cbf00 0x7f773c13e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.396+0000 7f7742e1c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f773c159a20 0x7f773c0ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.396+0000 7f7742e1c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c0b64b0 con 0x7f773c06d3b0 2023-10-06T04:39:52.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.396+0000 7f7742e1c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c156e10 con 0x7f773c0cbf00 2023-10-06T04:39:52.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.396+0000 7f7742e1c700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c0b3810 con 0x7f773c159a20 2023-10-06T04:39:52.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.396+0000 7f7740bb8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f773c06d3b0 0x7f773c06e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.396+0000 7f7740bb8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f773c06d3b0 0x7f773c06e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34482/0 (socket says 172.21.15.112:34482) 2023-10-06T04:39:52.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.396+0000 7f7740bb8700 1 -- 172.21.15.112:0/2110226977 learned_addr learned my addr 172.21.15.112:0/2110226977 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:52.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.397+0000 7f7733fff700 1 --2- 172.21.15.112:0/2110226977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f773c0cbf00 0x7f773c13e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.397+0000 7f77413b9700 1 --2- 172.21.15.112:0/2110226977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f773c159a20 0x7f773c0ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.397+0000 7f7740bb8700 1 -- 172.21.15.112:0/2110226977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f773c159a20 msgr2=0x7f773c0ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.397+0000 7f7740bb8700 1 --2- 172.21.15.112:0/2110226977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f773c159a20 0x7f773c0ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.397+0000 7f7740bb8700 1 -- 172.21.15.112:0/2110226977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f773c0cbf00 msgr2=0x7f773c13e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.397+0000 7f7740bb8700 1 --2- 172.21.15.112:0/2110226977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f773c0cbf00 0x7f773c13e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.397+0000 7f7740bb8700 1 -- 172.21.15.112:0/2110226977 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c009420 con 0x7f773c06d3b0 2023-10-06T04:39:52.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.397+0000 7f7740bb8700 1 --2- 172.21.15.112:0/2110226977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f773c06d3b0 0x7f773c06e510 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f773800cd30 tx=0x7f7738001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:52.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.397+0000 7f7730ff9700 1 -- 172.21.15.112:0/2110226977 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773800ab70 con 0x7f773c06d3b0 2023-10-06T04:39:52.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.397+0000 7f7730ff9700 1 -- 172.21.15.112:0/2110226977 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773800acf0 con 0x7f773c06d3b0 2023-10-06T04:39:52.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.397+0000 7f7730ff9700 1 -- 172.21.15.112:0/2110226977 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738007340 con 0x7f773c06d3b0 2023-10-06T04:39:52.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.397+0000 7f7742e1c700 1 -- 172.21.15.112:0/2110226977 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f773c157040 con 0x7f773c06d3b0 2023-10-06T04:39:52.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.397+0000 7f7742e1c700 1 -- 172.21.15.112:0/2110226977 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773c1578e0 con 0x7f773c06d3b0 2023-10-06T04:39:52.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.398+0000 7f7742e1c700 1 -- 172.21.15.112:0/2110226977 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f773c05f230 con 0x7f773c06d3b0 2023-10-06T04:39:52.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.399+0000 7f7730ff9700 1 -- 172.21.15.112:0/2110226977 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7738007730 con 0x7f773c06d3b0 2023-10-06T04:39:52.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.399+0000 7f7730ff9700 1 --2- 172.21.15.112:0/2110226977 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7728066f30 0x7f77280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.399+0000 7f7730ff9700 1 -- 172.21.15.112:0/2110226977 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7738084b90 con 0x7f773c06d3b0 2023-10-06T04:39:52.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.399+0000 7f7733fff700 1 --2- 172.21.15.112:0/2110226977 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7728066f30 0x7f77280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.400+0000 7f7733fff700 1 --2- 172.21.15.112:0/2110226977 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7728066f30 0x7f77280693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f773c0cc300 tx=0x7f772c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:52.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.403+0000 7f7730ff9700 1 -- 172.21.15.112:0/2110226977 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7738051d20 con 0x7f773c06d3b0 2023-10-06T04:39:52.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.584+0000 7f7742e1c700 1 -- 172.21.15.112:0/2110226977 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f773c09e400 con 0x7f773c06d3b0 2023-10-06T04:39:52.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.585+0000 7f7730ff9700 1 -- 172.21.15.112:0/2110226977 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f773800ae60 con 0x7f773c06d3b0 2023-10-06T04:39:52.587 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-10-06T04:39:52.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.586+0000 7f7742e1c700 1 -- 172.21.15.112:0/2110226977 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7728066f30 msgr2=0x7f77280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.586+0000 7f7742e1c700 1 --2- 172.21.15.112:0/2110226977 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7728066f30 0x7f77280693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f773c0cc300 tx=0x7f772c017000 comp rx=0 tx=0).stop 2023-10-06T04:39:52.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.586+0000 7f7742e1c700 1 -- 172.21.15.112:0/2110226977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f773c06d3b0 msgr2=0x7f773c06e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.586+0000 7f7742e1c700 1 --2- 172.21.15.112:0/2110226977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f773c06d3b0 0x7f773c06e510 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f773800cd30 tx=0x7f7738001b10 comp rx=0 tx=0).stop 2023-10-06T04:39:52.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.587+0000 7f7742e1c700 1 -- 172.21.15.112:0/2110226977 shutdown_connections 2023-10-06T04:39:52.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.587+0000 7f7742e1c700 1 --2- 172.21.15.112:0/2110226977 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7728066f30 0x7f77280693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.587+0000 7f7742e1c700 1 --2- 172.21.15.112:0/2110226977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f773c159a20 0x7f773c0ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.587+0000 7f7742e1c700 1 --2- 172.21.15.112:0/2110226977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f773c06d3b0 0x7f773c06e510 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.587+0000 7f7742e1c700 1 --2- 172.21.15.112:0/2110226977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f773c0cbf00 0x7f773c13e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.587+0000 7f7742e1c700 1 -- 172.21.15.112:0/2110226977 >> 172.21.15.112:0/2110226977 conn(0x7f773c06cfb0 msgr2=0x7f773c155430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:52.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.587+0000 7f7742e1c700 1 -- 172.21.15.112:0/2110226977 shutdown_connections 2023-10-06T04:39:52.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.587+0000 7f7742e1c700 1 -- 172.21.15.112:0/2110226977 wait complete. 2023-10-06T04:39:52.601 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:39:52.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.716+0000 7f59f2875700 1 Processor -- start 2023-10-06T04:39:52.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.716+0000 7f59f2875700 1 -- start start 2023-10-06T04:39:52.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.717+0000 7f59f2875700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59ec0afe70 0x7f59ec0caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.717+0000 7f59f2875700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f59ec0cccd0 0x7f59ec0c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.717+0000 7f59f2875700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59ec0cc1c0 con 0x7f59ec156c30 2023-10-06T04:39:52.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.717+0000 7f59f2875700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59ec157f30 con 0x7f59ec0cccd0 2023-10-06T04:39:52.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.717+0000 7f59f2875700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec1570a0 con 0x7f59ec0afe70 2023-10-06T04:39:52.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.717+0000 7f59f2074700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f59ec0cccd0 0x7f59ec0c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.717+0000 7f59f1873700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59ec0afe70 0x7f59ec0caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.717+0000 7f59f1873700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59ec0afe70 0x7f59ec0caeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.112:33986/0 (socket says 172.21.15.112:33986) 2023-10-06T04:39:52.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.717+0000 7f59f2074700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f59ec0cccd0 0x7f59ec0c8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.112:37064/0 (socket says 172.21.15.112:37064) 2023-10-06T04:39:52.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.717+0000 7f59f1873700 1 -- 172.21.15.112:0/1799486127 learned_addr learned my addr 172.21.15.112:0/1799486127 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:52.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.717+0000 7f59f1072700 1 --1- 172.21.15.112:0/1799486127 >> v1:172.21.15.179:6789/0 conn(0x7f59ec156c30 0x7f59ec0cc5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.112:45554/0 (socket says 172.21.15.112:45554) 2023-10-06T04:39:52.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.718+0000 7f59f1873700 1 -- 172.21.15.112:0/1799486127 >> v2:172.21.15.179:3300/0 conn(0x7f59ec0cccd0 msgr2=0x7f59ec0c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:52.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.718+0000 7f59f1873700 1 --2- 172.21.15.112:0/1799486127 >> v2:172.21.15.179:3300/0 conn(0x7f59ec0cccd0 0x7f59ec0c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.718+0000 7f59f1873700 1 -- 172.21.15.112:0/1799486127 >> v1:172.21.15.179:6789/0 conn(0x7f59ec156c30 legacy=0x7f59ec0cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.718+0000 7f59f1873700 1 -- 172.21.15.112:0/1799486127 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec0cb5b0 con 0x7f59ec0afe70 2023-10-06T04:39:52.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.718+0000 7f59f2074700 1 --2- 172.21.15.112:0/1799486127 >> v2:172.21.15.179:3300/0 conn(0x7f59ec0cccd0 0x7f59ec0c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:39:52.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.718+0000 7f59f0871700 1 -- 172.21.15.112:0/1799486127 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3318907378 0 0) 0x7f59ec0cc1c0 con 0x7f59ec156c30 2023-10-06T04:39:52.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.718+0000 7f59f1873700 1 --2- 172.21.15.112:0/1799486127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59ec0afe70 0x7f59ec0caeb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f59e800d1a0 tx=0x7f59e800ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70bc82f80d847f92 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:52.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.718+0000 7f59f0871700 1 -- 172.21.15.112:0/1799486127 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e8010070 con 0x7f59ec0afe70 2023-10-06T04:39:52.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.718+0000 7f59f0871700 1 -- 172.21.15.112:0/1799486127 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e800de10 con 0x7f59ec0afe70 2023-10-06T04:39:52.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.718+0000 7f59f0871700 1 -- 172.21.15.112:0/1799486127 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e800b320 con 0x7f59ec0afe70 2023-10-06T04:39:52.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.719+0000 7f59f2875700 1 -- 172.21.15.112:0/1799486127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59ec0afe70 msgr2=0x7f59ec0caeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.719+0000 7f59f2875700 1 --2- 172.21.15.112:0/1799486127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59ec0afe70 0x7f59ec0caeb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f59e800d1a0 tx=0x7f59e800ba50 comp rx=0 tx=0).stop 2023-10-06T04:39:52.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.719+0000 7f59f2875700 1 -- 172.21.15.112:0/1799486127 shutdown_connections 2023-10-06T04:39:52.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.719+0000 7f59f2875700 1 --2- 172.21.15.112:0/1799486127 >> v2:172.21.15.179:3300/0 conn(0x7f59ec0cccd0 0x7f59ec0c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.719+0000 7f59f2875700 1 --2- 172.21.15.112:0/1799486127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59ec0afe70 0x7f59ec0caeb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.719+0000 7f59f2875700 1 -- 172.21.15.112:0/1799486127 >> 172.21.15.112:0/1799486127 conn(0x7f59ec06d8e0 msgr2=0x7f59ec06dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:52.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.719+0000 7f59f2875700 1 -- 172.21.15.112:0/1799486127 shutdown_connections 2023-10-06T04:39:52.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.719+0000 7f59f2875700 1 -- 172.21.15.112:0/1799486127 wait complete. 2023-10-06T04:39:52.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.720+0000 7f59f2875700 1 Processor -- start 2023-10-06T04:39:52.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.720+0000 7f59f2875700 1 -- start start 2023-10-06T04:39:52.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.721+0000 7f59f2875700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59ec0afe70 0x7f59ec166510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.721+0000 7f59f2875700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59ec0cccd0 0x7f59ec0c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.721+0000 7f59f2875700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59ec156c30 0x7f59ec14f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.721+0000 7f59f2875700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0c7280 con 0x7f59ec0afe70 2023-10-06T04:39:52.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.721+0000 7f59f2875700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0c7070 con 0x7f59ec156c30 2023-10-06T04:39:52.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.721+0000 7f59f2875700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0c4c80 con 0x7f59ec0cccd0 2023-10-06T04:39:52.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.721+0000 7f59f1873700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59ec0afe70 0x7f59ec166510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.721+0000 7f59f1873700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59ec0afe70 0x7f59ec166510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34492/0 (socket says 172.21.15.112:34492) 2023-10-06T04:39:52.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.721+0000 7f59f1873700 1 -- 172.21.15.112:0/3583872319 learned_addr learned my addr 172.21.15.112:0/3583872319 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:52.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.721+0000 7f59f2074700 1 --2- 172.21.15.112:0/3583872319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59ec156c30 0x7f59ec14f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.721+0000 7f59f1072700 1 --2- 172.21.15.112:0/3583872319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59ec0cccd0 0x7f59ec0c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.721+0000 7f59f1873700 1 -- 172.21.15.112:0/3583872319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59ec0cccd0 msgr2=0x7f59ec0c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.721+0000 7f59f1873700 1 --2- 172.21.15.112:0/3583872319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59ec0cccd0 0x7f59ec0c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.721+0000 7f59f1873700 1 -- 172.21.15.112:0/3583872319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59ec156c30 msgr2=0x7f59ec14f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.721+0000 7f59f1873700 1 --2- 172.21.15.112:0/3583872319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59ec156c30 0x7f59ec14f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.721+0000 7f59f1873700 1 -- 172.21.15.112:0/3583872319 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e4009420 con 0x7f59ec0afe70 2023-10-06T04:39:52.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.721+0000 7f59f1873700 1 --2- 172.21.15.112:0/3583872319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59ec0afe70 0x7f59ec166510 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f59ec1571e0 tx=0x7f59e801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:52.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.721+0000 7f59e1ffb700 1 -- 172.21.15.112:0/3583872319 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e800acb0 con 0x7f59ec0afe70 2023-10-06T04:39:52.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.721+0000 7f59e1ffb700 1 -- 172.21.15.112:0/3583872319 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e800ae10 con 0x7f59ec0afe70 2023-10-06T04:39:52.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.721+0000 7f59f2875700 1 -- 172.21.15.112:0/3583872319 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e800bcf0 con 0x7f59ec0afe70 2023-10-06T04:39:52.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.721+0000 7f59e1ffb700 1 -- 172.21.15.112:0/3583872319 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e80286b0 con 0x7f59ec0afe70 2023-10-06T04:39:52.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.722+0000 7f59f2875700 1 -- 172.21.15.112:0/3583872319 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59ec0c4a20 con 0x7f59ec0afe70 2023-10-06T04:39:52.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.723+0000 7f59f2875700 1 -- 172.21.15.112:0/3583872319 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59ec05f230 con 0x7f59ec0afe70 2023-10-06T04:39:52.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.723+0000 7f59e1ffb700 1 -- 172.21.15.112:0/3583872319 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59e8003040 con 0x7f59ec0afe70 2023-10-06T04:39:52.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.723+0000 7f59e1ffb700 1 --2- 172.21.15.112:0/3583872319 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f59d0066f00 0x7f59d00693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:52.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.724+0000 7f59f1072700 1 --2- 172.21.15.112:0/3583872319 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f59d0066f00 0x7f59d00693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:52.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.724+0000 7f59e1ffb700 1 -- 172.21.15.112:0/3583872319 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f59e80885d0 con 0x7f59ec0afe70 2023-10-06T04:39:52.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.724+0000 7f59f1072700 1 --2- 172.21.15.112:0/3583872319 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f59d0066f00 0x7f59d00693b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f59dc007fd0 tx=0x7f59dc007e10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:52.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.728+0000 7f59e1ffb700 1 -- 172.21.15.112:0/3583872319 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59e80556e0 con 0x7f59ec0afe70 2023-10-06T04:39:52.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.912+0000 7f59f2875700 1 -- 172.21.15.112:0/3583872319 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59ec0cac70 con 0x7f59ec0afe70 2023-10-06T04:39:52.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.912+0000 7f59e1ffb700 1 -- 172.21.15.112:0/3583872319 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59e8023020 con 0x7f59ec0afe70 2023-10-06T04:39:52.914 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-10-06T04:39:52.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.914+0000 7f59f2875700 1 -- 172.21.15.112:0/3583872319 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f59d0066f00 msgr2=0x7f59d00693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.914+0000 7f59f2875700 1 --2- 172.21.15.112:0/3583872319 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f59d0066f00 0x7f59d00693b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f59dc007fd0 tx=0x7f59dc007e10 comp rx=0 tx=0).stop 2023-10-06T04:39:52.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.914+0000 7f59f2875700 1 -- 172.21.15.112:0/3583872319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59ec0afe70 msgr2=0x7f59ec166510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:52.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.914+0000 7f59f2875700 1 --2- 172.21.15.112:0/3583872319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59ec0afe70 0x7f59ec166510 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f59ec1571e0 tx=0x7f59e801a000 comp rx=0 tx=0).stop 2023-10-06T04:39:52.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.914+0000 7f59f2875700 1 -- 172.21.15.112:0/3583872319 shutdown_connections 2023-10-06T04:39:52.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.914+0000 7f59f2875700 1 --2- 172.21.15.112:0/3583872319 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f59d0066f00 0x7f59d00693b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.914+0000 7f59f2875700 1 --2- 172.21.15.112:0/3583872319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59ec156c30 0x7f59ec14f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.914+0000 7f59f2875700 1 --2- 172.21.15.112:0/3583872319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59ec0afe70 0x7f59ec166510 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.914+0000 7f59f2875700 1 --2- 172.21.15.112:0/3583872319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59ec0cccd0 0x7f59ec0c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:52.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.914+0000 7f59f2875700 1 -- 172.21.15.112:0/3583872319 >> 172.21.15.112:0/3583872319 conn(0x7f59ec06d8e0 msgr2=0x7f59ec157290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:52.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.914+0000 7f59f2875700 1 -- 172.21.15.112:0/3583872319 shutdown_connections 2023-10-06T04:39:52.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:52.914+0000 7f59f2875700 1 -- 172.21.15.112:0/3583872319 wait complete. 2023-10-06T04:39:52.928 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:39:53.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.043+0000 7f63a9a8c700 1 Processor -- start 2023-10-06T04:39:53.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.043+0000 7f63a9a8c700 1 -- start start 2023-10-06T04:39:53.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a9a8c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63a40afa20 0x7f63a40b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a9a8c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a40c9ca0 con 0x7f63a40cb140 2023-10-06T04:39:53.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a9a8c700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a40c93b0 con 0x7f63a4156580 2023-10-06T04:39:53.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a9a8c700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a40b15c0 con 0x7f63a40afa20 2023-10-06T04:39:53.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a3fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f63a40cb140 0x7f63a4160160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:37554/0 (socket says 172.21.15.112:37554) 2023-10-06T04:39:53.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a3fff700 1 -- 172.21.15.112:0/915884619 learned_addr learned my addr 172.21.15.112:0/915884619 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:53.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a2ffd700 1 --2- 172.21.15.112:0/915884619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63a40afa20 0x7f63a40b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a27fc700 1 -- 172.21.15.112:0/915884619 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461392316 0 0) 0x7f63a40c9ca0 con 0x7f63a40cb140 2023-10-06T04:39:53.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a27fc700 1 -- 172.21.15.112:0/915884619 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6390003570 con 0x7f63a40cb140 2023-10-06T04:39:53.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a27fc700 1 -- 172.21.15.112:0/915884619 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 196920856 0 0) 0x7f6390003570 con 0x7f63a40cb140 2023-10-06T04:39:53.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a27fc700 1 -- 172.21.15.112:0/915884619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63a40afa20 msgr2=0x7f63a40b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:53.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a27fc700 1 --2- 172.21.15.112:0/915884619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63a40afa20 0x7f63a40b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a27fc700 1 -- 172.21.15.112:0/915884619 >> v1:172.21.15.179:6789/0 conn(0x7f63a4156580 legacy=0x7f63a40af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a27fc700 1 -- 172.21.15.112:0/915884619 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a40c9650 con 0x7f63a40cb140 2023-10-06T04:39:53.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a27fc700 1 -- 172.21.15.112:0/915884619 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f639c0017f0 con 0x7f63a40cb140 2023-10-06T04:39:53.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a27fc700 1 -- 172.21.15.112:0/915884619 >> v1:172.21.15.112:6789/0 conn(0x7f63a40cb140 legacy=0x7f63a4160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a27fc700 1 --2- 172.21.15.112:0/915884619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63a40afa20 0x7f6390003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a27fc700 1 --2- 172.21.15.112:0/915884619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6390003fd0 0x7f6390004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a27fc700 1 --2- 172.21.15.112:0/915884619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6390004d50 0x7f63900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a27fc700 1 -- 172.21.15.112:0/915884619 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a40b15c0 con 0x7f6390004d50 2023-10-06T04:39:53.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a27fc700 1 -- 172.21.15.112:0/915884619 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639000bb40 con 0x7f6390003fd0 2023-10-06T04:39:53.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a27fc700 1 -- 172.21.15.112:0/915884619 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639000df10 con 0x7f63a40afa20 2023-10-06T04:39:53.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a3fff700 1 --2- 172.21.15.112:0/915884619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6390004d50 0x7f63900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.044+0000 7f63a37fe700 1 --2- 172.21.15.112:0/915884619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63a40afa20 0x7f6390003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.045+0000 7f63a2ffd700 1 --2- 172.21.15.112:0/915884619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6390003fd0 0x7f6390004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.045+0000 7f63a3fff700 1 -- 172.21.15.112:0/915884619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63a40afa20 msgr2=0x7f6390003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:53.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.045+0000 7f63a3fff700 1 --2- 172.21.15.112:0/915884619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63a40afa20 0x7f6390003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.045+0000 7f63a3fff700 1 -- 172.21.15.112:0/915884619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6390003fd0 msgr2=0x7f6390004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:53.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.045+0000 7f63a3fff700 1 --2- 172.21.15.112:0/915884619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6390003fd0 0x7f6390004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.045+0000 7f63a3fff700 1 -- 172.21.15.112:0/915884619 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6390003570 con 0x7f6390004d50 2023-10-06T04:39:53.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.045+0000 7f63a2ffd700 1 --2- 172.21.15.112:0/915884619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6390003fd0 0x7f6390004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:53.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.045+0000 7f63a3fff700 1 --2- 172.21.15.112:0/915884619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6390004d50 0x7f63900051c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f639c00a950 tx=0x7f639c0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ac8bbc1d61eb19 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:53.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.045+0000 7f63a27fc700 1 -- 172.21.15.112:0/915884619 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c0070d0 con 0x7f6390004d50 2023-10-06T04:39:53.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.045+0000 7f63a27fc700 1 -- 172.21.15.112:0/915884619 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639c007230 con 0x7f6390004d50 2023-10-06T04:39:53.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.045+0000 7f63a27fc700 1 -- 172.21.15.112:0/915884619 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c0075f0 con 0x7f6390004d50 2023-10-06T04:39:53.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.045+0000 7f63a9a8c700 1 -- 172.21.15.112:0/915884619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6390004d50 msgr2=0x7f63900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.045+0000 7f63a9a8c700 1 --2- 172.21.15.112:0/915884619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6390004d50 0x7f63900051c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f639c00a950 tx=0x7f639c0021f0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.045+0000 7f63a3fff700 1 -- 172.21.15.112:0/915884619 reap_dead start 2023-10-06T04:39:53.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.045+0000 7f63a9a8c700 1 -- 172.21.15.112:0/915884619 shutdown_connections 2023-10-06T04:39:53.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.045+0000 7f63a9a8c700 1 -- 172.21.15.112:0/915884619 >> 172.21.15.112:0/915884619 conn(0x7f63a406c7d0 msgr2=0x7f63a406cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:53.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.045+0000 7f63a9a8c700 1 -- 172.21.15.112:0/915884619 shutdown_connections 2023-10-06T04:39:53.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.046+0000 7f63a9a8c700 1 -- 172.21.15.112:0/915884619 wait complete. 2023-10-06T04:39:53.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.047+0000 7f63a9a8c700 1 Processor -- start 2023-10-06T04:39:53.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.047+0000 7f63a9a8c700 1 -- start start 2023-10-06T04:39:53.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.047+0000 7f63a9a8c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63a414ff30 0x7f63a4158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.047+0000 7f63a9a8c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63a4159c70 0x7f63a406a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.047+0000 7f63a9a8c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63a406ac30 0x7f63a4156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.047+0000 7f63a9a8c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a406b0a0 con 0x7f63a4159c70 2023-10-06T04:39:53.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.047+0000 7f63a9a8c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a41657b0 con 0x7f63a414ff30 2023-10-06T04:39:53.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.047+0000 7f63a9a8c700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a415a410 con 0x7f63a406ac30 2023-10-06T04:39:53.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.048+0000 7f63a2ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63a4159c70 0x7f63a406a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.048+0000 7f63a2ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63a4159c70 0x7f63a406a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34516/0 (socket says 172.21.15.112:34516) 2023-10-06T04:39:53.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.048+0000 7f63a2ffd700 1 -- 172.21.15.112:0/2312661723 learned_addr learned my addr 172.21.15.112:0/2312661723 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:53.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.048+0000 7f63a37fe700 1 --2- 172.21.15.112:0/2312661723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63a414ff30 0x7f63a4158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.048+0000 7f63a3fff700 1 --2- 172.21.15.112:0/2312661723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63a406ac30 0x7f63a4156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.048+0000 7f63a2ffd700 1 -- 172.21.15.112:0/2312661723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63a406ac30 msgr2=0x7f63a4156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.048+0000 7f63a2ffd700 1 --2- 172.21.15.112:0/2312661723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63a406ac30 0x7f63a4156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.048+0000 7f63a2ffd700 1 -- 172.21.15.112:0/2312661723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63a414ff30 msgr2=0x7f63a4158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.048+0000 7f63a2ffd700 1 --2- 172.21.15.112:0/2312661723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63a414ff30 0x7f63a4158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.048+0000 7f63a2ffd700 1 -- 172.21.15.112:0/2312661723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a415a6f0 con 0x7f63a4159c70 2023-10-06T04:39:53.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.048+0000 7f63a2ffd700 1 --2- 172.21.15.112:0/2312661723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63a4159c70 0x7f63a406a6f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f638c011990 tx=0x7f638c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:53.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.048+0000 7f639b7fe700 1 -- 172.21.15.112:0/2312661723 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c00f6d0 con 0x7f63a4159c70 2023-10-06T04:39:53.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.048+0000 7f639b7fe700 1 -- 172.21.15.112:0/2312661723 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638c00f830 con 0x7f63a4159c70 2023-10-06T04:39:53.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.048+0000 7f639b7fe700 1 -- 172.21.15.112:0/2312661723 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c00fbd0 con 0x7f63a4159c70 2023-10-06T04:39:53.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.048+0000 7f63a9a8c700 1 -- 172.21.15.112:0/2312661723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a415a9d0 con 0x7f63a4159c70 2023-10-06T04:39:53.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.048+0000 7f63a9a8c700 1 -- 172.21.15.112:0/2312661723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a4150300 con 0x7f63a4159c70 2023-10-06T04:39:53.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.049+0000 7f63a9a8c700 1 -- 172.21.15.112:0/2312661723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a4165960 con 0x7f63a4159c70 2023-10-06T04:39:53.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.050+0000 7f639b7fe700 1 -- 172.21.15.112:0/2312661723 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f638c015460 con 0x7f63a4159c70 2023-10-06T04:39:53.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.050+0000 7f639b7fe700 1 --2- 172.21.15.112:0/2312661723 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6384066f30 0x7f63840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.050+0000 7f639b7fe700 1 -- 172.21.15.112:0/2312661723 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f638c084e40 con 0x7f63a4159c70 2023-10-06T04:39:53.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.050+0000 7f63a37fe700 1 --2- 172.21.15.112:0/2312661723 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6384066f30 0x7f63840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.050+0000 7f63a37fe700 1 --2- 172.21.15.112:0/2312661723 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6384066f30 0x7f63840693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6394003c40 tx=0x7f6394007d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:53.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.054+0000 7f639b7fe700 1 -- 172.21.15.112:0/2312661723 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63a4165960 con 0x7f63a4159c70 2023-10-06T04:39:53.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.235+0000 7f63a9a8c700 1 -- 172.21.15.112:0/2312661723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f63a4165920 con 0x7f63a4159c70 2023-10-06T04:39:53.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.235+0000 7f639b7fe700 1 -- 172.21.15.112:0/2312661723 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f638c051f50 con 0x7f63a4159c70 2023-10-06T04:39:53.238 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-10-06T04:39:53.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.237+0000 7f63a9a8c700 1 -- 172.21.15.112:0/2312661723 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6384066f30 msgr2=0x7f63840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.237+0000 7f63a9a8c700 1 --2- 172.21.15.112:0/2312661723 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6384066f30 0x7f63840693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6394003c40 tx=0x7f6394007d10 comp rx=0 tx=0).stop 2023-10-06T04:39:53.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.237+0000 7f63a9a8c700 1 -- 172.21.15.112:0/2312661723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63a4159c70 msgr2=0x7f63a406a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.237+0000 7f63a9a8c700 1 --2- 172.21.15.112:0/2312661723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63a4159c70 0x7f63a406a6f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f638c011990 tx=0x7f638c008040 comp rx=0 tx=0).stop 2023-10-06T04:39:53.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.237+0000 7f63a9a8c700 1 -- 172.21.15.112:0/2312661723 shutdown_connections 2023-10-06T04:39:53.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.237+0000 7f63a9a8c700 1 --2- 172.21.15.112:0/2312661723 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6384066f30 0x7f63840693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.237+0000 7f63a9a8c700 1 --2- 172.21.15.112:0/2312661723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63a406ac30 0x7f63a4156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.237+0000 7f63a9a8c700 1 --2- 172.21.15.112:0/2312661723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63a414ff30 0x7f63a4158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.237+0000 7f63a9a8c700 1 --2- 172.21.15.112:0/2312661723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63a4159c70 0x7f63a406a6f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.237+0000 7f63a9a8c700 1 -- 172.21.15.112:0/2312661723 >> 172.21.15.112:0/2312661723 conn(0x7f63a406c7d0 msgr2=0x7f63a40af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:53.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.237+0000 7f63a9a8c700 1 -- 172.21.15.112:0/2312661723 shutdown_connections 2023-10-06T04:39:53.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.237+0000 7f63a9a8c700 1 -- 172.21.15.112:0/2312661723 wait complete. 2023-10-06T04:39:53.252 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:39:53.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.366+0000 7fa2e863e700 1 Processor -- start 2023-10-06T04:39:53.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.366+0000 7fa2e863e700 1 -- start start 2023-10-06T04:39:53.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.367+0000 7fa2e863e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa2e0159a20 0x7fa2e00cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.367+0000 7fa2e863e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e015af50 con 0x7fa2e006d3b0 2023-10-06T04:39:53.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.367+0000 7fa2e863e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e015e370 con 0x7fa2e015c720 2023-10-06T04:39:53.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.367+0000 7fa2e863e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e00cca70 con 0x7fa2e0159a20 2023-10-06T04:39:53.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.367+0000 7fa2e5bd9700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa2e006d3b0 0x7fa2e015d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:37564/0 (socket says 172.21.15.112:37564) 2023-10-06T04:39:53.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.367+0000 7fa2e5bd9700 1 -- 172.21.15.112:0/1950561509 learned_addr learned my addr 172.21.15.112:0/1950561509 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:53.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.367+0000 7fa2e63da700 1 --2- 172.21.15.112:0/1950561509 >> v2:172.21.15.179:3300/0 conn(0x7fa2e0159a20 0x7fa2e00cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.368+0000 7fa2e53d8700 1 -- 172.21.15.112:0/1950561509 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637206919 0 0) 0x7fa2e015af50 con 0x7fa2e006d3b0 2023-10-06T04:39:53.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.368+0000 7fa2e53d8700 1 -- 172.21.15.112:0/1950561509 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2cc003570 con 0x7fa2e006d3b0 2023-10-06T04:39:53.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.368+0000 7fa2e53d8700 1 -- 172.21.15.112:0/1950561509 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507899288 0 0) 0x7fa2e015e370 con 0x7fa2e015c720 2023-10-06T04:39:53.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.368+0000 7fa2e53d8700 1 -- 172.21.15.112:0/1950561509 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2e015af50 con 0x7fa2e015c720 2023-10-06T04:39:53.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.368+0000 7fa2e53d8700 1 -- 172.21.15.112:0/1950561509 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3400011933 0 0) 0x7fa2cc003570 con 0x7fa2e006d3b0 2023-10-06T04:39:53.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.368+0000 7fa2e63da700 1 -- 172.21.15.112:0/1950561509 >> v1:172.21.15.179:6789/0 conn(0x7fa2e015c720 legacy=0x7fa2e015dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.368+0000 7fa2e63da700 1 -- 172.21.15.112:0/1950561509 >> v1:172.21.15.112:6789/0 conn(0x7fa2e006d3b0 legacy=0x7fa2e015d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.368+0000 7fa2e63da700 1 -- 172.21.15.112:0/1950561509 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e00cae50 con 0x7fa2e0159a20 2023-10-06T04:39:53.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.368+0000 7fa2e63da700 1 --2- 172.21.15.112:0/1950561509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2e0159a20 0x7fa2e00cb7f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc009e60 tx=0x7fa2dc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8df4568e10ee0c33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:53.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.368+0000 7fa2e53d8700 1 -- 172.21.15.112:0/1950561509 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc00e070 con 0x7fa2e0159a20 2023-10-06T04:39:53.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.368+0000 7fa2e53d8700 1 -- 172.21.15.112:0/1950561509 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2dc00b7a0 con 0x7fa2e0159a20 2023-10-06T04:39:53.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.368+0000 7fa2e53d8700 1 -- 172.21.15.112:0/1950561509 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0001470 con 0x7fa2e0159a20 2023-10-06T04:39:53.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.369+0000 7fa2e863e700 1 -- 172.21.15.112:0/1950561509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2e0159a20 msgr2=0x7fa2e00cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.369+0000 7fa2e863e700 1 --2- 172.21.15.112:0/1950561509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2e0159a20 0x7fa2e00cb7f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc009e60 tx=0x7fa2dc009780 comp rx=0 tx=0).stop 2023-10-06T04:39:53.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.369+0000 7fa2e863e700 1 -- 172.21.15.112:0/1950561509 shutdown_connections 2023-10-06T04:39:53.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.369+0000 7fa2e863e700 1 --2- 172.21.15.112:0/1950561509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2e0159a20 0x7fa2e00cb7f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.369+0000 7fa2e863e700 1 -- 172.21.15.112:0/1950561509 >> 172.21.15.112:0/1950561509 conn(0x7fa2e006cfb0 msgr2=0x7fa2e00d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:53.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.369+0000 7fa2e863e700 1 -- 172.21.15.112:0/1950561509 shutdown_connections 2023-10-06T04:39:53.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.369+0000 7fa2e863e700 1 -- 172.21.15.112:0/1950561509 wait complete. 2023-10-06T04:39:53.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.370+0000 7fa2e863e700 1 Processor -- start 2023-10-06T04:39:53.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.370+0000 7fa2e863e700 1 -- start start 2023-10-06T04:39:53.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.371+0000 7fa2e863e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2e006d3b0 0x7fa2e00b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.371+0000 7fa2e863e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2e0159a20 0x7fa2e00b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.371+0000 7fa2e863e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2e015c720 0x7fa2e00b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.371+0000 7fa2e863e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e00b0d40 con 0x7fa2e015c720 2023-10-06T04:39:53.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.371+0000 7fa2e863e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e00b0b10 con 0x7fa2e0159a20 2023-10-06T04:39:53.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.371+0000 7fa2e863e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e01530e0 con 0x7fa2e006d3b0 2023-10-06T04:39:53.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.371+0000 7fa2e6bdb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2e015c720 0x7fa2e00b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.371+0000 7fa2e6bdb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2e015c720 0x7fa2e00b05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34522/0 (socket says 172.21.15.112:34522) 2023-10-06T04:39:53.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.371+0000 7fa2e6bdb700 1 -- 172.21.15.112:0/4108398179 learned_addr learned my addr 172.21.15.112:0/4108398179 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:53.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.371+0000 7fa2e5bd9700 1 --2- 172.21.15.112:0/4108398179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2e0159a20 0x7fa2e00b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.371+0000 7fa2e63da700 1 --2- 172.21.15.112:0/4108398179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2e006d3b0 0x7fa2e00b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.371+0000 7fa2e6bdb700 1 -- 172.21.15.112:0/4108398179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2e006d3b0 msgr2=0x7fa2e00b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.371+0000 7fa2e6bdb700 1 --2- 172.21.15.112:0/4108398179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2e006d3b0 0x7fa2e00b2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.371+0000 7fa2e6bdb700 1 -- 172.21.15.112:0/4108398179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2e0159a20 msgr2=0x7fa2e00b62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.371+0000 7fa2e6bdb700 1 --2- 172.21.15.112:0/4108398179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2e0159a20 0x7fa2e00b62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.371+0000 7fa2e6bdb700 1 -- 172.21.15.112:0/4108398179 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc009a20 con 0x7fa2e015c720 2023-10-06T04:39:53.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.371+0000 7fa2e6bdb700 1 --2- 172.21.15.112:0/4108398179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2e015c720 0x7fa2e00b05d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800c590 tx=0x7fa2d8007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:53.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.371+0000 7fa2d67fc700 1 -- 172.21.15.112:0/4108398179 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8016070 con 0x7fa2e015c720 2023-10-06T04:39:53.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.371+0000 7fa2d67fc700 1 -- 172.21.15.112:0/4108398179 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d8011590 con 0x7fa2e015c720 2023-10-06T04:39:53.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.372+0000 7fa2e863e700 1 -- 172.21.15.112:0/4108398179 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e0152360 con 0x7fa2e015c720 2023-10-06T04:39:53.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.372+0000 7fa2d67fc700 1 -- 172.21.15.112:0/4108398179 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8011970 con 0x7fa2e015c720 2023-10-06T04:39:53.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.372+0000 7fa2e863e700 1 -- 172.21.15.112:0/4108398179 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e01528e0 con 0x7fa2e015c720 2023-10-06T04:39:53.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.372+0000 7fa2e863e700 1 -- 172.21.15.112:0/4108398179 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e005f230 con 0x7fa2e015c720 2023-10-06T04:39:53.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.373+0000 7fa2d67fc700 1 -- 172.21.15.112:0/4108398179 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2d8012420 con 0x7fa2e015c720 2023-10-06T04:39:53.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.373+0000 7fa2d67fc700 1 --2- 172.21.15.112:0/4108398179 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa2c4066f30 0x7fa2c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.373+0000 7fa2d67fc700 1 -- 172.21.15.112:0/4108398179 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa2d8084200 con 0x7fa2e015c720 2023-10-06T04:39:53.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.373+0000 7fa2e63da700 1 --2- 172.21.15.112:0/4108398179 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa2c4066f30 0x7fa2c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.374+0000 7fa2e63da700 1 --2- 172.21.15.112:0/4108398179 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa2c4066f30 0x7fa2c40693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc0099f0 tx=0x7fa2dc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:53.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.377+0000 7fa2d67fc700 1 -- 172.21.15.112:0/4108398179 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2d8051310 con 0x7fa2e015c720 2023-10-06T04:39:53.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.557+0000 7fa2e863e700 1 -- 172.21.15.112:0/4108398179 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa2e0089500 con 0x7fa2e015c720 2023-10-06T04:39:53.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.558+0000 7fa2d67fc700 1 -- 172.21.15.112:0/4108398179 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa2d8054930 con 0x7fa2e015c720 2023-10-06T04:39:53.560 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-10-06T04:39:53.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.560+0000 7fa2e863e700 1 -- 172.21.15.112:0/4108398179 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa2c4066f30 msgr2=0x7fa2c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.560+0000 7fa2e863e700 1 --2- 172.21.15.112:0/4108398179 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa2c4066f30 0x7fa2c40693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc0099f0 tx=0x7fa2dc017000 comp rx=0 tx=0).stop 2023-10-06T04:39:53.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.560+0000 7fa2e863e700 1 -- 172.21.15.112:0/4108398179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2e015c720 msgr2=0x7fa2e00b05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.560+0000 7fa2e863e700 1 --2- 172.21.15.112:0/4108398179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2e015c720 0x7fa2e00b05d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800c590 tx=0x7fa2d8007d80 comp rx=0 tx=0).stop 2023-10-06T04:39:53.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.560+0000 7fa2e863e700 1 -- 172.21.15.112:0/4108398179 shutdown_connections 2023-10-06T04:39:53.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.560+0000 7fa2e863e700 1 --2- 172.21.15.112:0/4108398179 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa2c4066f30 0x7fa2c40693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.560+0000 7fa2e863e700 1 --2- 172.21.15.112:0/4108398179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2e015c720 0x7fa2e00b05d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.560+0000 7fa2e863e700 1 --2- 172.21.15.112:0/4108398179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2e006d3b0 0x7fa2e00b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.560+0000 7fa2e863e700 1 --2- 172.21.15.112:0/4108398179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2e0159a20 0x7fa2e00b62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.560+0000 7fa2e863e700 1 -- 172.21.15.112:0/4108398179 >> 172.21.15.112:0/4108398179 conn(0x7fa2e006cfb0 msgr2=0x7fa2e006dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:53.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.560+0000 7fa2e863e700 1 -- 172.21.15.112:0/4108398179 shutdown_connections 2023-10-06T04:39:53.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.560+0000 7fa2e863e700 1 -- 172.21.15.112:0/4108398179 wait complete. 2023-10-06T04:39:53.574 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:39:53.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.688+0000 7fbad8e51700 1 Processor -- start 2023-10-06T04:39:53.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.688+0000 7fbad8e51700 1 -- start start 2023-10-06T04:39:53.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.689+0000 7fbad8e51700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbad4159d50 0x7fbad40b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.689+0000 7fbad8e51700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbad40b0e70 0x7fbad40b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.689+0000 7fbad8e51700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad40cd740 con 0x7fbad415a120 2023-10-06T04:39:53.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.689+0000 7fbad8e51700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad40b17d0 con 0x7fbad4159d50 2023-10-06T04:39:53.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.689+0000 7fbad8e51700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad40ccb30 con 0x7fbad40b0e70 2023-10-06T04:39:53.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.689+0000 7fbad259c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbad4159d50 0x7fbad40b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.689+0000 7fbad259c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbad4159d50 0x7fbad40b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34528/0 (socket says 172.21.15.112:34528) 2023-10-06T04:39:53.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.689+0000 7fbad259c700 1 -- 172.21.15.112:0/1739741891 learned_addr learned my addr 172.21.15.112:0/1739741891 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:53.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.689+0000 7fbad2d9d700 1 --2- 172.21.15.112:0/1739741891 >> v2:172.21.15.179:3300/0 conn(0x7fbad40b0e70 0x7fbad40b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.689+0000 7fbad259c700 1 -- 172.21.15.112:0/1739741891 >> v2:172.21.15.179:3300/0 conn(0x7fbad40b0e70 msgr2=0x7fbad40b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:53.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.689+0000 7fbad259c700 1 --2- 172.21.15.112:0/1739741891 >> v2:172.21.15.179:3300/0 conn(0x7fbad40b0e70 0x7fbad40b1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.689+0000 7fbad259c700 1 -- 172.21.15.112:0/1739741891 >> v1:172.21.15.179:6789/0 conn(0x7fbad415a120 legacy=0x7fbad40cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:53.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.690+0000 7fbad259c700 1 -- 172.21.15.112:0/1739741891 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad40cce10 con 0x7fbad4159d50 2023-10-06T04:39:53.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.690+0000 7fbad259c700 1 --2- 172.21.15.112:0/1739741891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbad4159d50 0x7fbad40b3040 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbad40b0850 tx=0x7fbac4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841688e5b692d2a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:53.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.690+0000 7fbad1d9b700 1 -- 172.21.15.112:0/1739741891 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac400b820 con 0x7fbad4159d50 2023-10-06T04:39:53.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.690+0000 7fbad1d9b700 1 -- 172.21.15.112:0/1739741891 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac400b980 con 0x7fbad4159d50 2023-10-06T04:39:53.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.690+0000 7fbad1d9b700 1 -- 172.21.15.112:0/1739741891 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac400bd20 con 0x7fbad4159d50 2023-10-06T04:39:53.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.690+0000 7fbad8e51700 1 -- 172.21.15.112:0/1739741891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbad4159d50 msgr2=0x7fbad40b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.690+0000 7fbad8e51700 1 --2- 172.21.15.112:0/1739741891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbad4159d50 0x7fbad40b3040 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbad40b0850 tx=0x7fbac4009250 comp rx=0 tx=0).stop 2023-10-06T04:39:53.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.690+0000 7fbad8e51700 1 -- 172.21.15.112:0/1739741891 shutdown_connections 2023-10-06T04:39:53.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.690+0000 7fbad8e51700 1 --2- 172.21.15.112:0/1739741891 >> v2:172.21.15.179:3300/0 conn(0x7fbad40b0e70 0x7fbad40b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.690+0000 7fbad8e51700 1 --2- 172.21.15.112:0/1739741891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbad4159d50 0x7fbad40b3040 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.690+0000 7fbad8e51700 1 -- 172.21.15.112:0/1739741891 >> 172.21.15.112:0/1739741891 conn(0x7fbad4099b60 msgr2=0x7fbad406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:53.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.690+0000 7fbad8e51700 1 -- 172.21.15.112:0/1739741891 shutdown_connections 2023-10-06T04:39:53.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.690+0000 7fbad8e51700 1 -- 172.21.15.112:0/1739741891 wait complete. 2023-10-06T04:39:53.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.692+0000 7fbad8e51700 1 Processor -- start 2023-10-06T04:39:53.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.692+0000 7fbad8e51700 1 -- start start 2023-10-06T04:39:53.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.692+0000 7fbad8e51700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbad40b0e70 0x7fbad40b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.692+0000 7fbad8e51700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbad4159d50 0x7fbad415ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.692+0000 7fbad8e51700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbad415a120 0x7fbad4155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.692+0000 7fbad8e51700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad409fc90 con 0x7fbad40b0e70 2023-10-06T04:39:53.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.692+0000 7fbad8e51700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad40b6470 con 0x7fbad415a120 2023-10-06T04:39:53.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.692+0000 7fbad8e51700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad40b4ba0 con 0x7fbad4159d50 2023-10-06T04:39:53.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.692+0000 7fbad259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbad40b0e70 0x7fbad40b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.692+0000 7fbad259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbad40b0e70 0x7fbad40b4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34530/0 (socket says 172.21.15.112:34530) 2023-10-06T04:39:53.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.692+0000 7fbad259c700 1 -- 172.21.15.112:0/2759094468 learned_addr learned my addr 172.21.15.112:0/2759094468 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:53.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.693+0000 7fbad259c700 1 -- 172.21.15.112:0/2759094468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbad4159d50 msgr2=0x7fbad415ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.693+0000 7fbad259c700 1 --2- 172.21.15.112:0/2759094468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbad4159d50 0x7fbad415ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.693+0000 7fbad2d9d700 1 --2- 172.21.15.112:0/2759094468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbad415a120 0x7fbad4155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.693+0000 7fbad259c700 1 -- 172.21.15.112:0/2759094468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbad415a120 msgr2=0x7fbad4155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.693+0000 7fbad259c700 1 --2- 172.21.15.112:0/2759094468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbad415a120 0x7fbad4155760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.693+0000 7fbad259c700 1 -- 172.21.15.112:0/2759094468 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac40094f0 con 0x7fbad40b0e70 2023-10-06T04:39:53.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.693+0000 7fbad259c700 1 --2- 172.21.15.112:0/2759094468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbad40b0e70 0x7fbad40b4660 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbac40030c0 tx=0x7fbac4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:53.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.693+0000 7fbacaffd700 1 -- 172.21.15.112:0/2759094468 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4011e60 con 0x7fbad40b0e70 2023-10-06T04:39:53.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.693+0000 7fbacaffd700 1 -- 172.21.15.112:0/2759094468 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac4020070 con 0x7fbad40b0e70 2023-10-06T04:39:53.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.693+0000 7fbad8e51700 1 -- 172.21.15.112:0/2759094468 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad416e140 con 0x7fbad40b0e70 2023-10-06T04:39:53.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.693+0000 7fbacaffd700 1 -- 172.21.15.112:0/2759094468 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac401b6a0 con 0x7fbad40b0e70 2023-10-06T04:39:53.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.693+0000 7fbad8e51700 1 -- 172.21.15.112:0/2759094468 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad416e700 con 0x7fbad40b0e70 2023-10-06T04:39:53.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.694+0000 7fbad8e51700 1 -- 172.21.15.112:0/2759094468 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad40b00c0 con 0x7fbad40b0e70 2023-10-06T04:39:53.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.694+0000 7fbacaffd700 1 -- 172.21.15.112:0/2759094468 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbac4022030 con 0x7fbad40b0e70 2023-10-06T04:39:53.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.695+0000 7fbacaffd700 1 --2- 172.21.15.112:0/2759094468 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fbab4066f30 0x7fbab40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:53.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.695+0000 7fbac9d9b700 1 --2- 172.21.15.112:0/2759094468 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fbab4066f30 0x7fbab40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:53.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.695+0000 7fbacaffd700 1 -- 172.21.15.112:0/2759094468 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbac40866b0 con 0x7fbad40b0e70 2023-10-06T04:39:53.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.695+0000 7fbac9d9b700 1 --2- 172.21.15.112:0/2759094468 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fbab4066f30 0x7fbab40693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbad4152eb0 tx=0x7fbabc006c40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:53.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.699+0000 7fbacaffd700 1 -- 172.21.15.112:0/2759094468 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbac40537c0 con 0x7fbad40b0e70 2023-10-06T04:39:53.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.926+0000 7fbad8e51700 1 -- 172.21.15.112:0/2759094468 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbad40b00c0 con 0x7fbad40b0e70 2023-10-06T04:39:53.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.927+0000 7fbacaffd700 1 -- 172.21.15.112:0/2759094468 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fbac4056de0 con 0x7fbad40b0e70 2023-10-06T04:39:53.929 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:53.929 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1694304040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1694304040},{"type":"v1","addr":"172.21.15.112:6837","nonce":1694304040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3750383657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3750383657},{"type":"v1","addr":"172.21.15.112:6835","nonce":3750383657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2217480877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2217480877},{"type":"v1","addr":"172.21.15.179:6834","nonce":2217480877}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:39:21.015278+0000","modified":"2023-10-06T04:39:24.651029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/140836226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":140836226},{"type":"v1","addr":"172.21.15.179:6835","nonce":140836226}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:39:53.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.929+0000 7fbad8e51700 1 -- 172.21.15.112:0/2759094468 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fbab4066f30 msgr2=0x7fbab40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.929+0000 7fbad8e51700 1 --2- 172.21.15.112:0/2759094468 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fbab4066f30 0x7fbab40693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbad4152eb0 tx=0x7fbabc006c40 comp rx=0 tx=0).stop 2023-10-06T04:39:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.929+0000 7fbad8e51700 1 -- 172.21.15.112:0/2759094468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbad40b0e70 msgr2=0x7fbad40b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.929+0000 7fbad8e51700 1 --2- 172.21.15.112:0/2759094468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbad40b0e70 0x7fbad40b4660 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbac40030c0 tx=0x7fbac4016000 comp rx=0 tx=0).stop 2023-10-06T04:39:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.929+0000 7fbad8e51700 1 -- 172.21.15.112:0/2759094468 shutdown_connections 2023-10-06T04:39:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.929+0000 7fbad8e51700 1 --2- 172.21.15.112:0/2759094468 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fbab4066f30 0x7fbab40693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.929+0000 7fbad8e51700 1 --2- 172.21.15.112:0/2759094468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbad415a120 0x7fbad4155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.929+0000 7fbad8e51700 1 --2- 172.21.15.112:0/2759094468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbad40b0e70 0x7fbad40b4660 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.929+0000 7fbad8e51700 1 --2- 172.21.15.112:0/2759094468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbad4159d50 0x7fbad415ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.929+0000 7fbad8e51700 1 -- 172.21.15.112:0/2759094468 >> 172.21.15.112:0/2759094468 conn(0x7fbad4099b60 msgr2=0x7fbad41569f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.929+0000 7fbad8e51700 1 -- 172.21.15.112:0/2759094468 shutdown_connections 2023-10-06T04:39:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:53.929+0000 7fbad8e51700 1 -- 172.21.15.112:0/2759094468 wait complete. 2023-10-06T04:39:53.933 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 7 2023-10-06T04:39:53.943 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:54.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.055+0000 7f9ccf0f8700 1 Processor -- start 2023-10-06T04:39:54.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.055+0000 7f9ccf0f8700 1 -- start start 2023-10-06T04:39:54.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.055+0000 7f9ccf0f8700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cc80b3040 0x7f9cc80cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.056+0000 7f9ccf0f8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9cc80b0e70 0x7f9cc80b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.056+0000 7f9ccf0f8700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc80cd740 con 0x7f9cc8159d50 2023-10-06T04:39:54.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.056+0000 7f9ccf0f8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc80b3490 con 0x7f9cc80b0e70 2023-10-06T04:39:54.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.056+0000 7f9ccf0f8700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc80b1830 con 0x7f9cc80b3040 2023-10-06T04:39:54.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.056+0000 7f9ccd695700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9cc80b0e70 0x7f9cc80b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.056+0000 7f9ccd695700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9cc80b0e70 0x7f9cc80b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34540/0 (socket says 172.21.15.112:34540) 2023-10-06T04:39:54.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.056+0000 7f9ccd695700 1 -- 172.21.15.112:0/453558422 learned_addr learned my addr 172.21.15.112:0/453558422 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:54.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.056+0000 7f9cbffff700 1 --2- 172.21.15.112:0/453558422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cc80b3040 0x7f9cc80cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.056+0000 7f9ccd695700 1 -- 172.21.15.112:0/453558422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cc80b3040 msgr2=0x7f9cc80cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:54.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.056+0000 7f9ccd695700 1 --2- 172.21.15.112:0/453558422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cc80b3040 0x7f9cc80cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.056+0000 7f9ccd695700 1 -- 172.21.15.112:0/453558422 >> v1:172.21.15.179:6789/0 conn(0x7f9cc8159d50 legacy=0x7f9cc815a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.056+0000 7f9ccd695700 1 -- 172.21.15.112:0/453558422 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc80ccb30 con 0x7f9cc80b0e70 2023-10-06T04:39:54.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.056+0000 7f9cbffff700 1 --2- 172.21.15.112:0/453558422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cc80b3040 0x7f9cc80cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:54.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.056+0000 7f9ccd695700 1 --2- 172.21.15.112:0/453558422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc80b0e70 0x7f9cc80b12f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9cc00099b0 tx=0x7f9cc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dead6591195576 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:54.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.056+0000 7f9cbf7fe700 1 -- 172.21.15.112:0/453558422 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc000b860 con 0x7f9cc80b0e70 2023-10-06T04:39:54.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.056+0000 7f9cbf7fe700 1 -- 172.21.15.112:0/453558422 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc000b9c0 con 0x7f9cc80b0e70 2023-10-06T04:39:54.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.056+0000 7f9cbf7fe700 1 -- 172.21.15.112:0/453558422 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc000bd60 con 0x7f9cc80b0e70 2023-10-06T04:39:54.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.057+0000 7f9ccf0f8700 1 -- 172.21.15.112:0/453558422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc80b0e70 msgr2=0x7f9cc80b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.057+0000 7f9ccf0f8700 1 --2- 172.21.15.112:0/453558422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc80b0e70 0x7f9cc80b12f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9cc00099b0 tx=0x7f9cc0009250 comp rx=0 tx=0).stop 2023-10-06T04:39:54.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.057+0000 7f9ccf0f8700 1 -- 172.21.15.112:0/453558422 shutdown_connections 2023-10-06T04:39:54.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.057+0000 7f9ccf0f8700 1 --2- 172.21.15.112:0/453558422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc80b0e70 0x7f9cc80b12f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.057+0000 7f9ccf0f8700 1 --2- 172.21.15.112:0/453558422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cc80b3040 0x7f9cc80cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.057+0000 7f9ccf0f8700 1 -- 172.21.15.112:0/453558422 >> 172.21.15.112:0/453558422 conn(0x7f9cc8099b60 msgr2=0x7f9cc806cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:54.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.057+0000 7f9ccf0f8700 1 -- 172.21.15.112:0/453558422 shutdown_connections 2023-10-06T04:39:54.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.057+0000 7f9ccf0f8700 1 -- 172.21.15.112:0/453558422 wait complete. 2023-10-06T04:39:54.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.058+0000 7f9ccf0f8700 1 Processor -- start 2023-10-06T04:39:54.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.058+0000 7f9ccf0f8700 1 -- start start 2023-10-06T04:39:54.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9ccf0f8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc80b0e70 0x7f9cc80a11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9ccf0f8700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cc80b3040 0x7f9cc809e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9ccf0f8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cc8159d50 0x7f9cc81524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9ccf0f8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc80b48e0 con 0x7f9cc80b0e70 2023-10-06T04:39:54.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9ccf0f8700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc809f120 con 0x7f9cc8159d50 2023-10-06T04:39:54.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9ccf0f8700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc809f400 con 0x7f9cc80b3040 2023-10-06T04:39:54.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9ccce94700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc80b0e70 0x7f9cc80a11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9ccce94700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc80b0e70 0x7f9cc80a11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34546/0 (socket says 172.21.15.112:34546) 2023-10-06T04:39:54.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9ccce94700 1 -- 172.21.15.112:0/1694650105 learned_addr learned my addr 172.21.15.112:0/1694650105 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:54.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9cbffff700 1 --2- 172.21.15.112:0/1694650105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cc80b3040 0x7f9cc809e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9ccd695700 1 --2- 172.21.15.112:0/1694650105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cc8159d50 0x7f9cc81524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9ccce94700 1 -- 172.21.15.112:0/1694650105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cc80b3040 msgr2=0x7f9cc809e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9ccce94700 1 --2- 172.21.15.112:0/1694650105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cc80b3040 0x7f9cc809e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9ccce94700 1 -- 172.21.15.112:0/1694650105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cc8159d50 msgr2=0x7f9cc81524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9ccce94700 1 --2- 172.21.15.112:0/1694650105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cc8159d50 0x7f9cc81524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9ccce94700 1 -- 172.21.15.112:0/1694650105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc00094f0 con 0x7f9cc80b0e70 2023-10-06T04:39:54.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9ccd695700 1 --2- 172.21.15.112:0/1694650105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cc8159d50 0x7f9cc81524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:54.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9ccce94700 1 --2- 172.21.15.112:0/1694650105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc80b0e70 0x7f9cc80a11b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400cb10 tx=0x7f9cc40017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:54.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9cbcff9700 1 -- 172.21.15.112:0/1694650105 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc400a760 con 0x7f9cc80b0e70 2023-10-06T04:39:54.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9cbcff9700 1 -- 172.21.15.112:0/1694650105 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc400a8e0 con 0x7f9cc80b0e70 2023-10-06T04:39:54.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9ccf0f8700 1 -- 172.21.15.112:0/1694650105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc809f6e0 con 0x7f9cc80b0e70 2023-10-06T04:39:54.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.059+0000 7f9cbcff9700 1 -- 172.21.15.112:0/1694650105 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc400aca0 con 0x7f9cc80b0e70 2023-10-06T04:39:54.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.060+0000 7f9ccf0f8700 1 -- 172.21.15.112:0/1694650105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc809ee10 con 0x7f9cc80b0e70 2023-10-06T04:39:54.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.060+0000 7f9ccf0f8700 1 -- 172.21.15.112:0/1694650105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc805f230 con 0x7f9cc80b0e70 2023-10-06T04:39:54.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.061+0000 7f9cbcff9700 1 -- 172.21.15.112:0/1694650105 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9cc4003030 con 0x7f9cc80b0e70 2023-10-06T04:39:54.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.061+0000 7f9cbcff9700 1 --2- 172.21.15.112:0/1694650105 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9cb4066f30 0x7f9cb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.061+0000 7f9cbcff9700 1 -- 172.21.15.112:0/1694650105 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9cc4084790 con 0x7f9cc80b0e70 2023-10-06T04:39:54.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.061+0000 7f9cbffff700 1 --2- 172.21.15.112:0/1694650105 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9cb4066f30 0x7f9cb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.062+0000 7f9cbffff700 1 --2- 172.21.15.112:0/1694650105 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9cb4066f30 0x7f9cb40693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8006f00 tx=0x7f9cb8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:54.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.065+0000 7f9cbcff9700 1 -- 172.21.15.112:0/1694650105 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9cc40518a0 con 0x7f9cc80b0e70 2023-10-06T04:39:54.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.250+0000 7f9ccf0f8700 1 -- 172.21.15.112:0/1694650105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cc80b4a20 con 0x7f9cc80b0e70 2023-10-06T04:39:54.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.251+0000 7f9cbcff9700 1 -- 172.21.15.112:0/1694650105 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f9cc4054ec0 con 0x7f9cc80b0e70 2023-10-06T04:39:54.253 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:54.254 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:39:22.637355+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:18.657040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:19.972295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:54.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.253+0000 7f9ccf0f8700 1 -- 172.21.15.112:0/1694650105 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9cb4066f30 msgr2=0x7f9cb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.253+0000 7f9ccf0f8700 1 --2- 172.21.15.112:0/1694650105 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9cb4066f30 0x7f9cb40693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8006f00 tx=0x7f9cb8008040 comp rx=0 tx=0).stop 2023-10-06T04:39:54.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.253+0000 7f9ccf0f8700 1 -- 172.21.15.112:0/1694650105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc80b0e70 msgr2=0x7f9cc80a11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.253+0000 7f9ccf0f8700 1 --2- 172.21.15.112:0/1694650105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc80b0e70 0x7f9cc80a11b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400cb10 tx=0x7f9cc40017b0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.253+0000 7f9ccf0f8700 1 -- 172.21.15.112:0/1694650105 shutdown_connections 2023-10-06T04:39:54.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.253+0000 7f9ccf0f8700 1 --2- 172.21.15.112:0/1694650105 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9cb4066f30 0x7f9cb40693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.253+0000 7f9ccf0f8700 1 --2- 172.21.15.112:0/1694650105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cc8159d50 0x7f9cc81524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.253+0000 7f9ccf0f8700 1 --2- 172.21.15.112:0/1694650105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc80b0e70 0x7f9cc80a11b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.253+0000 7f9ccf0f8700 1 --2- 172.21.15.112:0/1694650105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cc80b3040 0x7f9cc809e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.253+0000 7f9ccf0f8700 1 -- 172.21.15.112:0/1694650105 >> 172.21.15.112:0/1694650105 conn(0x7f9cc8099b60 msgr2=0x7f9cc8153ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:54.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.253+0000 7f9ccf0f8700 1 -- 172.21.15.112:0/1694650105 shutdown_connections 2023-10-06T04:39:54.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.253+0000 7f9ccf0f8700 1 -- 172.21.15.112:0/1694650105 wait complete. 2023-10-06T04:39:54.267 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:39:54.268 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:39:54.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.380+0000 7fd53b015700 1 Processor -- start 2023-10-06T04:39:54.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.380+0000 7fd53b015700 1 -- start start 2023-10-06T04:39:54.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.381+0000 7fd53b015700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5340b11a0 0x7fd5340d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.381+0000 7fd53b015700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd53406d3b0 0x7fd5340b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.381+0000 7fd53b015700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd5340b3810 0x7fd5340b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.381+0000 7fd53b015700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5340afed0 con 0x7fd53406d3b0 2023-10-06T04:39:54.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.381+0000 7fd53b015700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5340b1ab0 con 0x7fd5340b3810 2023-10-06T04:39:54.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.381+0000 7fd53b015700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340b6170 con 0x7fd5340b11a0 2023-10-06T04:39:54.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.381+0000 7fd539812700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd53406d3b0 0x7fd5340b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.381+0000 7fd539812700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd53406d3b0 0x7fd5340b1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34554/0 (socket says 172.21.15.112:34554) 2023-10-06T04:39:54.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.381+0000 7fd539812700 1 -- 172.21.15.112:0/1726841907 learned_addr learned my addr 172.21.15.112:0/1726841907 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:54.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.381+0000 7fd53a013700 1 --2- 172.21.15.112:0/1726841907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5340b11a0 0x7fd5340d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.381+0000 7fd53a814700 1 --2- 172.21.15.112:0/1726841907 >> v2:172.21.15.179:3300/0 conn(0x7fd5340b3810 0x7fd5340b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.381+0000 7fd539812700 1 -- 172.21.15.112:0/1726841907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5340b11a0 msgr2=0x7fd5340d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:54.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.381+0000 7fd539812700 1 --2- 172.21.15.112:0/1726841907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5340b11a0 0x7fd5340d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.381+0000 7fd539812700 1 -- 172.21.15.112:0/1726841907 >> v2:172.21.15.179:3300/0 conn(0x7fd5340b3810 msgr2=0x7fd5340b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:54.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.381+0000 7fd539812700 1 --2- 172.21.15.112:0/1726841907 >> v2:172.21.15.179:3300/0 conn(0x7fd5340b3810 0x7fd5340b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.381+0000 7fd539812700 1 -- 172.21.15.112:0/1726841907 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5340b6450 con 0x7fd53406d3b0 2023-10-06T04:39:54.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.381+0000 7fd539812700 1 --2- 172.21.15.112:0/1726841907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd53406d3b0 0x7fd5340b1570 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd534088a80 tx=0x7fd524009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cc54aae8656765 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:54.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.382+0000 7fd539011700 1 -- 172.21.15.112:0/1726841907 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52400b640 con 0x7fd53406d3b0 2023-10-06T04:39:54.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.382+0000 7fd539011700 1 -- 172.21.15.112:0/1726841907 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52400b7a0 con 0x7fd53406d3b0 2023-10-06T04:39:54.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.382+0000 7fd539011700 1 -- 172.21.15.112:0/1726841907 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52400bb60 con 0x7fd53406d3b0 2023-10-06T04:39:54.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.382+0000 7fd53b015700 1 -- 172.21.15.112:0/1726841907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd53406d3b0 msgr2=0x7fd5340b1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.382+0000 7fd53b015700 1 --2- 172.21.15.112:0/1726841907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd53406d3b0 0x7fd5340b1570 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd534088a80 tx=0x7fd524009250 comp rx=0 tx=0).stop 2023-10-06T04:39:54.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.382+0000 7fd53b015700 1 -- 172.21.15.112:0/1726841907 shutdown_connections 2023-10-06T04:39:54.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.382+0000 7fd53b015700 1 --2- 172.21.15.112:0/1726841907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5340b11a0 0x7fd5340d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.382+0000 7fd53b015700 1 --2- 172.21.15.112:0/1726841907 >> v2:172.21.15.179:3300/0 conn(0x7fd5340b3810 0x7fd5340b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.382+0000 7fd53b015700 1 --2- 172.21.15.112:0/1726841907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd53406d3b0 0x7fd5340b1570 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.382+0000 7fd53b015700 1 -- 172.21.15.112:0/1726841907 >> 172.21.15.112:0/1726841907 conn(0x7fd53406cfb0 msgr2=0x7fd5340d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:54.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.382+0000 7fd53b015700 1 -- 172.21.15.112:0/1726841907 shutdown_connections 2023-10-06T04:39:54.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.382+0000 7fd53b015700 1 -- 172.21.15.112:0/1726841907 wait complete. 2023-10-06T04:39:54.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.383+0000 7fd53b015700 1 Processor -- start 2023-10-06T04:39:54.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.383+0000 7fd53b015700 1 -- start start 2023-10-06T04:39:54.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.384+0000 7fd53b015700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd53406d3b0 0x7fd5340c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.384+0000 7fd53b015700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5340b11a0 0x7fd53415d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.384+0000 7fd53b015700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5340b3810 0x7fd53416d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.384+0000 7fd53b015700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340c7710 con 0x7fd53406d3b0 2023-10-06T04:39:54.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.384+0000 7fd53b015700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340c5e50 con 0x7fd5340b11a0 2023-10-06T04:39:54.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.384+0000 7fd53b015700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340cb330 con 0x7fd5340b3810 2023-10-06T04:39:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.384+0000 7fd53a013700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd53406d3b0 0x7fd5340c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.384+0000 7fd53a013700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd53406d3b0 0x7fd5340c5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34564/0 (socket says 172.21.15.112:34564) 2023-10-06T04:39:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.384+0000 7fd53a013700 1 -- 172.21.15.112:0/2688230003 learned_addr learned my addr 172.21.15.112:0/2688230003 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.384+0000 7fd539812700 1 --2- 172.21.15.112:0/2688230003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5340b11a0 0x7fd53415d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.384+0000 7fd53a814700 1 --2- 172.21.15.112:0/2688230003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5340b3810 0x7fd53416d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.384+0000 7fd53a013700 1 -- 172.21.15.112:0/2688230003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5340b3810 msgr2=0x7fd53416d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.384+0000 7fd53a013700 1 --2- 172.21.15.112:0/2688230003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5340b3810 0x7fd53416d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.384+0000 7fd53a013700 1 -- 172.21.15.112:0/2688230003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5340b11a0 msgr2=0x7fd53415d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.384+0000 7fd53a013700 1 --2- 172.21.15.112:0/2688230003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5340b11a0 0x7fd53415d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.384+0000 7fd53a013700 1 -- 172.21.15.112:0/2688230003 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5240094f0 con 0x7fd53406d3b0 2023-10-06T04:39:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.384+0000 7fd539812700 1 --2- 172.21.15.112:0/2688230003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5340b11a0 0x7fd53415d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.384+0000 7fd53a013700 1 --2- 172.21.15.112:0/2688230003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd53406d3b0 0x7fd5340c5910 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00e930 tx=0x7fd52c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.384+0000 7fd52a7fc700 1 -- 172.21.15.112:0/2688230003 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c00eed0 con 0x7fd53406d3b0 2023-10-06T04:39:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.384+0000 7fd52a7fc700 1 -- 172.21.15.112:0/2688230003 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c00c850 con 0x7fd53406d3b0 2023-10-06T04:39:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.385+0000 7fd52a7fc700 1 -- 172.21.15.112:0/2688230003 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c00cbf0 con 0x7fd53406d3b0 2023-10-06T04:39:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.385+0000 7fd53b015700 1 -- 172.21.15.112:0/2688230003 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5340cb610 con 0x7fd53406d3b0 2023-10-06T04:39:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.385+0000 7fd53b015700 1 -- 172.21.15.112:0/2688230003 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53415d740 con 0x7fd53406d3b0 2023-10-06T04:39:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.386+0000 7fd53b015700 1 -- 172.21.15.112:0/2688230003 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53408abe0 con 0x7fd53406d3b0 2023-10-06T04:39:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.386+0000 7fd52a7fc700 1 -- 172.21.15.112:0/2688230003 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd52c013470 con 0x7fd53406d3b0 2023-10-06T04:39:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.386+0000 7fd52a7fc700 1 --2- 172.21.15.112:0/2688230003 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd518066f30 0x7fd5180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.386+0000 7fd52a7fc700 1 -- 172.21.15.112:0/2688230003 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd52c0848c0 con 0x7fd53406d3b0 2023-10-06T04:39:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.386+0000 7fd539812700 1 --2- 172.21.15.112:0/2688230003 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd518066f30 0x7fd5180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.387+0000 7fd539812700 1 --2- 172.21.15.112:0/2688230003 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd518066f30 0x7fd5180693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd534088a80 tx=0x7fd524017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:54.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.391+0000 7fd52a7fc700 1 -- 172.21.15.112:0/2688230003 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd52c0519d0 con 0x7fd53406d3b0 2023-10-06T04:39:54.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.615+0000 7fd53b015700 1 -- 172.21.15.112:0/2688230003 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd53405f230 con 0x7fd53406d3b0 2023-10-06T04:39:54.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.616+0000 7fd52a7fc700 1 -- 172.21.15.112:0/2688230003 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fd52c054ff0 con 0x7fd53406d3b0 2023-10-06T04:39:54.618 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:54.619 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1694304040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1694304040},{"type":"v1","addr":"172.21.15.112:6837","nonce":1694304040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3750383657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3750383657},{"type":"v1","addr":"172.21.15.112:6835","nonce":3750383657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2217480877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2217480877},{"type":"v1","addr":"172.21.15.179:6834","nonce":2217480877}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:39:21.015278+0000","modified":"2023-10-06T04:39:24.651029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/140836226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":140836226},{"type":"v1","addr":"172.21.15.179:6835","nonce":140836226}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:39:54.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.618+0000 7fd53b015700 1 -- 172.21.15.112:0/2688230003 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd518066f30 msgr2=0x7fd5180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.618+0000 7fd53b015700 1 --2- 172.21.15.112:0/2688230003 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd518066f30 0x7fd5180693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd534088a80 tx=0x7fd524017000 comp rx=0 tx=0).stop 2023-10-06T04:39:54.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.618+0000 7fd53b015700 1 -- 172.21.15.112:0/2688230003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd53406d3b0 msgr2=0x7fd5340c5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.618+0000 7fd53b015700 1 --2- 172.21.15.112:0/2688230003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd53406d3b0 0x7fd5340c5910 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00e930 tx=0x7fd52c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.618+0000 7fd53b015700 1 -- 172.21.15.112:0/2688230003 shutdown_connections 2023-10-06T04:39:54.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.618+0000 7fd53b015700 1 --2- 172.21.15.112:0/2688230003 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd518066f30 0x7fd5180693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.618+0000 7fd53b015700 1 --2- 172.21.15.112:0/2688230003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5340b3810 0x7fd53416d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.618+0000 7fd53b015700 1 --2- 172.21.15.112:0/2688230003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd53406d3b0 0x7fd5340c5910 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.618+0000 7fd53b015700 1 --2- 172.21.15.112:0/2688230003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5340b11a0 0x7fd53415d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.618+0000 7fd53b015700 1 -- 172.21.15.112:0/2688230003 >> 172.21.15.112:0/2688230003 conn(0x7fd53406cfb0 msgr2=0x7fd53415f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:54.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.618+0000 7fd53b015700 1 -- 172.21.15.112:0/2688230003 shutdown_connections 2023-10-06T04:39:54.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.618+0000 7fd53b015700 1 -- 172.21.15.112:0/2688230003 wait complete. 2023-10-06T04:39:54.622 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 7 2023-10-06T04:39:54.632 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:39:54.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.744+0000 7fd2e871c700 1 Processor -- start 2023-10-06T04:39:54.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.744+0000 7fd2e871c700 1 -- start start 2023-10-06T04:39:54.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.745+0000 7fd2e871c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd2e006d170 0x7fd2e006d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.745+0000 7fd2e871c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd2e0157aa0 0x7fd2e0157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.745+0000 7fd2e871c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e006db20 con 0x7fd2e01576d0 2023-10-06T04:39:54.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.745+0000 7fd2e871c700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e015b410 con 0x7fd2e006d170 2023-10-06T04:39:54.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.745+0000 7fd2e871c700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e015bcb0 con 0x7fd2e0157aa0 2023-10-06T04:39:54.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.745+0000 7fd2e64b8700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd2e01576d0 0x7fd2e00cb890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:37568/0 (socket says 172.21.15.112:37568) 2023-10-06T04:39:54.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.745+0000 7fd2e64b8700 1 -- 172.21.15.112:0/65549875 learned_addr learned my addr 172.21.15.112:0/65549875 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:54.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.745+0000 7fd2e5cb7700 1 --2- 172.21.15.112:0/65549875 >> v2:172.21.15.112:3300/0 conn(0x7fd2e006d170 0x7fd2e006d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.746+0000 7fd2e6cb9700 1 --2- 172.21.15.112:0/65549875 >> v2:172.21.15.179:3300/0 conn(0x7fd2e0157aa0 0x7fd2e0157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.746+0000 7fd2e54b6700 1 -- 172.21.15.112:0/65549875 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591469546 0 0) 0x7fd2e006db20 con 0x7fd2e01576d0 2023-10-06T04:39:54.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.746+0000 7fd2e54b6700 1 -- 172.21.15.112:0/65549875 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2cc003570 con 0x7fd2e01576d0 2023-10-06T04:39:54.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.746+0000 7fd2e5cb7700 1 -- 172.21.15.112:0/65549875 >> v2:172.21.15.179:3300/0 conn(0x7fd2e0157aa0 msgr2=0x7fd2e0157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:54.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.746+0000 7fd2e5cb7700 1 --2- 172.21.15.112:0/65549875 >> v2:172.21.15.179:3300/0 conn(0x7fd2e0157aa0 0x7fd2e0157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.746+0000 7fd2e5cb7700 1 -- 172.21.15.112:0/65549875 >> v1:172.21.15.112:6789/0 conn(0x7fd2e01576d0 legacy=0x7fd2e00cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.746+0000 7fd2e5cb7700 1 -- 172.21.15.112:0/65549875 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e00cbfa0 con 0x7fd2e006d170 2023-10-06T04:39:54.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.746+0000 7fd2e5cb7700 1 --2- 172.21.15.112:0/65549875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2e006d170 0x7fd2e006d5e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd2e006bdb0 tx=0x7fd2d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156968dca1217cda server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.746+0000 7fd2e54b6700 1 -- 172.21.15.112:0/65549875 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0011630 con 0x7fd2e006d170 2023-10-06T04:39:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.746+0000 7fd2e54b6700 1 -- 172.21.15.112:0/65549875 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d00117b0 con 0x7fd2e006d170 2023-10-06T04:39:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.746+0000 7fd2e54b6700 1 -- 172.21.15.112:0/65549875 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0011b30 con 0x7fd2e006d170 2023-10-06T04:39:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.747+0000 7fd2e871c700 1 -- 172.21.15.112:0/65549875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2e006d170 msgr2=0x7fd2e006d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.747+0000 7fd2e871c700 1 --2- 172.21.15.112:0/65549875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2e006d170 0x7fd2e006d5e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd2e006bdb0 tx=0x7fd2d00091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.747+0000 7fd2e871c700 1 -- 172.21.15.112:0/65549875 shutdown_connections 2023-10-06T04:39:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.747+0000 7fd2e871c700 1 --2- 172.21.15.112:0/65549875 >> v2:172.21.15.179:3300/0 conn(0x7fd2e0157aa0 0x7fd2e0157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.747+0000 7fd2e871c700 1 --2- 172.21.15.112:0/65549875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2e006d170 0x7fd2e006d5e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.747+0000 7fd2e871c700 1 -- 172.21.15.112:0/65549875 >> 172.21.15.112:0/65549875 conn(0x7fd2e00cd6e0 msgr2=0x7fd2e00ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.747+0000 7fd2e871c700 1 -- 172.21.15.112:0/65549875 shutdown_connections 2023-10-06T04:39:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.747+0000 7fd2e871c700 1 -- 172.21.15.112:0/65549875 wait complete. 2023-10-06T04:39:54.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.748+0000 7fd2e871c700 1 Processor -- start 2023-10-06T04:39:54.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.748+0000 7fd2e871c700 1 -- start start 2023-10-06T04:39:54.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.748+0000 7fd2e871c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2e006d170 0x7fd2e0167a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.748+0000 7fd2e871c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2e01576d0 0x7fd2e01539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.748+0000 7fd2e871c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2e0157aa0 0x7fd2e0144850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.748+0000 7fd2e871c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e0167f60 con 0x7fd2e006d170 2023-10-06T04:39:54.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.748+0000 7fd2e871c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e0168a20 con 0x7fd2e0157aa0 2023-10-06T04:39:54.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.748+0000 7fd2e871c700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e00a63e0 con 0x7fd2e01576d0 2023-10-06T04:39:54.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.749+0000 7fd2e64b8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2e006d170 0x7fd2e0167a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.749+0000 7fd2e64b8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2e006d170 0x7fd2e0167a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34580/0 (socket says 172.21.15.112:34580) 2023-10-06T04:39:54.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.749+0000 7fd2e64b8700 1 -- 172.21.15.112:0/4097417083 learned_addr learned my addr 172.21.15.112:0/4097417083 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:54.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.749+0000 7fd2e6cb9700 1 --2- 172.21.15.112:0/4097417083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2e0157aa0 0x7fd2e0144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.749+0000 7fd2e5cb7700 1 --2- 172.21.15.112:0/4097417083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2e01576d0 0x7fd2e01539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.749+0000 7fd2e64b8700 1 -- 172.21.15.112:0/4097417083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2e01576d0 msgr2=0x7fd2e01539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.749+0000 7fd2e64b8700 1 --2- 172.21.15.112:0/4097417083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2e01576d0 0x7fd2e01539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.749+0000 7fd2e64b8700 1 -- 172.21.15.112:0/4097417083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2e0157aa0 msgr2=0x7fd2e0144850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.749+0000 7fd2e64b8700 1 --2- 172.21.15.112:0/4097417083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2e0157aa0 0x7fd2e0144850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.749+0000 7fd2e64b8700 1 -- 172.21.15.112:0/4097417083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d0009420 con 0x7fd2e006d170 2023-10-06T04:39:54.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.749+0000 7fd2e64b8700 1 --2- 172.21.15.112:0/4097417083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2e006d170 0x7fd2e0167a20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00cd60 tx=0x7fd2dc001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:54.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.749+0000 7fd2d67fc700 1 -- 172.21.15.112:0/4097417083 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc00aa90 con 0x7fd2e006d170 2023-10-06T04:39:54.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.749+0000 7fd2d67fc700 1 -- 172.21.15.112:0/4097417083 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2dc00abf0 con 0x7fd2e006d170 2023-10-06T04:39:54.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.749+0000 7fd2e871c700 1 -- 172.21.15.112:0/4097417083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e0150300 con 0x7fd2e006d170 2023-10-06T04:39:54.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.749+0000 7fd2d67fc700 1 -- 172.21.15.112:0/4097417083 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc0070f0 con 0x7fd2e006d170 2023-10-06T04:39:54.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.749+0000 7fd2e871c700 1 -- 172.21.15.112:0/4097417083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e0168460 con 0x7fd2e006d170 2023-10-06T04:39:54.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.750+0000 7fd2e871c700 1 -- 172.21.15.112:0/4097417083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e00a61b0 con 0x7fd2e006d170 2023-10-06T04:39:54.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.751+0000 7fd2d67fc700 1 -- 172.21.15.112:0/4097417083 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd2dc0074a0 con 0x7fd2e006d170 2023-10-06T04:39:54.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.751+0000 7fd2d67fc700 1 --2- 172.21.15.112:0/4097417083 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd2c4066f30 0x7fd2c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:54.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.751+0000 7fd2d67fc700 1 -- 172.21.15.112:0/4097417083 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd2dc084a50 con 0x7fd2e006d170 2023-10-06T04:39:54.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.751+0000 7fd2e5cb7700 1 --2- 172.21.15.112:0/4097417083 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd2c4066f30 0x7fd2c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:54.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.751+0000 7fd2e5cb7700 1 --2- 172.21.15.112:0/4097417083 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd2c4066f30 0x7fd2c40693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd2e006bdb0 tx=0x7fd2d0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:54.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.755+0000 7fd2d67fc700 1 -- 172.21.15.112:0/4097417083 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2dc051be0 con 0x7fd2e006d170 2023-10-06T04:39:54.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.982+0000 7fd2e871c700 1 -- 172.21.15.112:0/4097417083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2e00cc250 con 0x7fd2e006d170 2023-10-06T04:39:54.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.982+0000 7fd2d67fc700 1 -- 172.21.15.112:0/4097417083 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fd2dc055200 con 0x7fd2e006d170 2023-10-06T04:39:54.985 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:54.985 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1694304040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1694304040},{"type":"v1","addr":"172.21.15.112:6837","nonce":1694304040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3750383657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3750383657},{"type":"v1","addr":"172.21.15.112:6835","nonce":3750383657}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2217480877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2217480877},{"type":"v1","addr":"172.21.15.179:6834","nonce":2217480877}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:39:21.015278+0000","modified":"2023-10-06T04:39:24.651029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/140836226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":140836226},{"type":"v1","addr":"172.21.15.179:6835","nonce":140836226}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:39:54.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.985+0000 7fd2e871c700 1 -- 172.21.15.112:0/4097417083 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd2c4066f30 msgr2=0x7fd2c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.985+0000 7fd2e871c700 1 --2- 172.21.15.112:0/4097417083 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd2c4066f30 0x7fd2c40693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd2e006bdb0 tx=0x7fd2d0017000 comp rx=0 tx=0).stop 2023-10-06T04:39:54.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.985+0000 7fd2e871c700 1 -- 172.21.15.112:0/4097417083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2e006d170 msgr2=0x7fd2e0167a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:54.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.985+0000 7fd2e871c700 1 --2- 172.21.15.112:0/4097417083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2e006d170 0x7fd2e0167a20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00cd60 tx=0x7fd2dc001b00 comp rx=0 tx=0).stop 2023-10-06T04:39:54.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.985+0000 7fd2e871c700 1 -- 172.21.15.112:0/4097417083 shutdown_connections 2023-10-06T04:39:54.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.985+0000 7fd2e871c700 1 --2- 172.21.15.112:0/4097417083 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd2c4066f30 0x7fd2c40693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.985+0000 7fd2e871c700 1 --2- 172.21.15.112:0/4097417083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2e0157aa0 0x7fd2e0144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.985+0000 7fd2e871c700 1 --2- 172.21.15.112:0/4097417083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2e006d170 0x7fd2e0167a20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.985+0000 7fd2e871c700 1 --2- 172.21.15.112:0/4097417083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2e01576d0 0x7fd2e01539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:54.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.985+0000 7fd2e871c700 1 -- 172.21.15.112:0/4097417083 >> 172.21.15.112:0/4097417083 conn(0x7fd2e00cd6e0 msgr2=0x7fd2e0150b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:54.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.985+0000 7fd2e871c700 1 -- 172.21.15.112:0/4097417083 shutdown_connections 2023-10-06T04:39:54.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:54.985+0000 7fd2e871c700 1 -- 172.21.15.112:0/4097417083 wait complete. 2023-10-06T04:39:54.988 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 7 2023-10-06T04:39:54.999 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:39:55.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.110+0000 7f86d5608700 1 Processor -- start 2023-10-06T04:39:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.110+0000 7f86d5608700 1 -- start start 2023-10-06T04:39:55.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.111+0000 7f86d5608700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f86d00b11a0 0x7f86d00d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.111+0000 7f86d5608700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86d006d3b0 0x7f86d00b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.111+0000 7f86d5608700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f86d00b3810 0x7f86d00b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.111+0000 7f86d5608700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d00afed0 con 0x7f86d00b3810 2023-10-06T04:39:55.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.111+0000 7f86d5608700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d00b1ab0 con 0x7f86d00b11a0 2023-10-06T04:39:55.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.111+0000 7f86d5608700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d00b6170 con 0x7f86d006d3b0 2023-10-06T04:39:55.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.111+0000 7f86d4e07700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f86d00b3810 0x7f86d00b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.111+0000 7f86d4e07700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f86d00b3810 0x7f86d00b3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34584/0 (socket says 172.21.15.112:34584) 2023-10-06T04:39:55.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.111+0000 7f86d4e07700 1 -- 172.21.15.112:0/3179675411 learned_addr learned my addr 172.21.15.112:0/3179675411 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:55.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.111+0000 7f86cf7fe700 1 --2- 172.21.15.112:0/3179675411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86d006d3b0 0x7f86d00b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.111+0000 7f86cffff700 1 --2- 172.21.15.112:0/3179675411 >> v2:172.21.15.179:3300/0 conn(0x7f86d00b11a0 0x7f86d00d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.111+0000 7f86d4e07700 1 -- 172.21.15.112:0/3179675411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86d006d3b0 msgr2=0x7f86d00b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:55.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.111+0000 7f86d4e07700 1 --2- 172.21.15.112:0/3179675411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86d006d3b0 0x7f86d00b1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.111+0000 7f86d4e07700 1 -- 172.21.15.112:0/3179675411 >> v2:172.21.15.179:3300/0 conn(0x7f86d00b11a0 msgr2=0x7f86d00d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:55.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.111+0000 7f86d4e07700 1 --2- 172.21.15.112:0/3179675411 >> v2:172.21.15.179:3300/0 conn(0x7f86d00b11a0 0x7f86d00d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.111+0000 7f86d4e07700 1 -- 172.21.15.112:0/3179675411 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d00b6450 con 0x7f86d00b3810 2023-10-06T04:39:55.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.112+0000 7f86d4e07700 1 --2- 172.21.15.112:0/3179675411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d00b3810 0x7f86d00b3cb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f86d0088ee0 tx=0x7f86c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fa40d58984a878 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:55.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.112+0000 7f86ceffd700 1 -- 172.21.15.112:0/3179675411 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c800e070 con 0x7f86d00b3810 2023-10-06T04:39:55.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.112+0000 7f86ceffd700 1 -- 172.21.15.112:0/3179675411 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c800b970 con 0x7f86d00b3810 2023-10-06T04:39:55.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.112+0000 7f86ceffd700 1 -- 172.21.15.112:0/3179675411 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c80092e0 con 0x7f86d00b3810 2023-10-06T04:39:55.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.112+0000 7f86d5608700 1 -- 172.21.15.112:0/3179675411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d00b3810 msgr2=0x7f86d00b3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.112+0000 7f86d5608700 1 --2- 172.21.15.112:0/3179675411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d00b3810 0x7f86d00b3cb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f86d0088ee0 tx=0x7f86c8009840 comp rx=0 tx=0).stop 2023-10-06T04:39:55.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.112+0000 7f86d5608700 1 -- 172.21.15.112:0/3179675411 shutdown_connections 2023-10-06T04:39:55.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.112+0000 7f86d5608700 1 --2- 172.21.15.112:0/3179675411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d00b3810 0x7f86d00b3cb0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.112+0000 7f86d5608700 1 --2- 172.21.15.112:0/3179675411 >> v2:172.21.15.179:3300/0 conn(0x7f86d00b11a0 0x7f86d00d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.112+0000 7f86d5608700 1 --2- 172.21.15.112:0/3179675411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86d006d3b0 0x7f86d00b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.112+0000 7f86d5608700 1 -- 172.21.15.112:0/3179675411 >> 172.21.15.112:0/3179675411 conn(0x7f86d006cfb0 msgr2=0x7f86d00d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:55.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.112+0000 7f86d5608700 1 -- 172.21.15.112:0/3179675411 shutdown_connections 2023-10-06T04:39:55.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.112+0000 7f86d5608700 1 -- 172.21.15.112:0/3179675411 wait complete. 2023-10-06T04:39:55.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.113+0000 7f86d5608700 1 Processor -- start 2023-10-06T04:39:55.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.114+0000 7f86d5608700 1 -- start start 2023-10-06T04:39:55.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.114+0000 7f86d5608700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86d006d3b0 0x7f86d009d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.114+0000 7f86d5608700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d00b11a0 0x7f86d00c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.114+0000 7f86d5608700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86d00b3810 0x7f86d00c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.114+0000 7f86d5608700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d00c5e40 con 0x7f86d00b11a0 2023-10-06T04:39:55.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.114+0000 7f86d5608700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d00c6c60 con 0x7f86d00b3810 2023-10-06T04:39:55.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.114+0000 7f86d5608700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d00c6050 con 0x7f86d006d3b0 2023-10-06T04:39:55.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.114+0000 7f86cf7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d00b11a0 0x7f86d00c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.114+0000 7f86cf7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d00b11a0 0x7f86d00c5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34596/0 (socket says 172.21.15.112:34596) 2023-10-06T04:39:55.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.114+0000 7f86cf7fe700 1 -- 172.21.15.112:0/247051776 learned_addr learned my addr 172.21.15.112:0/247051776 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:55.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.115+0000 7f86cffff700 1 --2- 172.21.15.112:0/247051776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86d006d3b0 0x7f86d009d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.115+0000 7f86d4e07700 1 --2- 172.21.15.112:0/247051776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86d00b3810 0x7f86d00c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.115+0000 7f86cf7fe700 1 -- 172.21.15.112:0/247051776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86d006d3b0 msgr2=0x7f86d009d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.115+0000 7f86cf7fe700 1 --2- 172.21.15.112:0/247051776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86d006d3b0 0x7f86d009d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.115+0000 7f86cf7fe700 1 -- 172.21.15.112:0/247051776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86d00b3810 msgr2=0x7f86d00c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.115+0000 7f86cf7fe700 1 --2- 172.21.15.112:0/247051776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86d00b3810 0x7f86d00c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.115+0000 7f86cf7fe700 1 -- 172.21.15.112:0/247051776 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c8009ae0 con 0x7f86d00b11a0 2023-10-06T04:39:55.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.115+0000 7f86d4e07700 1 --2- 172.21.15.112:0/247051776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86d00b3810 0x7f86d00c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:55.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.115+0000 7f86cf7fe700 1 --2- 172.21.15.112:0/247051776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d00b11a0 0x7f86d00c5900 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f86c400e950 tx=0x7f86c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:55.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.115+0000 7f86b7fff700 1 -- 172.21.15.112:0/247051776 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c400c850 con 0x7f86d00b11a0 2023-10-06T04:39:55.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.115+0000 7f86b7fff700 1 -- 172.21.15.112:0/247051776 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c400c9b0 con 0x7f86d00b11a0 2023-10-06T04:39:55.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.115+0000 7f86d5608700 1 -- 172.21.15.112:0/247051776 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d00c6330 con 0x7f86d00b11a0 2023-10-06T04:39:55.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.115+0000 7f86b7fff700 1 -- 172.21.15.112:0/247051776 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c400cdb0 con 0x7f86d00b11a0 2023-10-06T04:39:55.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.115+0000 7f86d5608700 1 -- 172.21.15.112:0/247051776 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d00c68f0 con 0x7f86d00b11a0 2023-10-06T04:39:55.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.116+0000 7f86d5608700 1 -- 172.21.15.112:0/247051776 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d00c6dd0 con 0x7f86d00b11a0 2023-10-06T04:39:55.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.116+0000 7f86b7fff700 1 -- 172.21.15.112:0/247051776 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f86c4013680 con 0x7f86d00b11a0 2023-10-06T04:39:55.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.117+0000 7f86b7fff700 1 --2- 172.21.15.112:0/247051776 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f86bc066f30 0x7f86bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.117+0000 7f86b7fff700 1 -- 172.21.15.112:0/247051776 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f86c40848c0 con 0x7f86d00b11a0 2023-10-06T04:39:55.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.117+0000 7f86cffff700 1 --2- 172.21.15.112:0/247051776 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f86bc066f30 0x7f86bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.117+0000 7f86cffff700 1 --2- 172.21.15.112:0/247051776 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f86bc066f30 0x7f86bc0693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009ca0 tx=0x7f86c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:55.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.121+0000 7f86b7fff700 1 -- 172.21.15.112:0/247051776 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86c40519d0 con 0x7f86d00b11a0 2023-10-06T04:39:55.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.307+0000 7f86d5608700 1 -- 172.21.15.112:0/247051776 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86d005f230 con 0x7f86d00b11a0 2023-10-06T04:39:55.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.307+0000 7f86b7fff700 1 -- 172.21.15.112:0/247051776 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f86c4054ff0 con 0x7f86d00b11a0 2023-10-06T04:39:55.310 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:39:55.310 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:39:22.637355+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:39:18.657040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:39:19.972295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:39:55.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.309+0000 7f86d5608700 1 -- 172.21.15.112:0/247051776 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f86bc066f30 msgr2=0x7f86bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.309+0000 7f86d5608700 1 --2- 172.21.15.112:0/247051776 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f86bc066f30 0x7f86bc0693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009ca0 tx=0x7f86c0008040 comp rx=0 tx=0).stop 2023-10-06T04:39:55.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.309+0000 7f86d5608700 1 -- 172.21.15.112:0/247051776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d00b11a0 msgr2=0x7f86d00c5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.309+0000 7f86d5608700 1 --2- 172.21.15.112:0/247051776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d00b11a0 0x7f86d00c5900 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f86c400e950 tx=0x7f86c40091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.309+0000 7f86d5608700 1 -- 172.21.15.112:0/247051776 shutdown_connections 2023-10-06T04:39:55.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.309+0000 7f86d5608700 1 --2- 172.21.15.112:0/247051776 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f86bc066f30 0x7f86bc0693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.309+0000 7f86d5608700 1 --2- 172.21.15.112:0/247051776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86d00b3810 0x7f86d00c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.309+0000 7f86d5608700 1 --2- 172.21.15.112:0/247051776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86d006d3b0 0x7f86d009d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.309+0000 7f86d5608700 1 --2- 172.21.15.112:0/247051776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86d00b11a0 0x7f86d00c5900 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.309+0000 7f86d5608700 1 -- 172.21.15.112:0/247051776 >> 172.21.15.112:0/247051776 conn(0x7f86d006cfb0 msgr2=0x7f86d006e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:55.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.310+0000 7f86d5608700 1 -- 172.21.15.112:0/247051776 shutdown_connections 2023-10-06T04:39:55.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.310+0000 7f86d5608700 1 -- 172.21.15.112:0/247051776 wait complete. 2023-10-06T04:39:55.324 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T04:39:55.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.436+0000 7f0888138700 1 Processor -- start 2023-10-06T04:39:55.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.437+0000 7f0888138700 1 -- start start 2023-10-06T04:39:55.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.437+0000 7f0888138700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08800ce590 0x7f08800af830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.437+0000 7f0888138700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f08800d13c0 0x7f0880159460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.437+0000 7f0888138700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f08800ce960 0x7f08801599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.437+0000 7f0888138700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08800aff30 con 0x7f08800ce960 2023-10-06T04:39:55.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.437+0000 7f0888138700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0880159ee0 con 0x7f08800d13c0 2023-10-06T04:39:55.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.437+0000 7f0888138700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08800cfa90 con 0x7f08800ce590 2023-10-06T04:39:55.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.437+0000 7f08866d5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f08800ce960 0x7f08801599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.437+0000 7f08866d5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f08800ce960 0x7f08801599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34600/0 (socket says 172.21.15.112:34600) 2023-10-06T04:39:55.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.437+0000 7f08866d5700 1 -- 172.21.15.112:0/3416905305 learned_addr learned my addr 172.21.15.112:0/3416905305 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:55.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.438+0000 7f0885ed4700 1 --2- 172.21.15.112:0/3416905305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08800ce590 0x7f08800af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.438+0000 7f08856d3700 1 --2- 172.21.15.112:0/3416905305 >> v2:172.21.15.179:3300/0 conn(0x7f08800d13c0 0x7f0880159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.438+0000 7f08866d5700 1 -- 172.21.15.112:0/3416905305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08800ce590 msgr2=0x7f08800af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:55.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.438+0000 7f08866d5700 1 --2- 172.21.15.112:0/3416905305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08800ce590 0x7f08800af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.438+0000 7f08866d5700 1 -- 172.21.15.112:0/3416905305 >> v2:172.21.15.179:3300/0 conn(0x7f08800d13c0 msgr2=0x7f0880159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:55.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.438+0000 7f08866d5700 1 --2- 172.21.15.112:0/3416905305 >> v2:172.21.15.179:3300/0 conn(0x7f08800d13c0 0x7f0880159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.438+0000 7f08866d5700 1 -- 172.21.15.112:0/3416905305 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08800cc800 con 0x7f08800ce960 2023-10-06T04:39:55.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.438+0000 7f08866d5700 1 --2- 172.21.15.112:0/3416905305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08800ce960 0x7f08801599a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f08800719c0 tx=0x7f0878009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5ffe1146c3bc8d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:55.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.438+0000 7f0884ed2700 1 -- 172.21.15.112:0/3416905305 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087800e070 con 0x7f08800ce960 2023-10-06T04:39:55.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.438+0000 7f0884ed2700 1 -- 172.21.15.112:0/3416905305 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087800b970 con 0x7f08800ce960 2023-10-06T04:39:55.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.438+0000 7f0884ed2700 1 -- 172.21.15.112:0/3416905305 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08780092e0 con 0x7f08800ce960 2023-10-06T04:39:55.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.439+0000 7f0888138700 1 -- 172.21.15.112:0/3416905305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08800ce960 msgr2=0x7f08801599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.439+0000 7f0888138700 1 --2- 172.21.15.112:0/3416905305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08800ce960 0x7f08801599a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f08800719c0 tx=0x7f0878009840 comp rx=0 tx=0).stop 2023-10-06T04:39:55.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.439+0000 7f0888138700 1 -- 172.21.15.112:0/3416905305 shutdown_connections 2023-10-06T04:39:55.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.439+0000 7f0888138700 1 --2- 172.21.15.112:0/3416905305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08800ce590 0x7f08800af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.439+0000 7f0888138700 1 --2- 172.21.15.112:0/3416905305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08800ce960 0x7f08801599a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.439+0000 7f0888138700 1 --2- 172.21.15.112:0/3416905305 >> v2:172.21.15.179:3300/0 conn(0x7f08800d13c0 0x7f0880159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.439+0000 7f0888138700 1 -- 172.21.15.112:0/3416905305 >> 172.21.15.112:0/3416905305 conn(0x7f088006cfb0 msgr2=0x7f08800d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:55.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.439+0000 7f0888138700 1 -- 172.21.15.112:0/3416905305 shutdown_connections 2023-10-06T04:39:55.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.439+0000 7f0888138700 1 -- 172.21.15.112:0/3416905305 wait complete. 2023-10-06T04:39:55.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.440+0000 7f0888138700 1 Processor -- start 2023-10-06T04:39:55.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.440+0000 7f0888138700 1 -- start start 2023-10-06T04:39:55.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.440+0000 7f0888138700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08800ce590 0x7f0880154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.440+0000 7f0888138700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08800ce960 0x7f08800b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.440+0000 7f0888138700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08800d13c0 0x7f08800ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.440+0000 7f0888138700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0880154cd0 con 0x7f08800ce960 2023-10-06T04:39:55.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.440+0000 7f0888138700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08800b45e0 con 0x7f08800ce590 2023-10-06T04:39:55.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.440+0000 7f0888138700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08800b48c0 con 0x7f08800d13c0 2023-10-06T04:39:55.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.441+0000 7f08856d3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08800ce960 0x7f08800b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.441+0000 7f08856d3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08800ce960 0x7f08800b14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34604/0 (socket says 172.21.15.112:34604) 2023-10-06T04:39:55.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.441+0000 7f08856d3700 1 -- 172.21.15.112:0/2874642525 learned_addr learned my addr 172.21.15.112:0/2874642525 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:55.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.441+0000 7f0885ed4700 1 --2- 172.21.15.112:0/2874642525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08800ce590 0x7f0880154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.441+0000 7f08866d5700 1 --2- 172.21.15.112:0/2874642525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08800d13c0 0x7f08800ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.441+0000 7f08856d3700 1 -- 172.21.15.112:0/2874642525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08800d13c0 msgr2=0x7f08800ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.441+0000 7f08856d3700 1 --2- 172.21.15.112:0/2874642525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08800d13c0 0x7f08800ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.441+0000 7f08856d3700 1 -- 172.21.15.112:0/2874642525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08800ce590 msgr2=0x7f0880154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.441+0000 7f08856d3700 1 --2- 172.21.15.112:0/2874642525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08800ce590 0x7f0880154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.441+0000 7f08856d3700 1 -- 172.21.15.112:0/2874642525 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0878009ae0 con 0x7f08800ce960 2023-10-06T04:39:55.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.441+0000 7f08856d3700 1 --2- 172.21.15.112:0/2874642525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08800ce960 0x7f08800b14b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f087000e930 tx=0x7f08700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:55.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.441+0000 7f0875ffb700 1 -- 172.21.15.112:0/2874642525 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870013680 con 0x7f08800ce960 2023-10-06T04:39:55.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.441+0000 7f0875ffb700 1 -- 172.21.15.112:0/2874642525 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08700137e0 con 0x7f08800ce960 2023-10-06T04:39:55.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.441+0000 7f0875ffb700 1 -- 172.21.15.112:0/2874642525 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870013b80 con 0x7f08800ce960 2023-10-06T04:39:55.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.441+0000 7f0888138700 1 -- 172.21.15.112:0/2874642525 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08800b4ba0 con 0x7f08800ce960 2023-10-06T04:39:55.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.441+0000 7f0888138700 1 -- 172.21.15.112:0/2874642525 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08800b5160 con 0x7f08800ce960 2023-10-06T04:39:55.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.442+0000 7f0888138700 1 -- 172.21.15.112:0/2874642525 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088005f230 con 0x7f08800ce960 2023-10-06T04:39:55.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.443+0000 7f0875ffb700 1 -- 172.21.15.112:0/2874642525 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f087000c3e0 con 0x7f08800ce960 2023-10-06T04:39:55.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.443+0000 7f0875ffb700 1 --2- 172.21.15.112:0/2874642525 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0864066f30 0x7f08640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.443+0000 7f0875ffb700 1 -- 172.21.15.112:0/2874642525 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0870084700 con 0x7f08800ce960 2023-10-06T04:39:55.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.443+0000 7f0885ed4700 1 --2- 172.21.15.112:0/2874642525 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0864066f30 0x7f08640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.444+0000 7f0885ed4700 1 --2- 172.21.15.112:0/2874642525 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0864066f30 0x7f08640693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f087c009da0 tx=0x7f087c009120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:55.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.447+0000 7f0875ffb700 1 -- 172.21.15.112:0/2874642525 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0870051810 con 0x7f08800ce960 2023-10-06T04:39:55.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.673+0000 7f0888138700 1 -- 172.21.15.112:0/2874642525 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f088006d5c0 con 0x7f08800ce960 2023-10-06T04:39:55.676 INFO:tasks.ceph.mon.a.smithi112.stderr:2023-10-06T04:39:55.674+0000 7f1d6056f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T04:39:55.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.678+0000 7f0875ffb700 1 -- 172.21.15.112:0/2874642525 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0870054e30 con 0x7f08800ce960 2023-10-06T04:39:55.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.680+0000 7f0888138700 1 -- 172.21.15.112:0/2874642525 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0864066f30 msgr2=0x7f08640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.680+0000 7f0888138700 1 --2- 172.21.15.112:0/2874642525 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0864066f30 0x7f08640693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f087c009da0 tx=0x7f087c009120 comp rx=0 tx=0).stop 2023-10-06T04:39:55.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.680+0000 7f0888138700 1 -- 172.21.15.112:0/2874642525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08800ce960 msgr2=0x7f08800b14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.680+0000 7f0888138700 1 --2- 172.21.15.112:0/2874642525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08800ce960 0x7f08800b14b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f087000e930 tx=0x7f08700091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.680+0000 7f0888138700 1 -- 172.21.15.112:0/2874642525 shutdown_connections 2023-10-06T04:39:55.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.680+0000 7f0888138700 1 --2- 172.21.15.112:0/2874642525 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f0864066f30 0x7f08640693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.680+0000 7f0888138700 1 --2- 172.21.15.112:0/2874642525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08800d13c0 0x7f08800ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.680+0000 7f0888138700 1 --2- 172.21.15.112:0/2874642525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08800ce590 0x7f0880154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.680+0000 7f0888138700 1 --2- 172.21.15.112:0/2874642525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08800ce960 0x7f08800b14b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.680+0000 7f0888138700 1 -- 172.21.15.112:0/2874642525 >> 172.21.15.112:0/2874642525 conn(0x7f088006cfb0 msgr2=0x7f088006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:55.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.680+0000 7f0888138700 1 -- 172.21.15.112:0/2874642525 shutdown_connections 2023-10-06T04:39:55.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.680+0000 7f0888138700 1 -- 172.21.15.112:0/2874642525 wait complete. 2023-10-06T04:39:55.685 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T04:39:55.686 INFO:tasks.ceph.mds.d.smithi179.stderr: -1705> 2023-10-06T04:39:25.705+0000 7f4d9410b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:39:55.695 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T04:39:55.707 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-06T04:39:55.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.810+0000 7fbef0b66700 1 Processor -- start 2023-10-06T04:39:55.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.810+0000 7fbef0b66700 1 -- start start 2023-10-06T04:39:55.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.811+0000 7fbef0b66700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbeec142f90 0x7fbeec0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.811+0000 7fbef0b66700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeec06e1f0 0x7fbeec0b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.811+0000 7fbef0b66700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeec0cce70 con 0x7fbeec143360 2023-10-06T04:39:55.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.811+0000 7fbef0b66700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeec0b1780 con 0x7fbeec142f90 2023-10-06T04:39:55.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.811+0000 7fbef0b66700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec0b0b70 con 0x7fbeec06e1f0 2023-10-06T04:39:55.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.811+0000 7fbeeb7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbeec142f90 0x7fbeec0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.811+0000 7fbeeb7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbeec142f90 0x7fbeec0b4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34606/0 (socket says 172.21.15.112:34606) 2023-10-06T04:39:55.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.811+0000 7fbeeb7fe700 1 -- 172.21.15.112:0/2229619931 learned_addr learned my addr 172.21.15.112:0/2229619931 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:55.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.811+0000 7fbeeb7fe700 1 -- 172.21.15.112:0/2229619931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeec06e1f0 msgr2=0x7fbeec0b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:55.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.811+0000 7fbeebfff700 1 --2- 172.21.15.112:0/2229619931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeec06e1f0 0x7fbeec0b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.811+0000 7fbeeb7fe700 1 --2- 172.21.15.112:0/2229619931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeec06e1f0 0x7fbeec0b5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.811+0000 7fbeeb7fe700 1 -- 172.21.15.112:0/2229619931 >> v1:172.21.15.179:6789/0 conn(0x7fbeec143360 legacy=0x7fbeec06dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:55.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.811+0000 7fbeeb7fe700 1 -- 172.21.15.112:0/2229619931 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeec0b0e50 con 0x7fbeec142f90 2023-10-06T04:39:55.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.811+0000 7fbeeb7fe700 1 --2- 172.21.15.112:0/2229619931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbeec142f90 0x7fbeec0b4cf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbedc009990 tx=0x7fbedc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719abd05857630dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:55.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.811+0000 7fbeeaffd700 1 -- 172.21.15.112:0/2229619931 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc005c10 con 0x7fbeec142f90 2023-10-06T04:39:55.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.811+0000 7fbeeaffd700 1 -- 172.21.15.112:0/2229619931 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbedc005d70 con 0x7fbeec142f90 2023-10-06T04:39:55.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.811+0000 7fbeeaffd700 1 -- 172.21.15.112:0/2229619931 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc00b840 con 0x7fbeec142f90 2023-10-06T04:39:55.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.812+0000 7fbef0b66700 1 -- 172.21.15.112:0/2229619931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbeec142f90 msgr2=0x7fbeec0b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.812+0000 7fbef0b66700 1 --2- 172.21.15.112:0/2229619931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbeec142f90 0x7fbeec0b4cf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbedc009990 tx=0x7fbedc009220 comp rx=0 tx=0).stop 2023-10-06T04:39:55.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.812+0000 7fbef0b66700 1 -- 172.21.15.112:0/2229619931 shutdown_connections 2023-10-06T04:39:55.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.812+0000 7fbef0b66700 1 --2- 172.21.15.112:0/2229619931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeec06e1f0 0x7fbeec0b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.812+0000 7fbef0b66700 1 --2- 172.21.15.112:0/2229619931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbeec142f90 0x7fbeec0b4cf0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.812+0000 7fbef0b66700 1 -- 172.21.15.112:0/2229619931 >> 172.21.15.112:0/2229619931 conn(0x7fbeec06c7d0 msgr2=0x7fbeec06cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:55.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.812+0000 7fbef0b66700 1 -- 172.21.15.112:0/2229619931 shutdown_connections 2023-10-06T04:39:55.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.812+0000 7fbef0b66700 1 -- 172.21.15.112:0/2229619931 wait complete. 2023-10-06T04:39:55.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.813+0000 7fbef0b66700 1 Processor -- start 2023-10-06T04:39:55.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.813+0000 7fbef0b66700 1 -- start start 2023-10-06T04:39:55.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.814+0000 7fbef0b66700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeec06e1f0 0x7fbeec135ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.814+0000 7fbef0b66700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbeec142f90 0x7fbeec0cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.814+0000 7fbef0b66700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbeec143360 0x7fbeec15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.814+0000 7fbef0b66700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec0c7770 con 0x7fbeec142f90 2023-10-06T04:39:55.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.814+0000 7fbef0b66700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec0c6870 con 0x7fbeec143360 2023-10-06T04:39:55.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.814+0000 7fbef0b66700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec0c6b50 con 0x7fbeec06e1f0 2023-10-06T04:39:55.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.814+0000 7fbee2ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbeec142f90 0x7fbeec0cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.814+0000 7fbee2ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbeec142f90 0x7fbeec0cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34608/0 (socket says 172.21.15.112:34608) 2023-10-06T04:39:55.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.814+0000 7fbee2ffd700 1 -- 172.21.15.112:0/3773661879 learned_addr learned my addr 172.21.15.112:0/3773661879 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:55.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.814+0000 7fbeebfff700 1 --2- 172.21.15.112:0/3773661879 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbeec143360 0x7fbeec15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.814+0000 7fbeeb7fe700 1 --2- 172.21.15.112:0/3773661879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeec06e1f0 0x7fbeec135ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.814+0000 7fbee2ffd700 1 -- 172.21.15.112:0/3773661879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeec06e1f0 msgr2=0x7fbeec135ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.814+0000 7fbee2ffd700 1 --2- 172.21.15.112:0/3773661879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeec06e1f0 0x7fbeec135ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.814+0000 7fbee2ffd700 1 -- 172.21.15.112:0/3773661879 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbeec143360 msgr2=0x7fbeec15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:55.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.814+0000 7fbee2ffd700 1 --2- 172.21.15.112:0/3773661879 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbeec143360 0x7fbeec15d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:55.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.814+0000 7fbee2ffd700 1 -- 172.21.15.112:0/3773661879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc009480 con 0x7fbeec142f90 2023-10-06T04:39:55.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.814+0000 7fbee2ffd700 1 --2- 172.21.15.112:0/3773661879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbeec142f90 0x7fbeec0cc580 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbed400b5e0 tx=0x7fbed4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:55.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.814+0000 7fbee3fff700 1 -- 172.21.15.112:0/3773661879 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed400f510 con 0x7fbeec142f90 2023-10-06T04:39:55.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.815+0000 7fbee3fff700 1 -- 172.21.15.112:0/3773661879 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed400f670 con 0x7fbeec142f90 2023-10-06T04:39:55.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.815+0000 7fbef0b66700 1 -- 172.21.15.112:0/3773661879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeec0c6e30 con 0x7fbeec142f90 2023-10-06T04:39:55.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.815+0000 7fbee3fff700 1 -- 172.21.15.112:0/3773661879 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed400fa30 con 0x7fbeec142f90 2023-10-06T04:39:55.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.815+0000 7fbef0b66700 1 -- 172.21.15.112:0/3773661879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeec1363e0 con 0x7fbeec142f90 2023-10-06T04:39:55.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.815+0000 7fbef0b66700 1 -- 172.21.15.112:0/3773661879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeec05f230 con 0x7fbeec142f90 2023-10-06T04:39:55.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.817+0000 7fbee3fff700 1 -- 172.21.15.112:0/3773661879 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbed4024430 con 0x7fbeec142f90 2023-10-06T04:39:55.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.817+0000 7fbee3fff700 1 --2- 172.21.15.112:0/3773661879 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fbecc066f30 0x7fbecc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:55.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.817+0000 7fbee3fff700 1 -- 172.21.15.112:0/3773661879 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fbed4084c00 con 0x7fbeec142f90 2023-10-06T04:39:55.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.817+0000 7fbeeb7fe700 1 --2- 172.21.15.112:0/3773661879 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fbecc066f30 0x7fbecc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:55.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.818+0000 7fbeeb7fe700 1 --2- 172.21.15.112:0/3773661879 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fbecc066f30 0x7fbecc0693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbedc003080 tx=0x7fbedc015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:55.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:55.821+0000 7fbee3fff700 1 -- 172.21.15.112:0/3773661879 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbed4051d40 con 0x7fbeec142f90 2023-10-06T04:39:56.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.047+0000 7fbef0b66700 1 -- 172.21.15.112:0/3773661879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbeec0b1130 con 0x7fbeec142f90 2023-10-06T04:39:56.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.679+0000 7fbee3fff700 1 -- 172.21.15.112:0/3773661879 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbed4055360 con 0x7fbeec142f90 2023-10-06T04:39:56.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.681+0000 7fbef0b66700 1 -- 172.21.15.112:0/3773661879 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fbecc066f30 msgr2=0x7fbecc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.681+0000 7fbef0b66700 1 --2- 172.21.15.112:0/3773661879 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fbecc066f30 0x7fbecc0693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbedc003080 tx=0x7fbedc015000 comp rx=0 tx=0).stop 2023-10-06T04:39:56.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.681+0000 7fbef0b66700 1 -- 172.21.15.112:0/3773661879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbeec142f90 msgr2=0x7fbeec0cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.681+0000 7fbef0b66700 1 --2- 172.21.15.112:0/3773661879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbeec142f90 0x7fbeec0cc580 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbed400b5e0 tx=0x7fbed4009120 comp rx=0 tx=0).stop 2023-10-06T04:39:56.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.681+0000 7fbef0b66700 1 -- 172.21.15.112:0/3773661879 shutdown_connections 2023-10-06T04:39:56.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.681+0000 7fbef0b66700 1 --2- 172.21.15.112:0/3773661879 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fbecc066f30 0x7fbecc0693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.681+0000 7fbef0b66700 1 --2- 172.21.15.112:0/3773661879 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbeec143360 0x7fbeec15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.681+0000 7fbef0b66700 1 --2- 172.21.15.112:0/3773661879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeec06e1f0 0x7fbeec135ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.681+0000 7fbef0b66700 1 --2- 172.21.15.112:0/3773661879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbeec142f90 0x7fbeec0cc580 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.682+0000 7fbef0b66700 1 -- 172.21.15.112:0/3773661879 >> 172.21.15.112:0/3773661879 conn(0x7fbeec06c7d0 msgr2=0x7fbeec15e860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:56.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.682+0000 7fbef0b66700 1 -- 172.21.15.112:0/3773661879 shutdown_connections 2023-10-06T04:39:56.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.682+0000 7fbef0b66700 1 -- 172.21.15.112:0/3773661879 wait complete. 2023-10-06T04:39:56.697 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T04:39:56.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.816+0000 7f5bcf048700 1 Processor -- start 2023-10-06T04:39:56.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.816+0000 7f5bcf048700 1 -- start start 2023-10-06T04:39:56.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.817+0000 7f5bcf048700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bc8159a20 0x7f5bc80cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.817+0000 7f5bcf048700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5bc806d3b0 0x7f5bc80cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.817+0000 7f5bcf048700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5bc815a9f0 0x7f5bc815d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.817+0000 7f5bcf048700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc80cca70 con 0x7f5bc815a9f0 2023-10-06T04:39:56.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.817+0000 7f5bcf048700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc808a080 con 0x7f5bc806d3b0 2023-10-06T04:39:56.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.817+0000 7f5bcf048700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc815af50 con 0x7f5bc8159a20 2023-10-06T04:39:56.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.817+0000 7f5bcd5e5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5bc815a9f0 0x7f5bc815d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.817+0000 7f5bcd5e5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5bc815a9f0 0x7f5bc815d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34616/0 (socket says 172.21.15.112:34616) 2023-10-06T04:39:56.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.817+0000 7f5bcd5e5700 1 -- 172.21.15.112:0/1961941665 learned_addr learned my addr 172.21.15.112:0/1961941665 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:56.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.817+0000 7f5bccde4700 1 --2- 172.21.15.112:0/1961941665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bc8159a20 0x7f5bc80cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.817+0000 7f5bbffff700 1 --2- 172.21.15.112:0/1961941665 >> v2:172.21.15.179:3300/0 conn(0x7f5bc806d3b0 0x7f5bc80cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.817+0000 7f5bcd5e5700 1 -- 172.21.15.112:0/1961941665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bc8159a20 msgr2=0x7f5bc80cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:56.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.817+0000 7f5bcd5e5700 1 --2- 172.21.15.112:0/1961941665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bc8159a20 0x7f5bc80cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.817+0000 7f5bcd5e5700 1 -- 172.21.15.112:0/1961941665 >> v2:172.21.15.179:3300/0 conn(0x7f5bc806d3b0 msgr2=0x7f5bc80cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:56.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.817+0000 7f5bcd5e5700 1 --2- 172.21.15.112:0/1961941665 >> v2:172.21.15.179:3300/0 conn(0x7f5bc806d3b0 0x7f5bc80cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.817+0000 7f5bcd5e5700 1 -- 172.21.15.112:0/1961941665 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc80cae50 con 0x7f5bc815a9f0 2023-10-06T04:39:56.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.818+0000 7f5bcd5e5700 1 --2- 172.21.15.112:0/1961941665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bc815a9f0 0x7f5bc815d550 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5bc8089430 tx=0x7f5bc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58548312c7afa32 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:56.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.818+0000 7f5bbf7fe700 1 -- 172.21.15.112:0/1961941665 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc000b640 con 0x7f5bc815a9f0 2023-10-06T04:39:56.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.818+0000 7f5bbf7fe700 1 -- 172.21.15.112:0/1961941665 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc000b7a0 con 0x7f5bc815a9f0 2023-10-06T04:39:56.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.818+0000 7f5bbf7fe700 1 -- 172.21.15.112:0/1961941665 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc000bb40 con 0x7f5bc815a9f0 2023-10-06T04:39:56.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.818+0000 7f5bcf048700 1 -- 172.21.15.112:0/1961941665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bc815a9f0 msgr2=0x7f5bc815d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.818+0000 7f5bcf048700 1 --2- 172.21.15.112:0/1961941665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bc815a9f0 0x7f5bc815d550 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5bc8089430 tx=0x7f5bc0009250 comp rx=0 tx=0).stop 2023-10-06T04:39:56.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.818+0000 7f5bcf048700 1 -- 172.21.15.112:0/1961941665 shutdown_connections 2023-10-06T04:39:56.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.818+0000 7f5bcf048700 1 --2- 172.21.15.112:0/1961941665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bc8159a20 0x7f5bc80cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.818+0000 7f5bcf048700 1 --2- 172.21.15.112:0/1961941665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bc815a9f0 0x7f5bc815d550 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.818+0000 7f5bcf048700 1 --2- 172.21.15.112:0/1961941665 >> v2:172.21.15.179:3300/0 conn(0x7f5bc806d3b0 0x7f5bc80cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.818+0000 7f5bcf048700 1 -- 172.21.15.112:0/1961941665 >> 172.21.15.112:0/1961941665 conn(0x7f5bc806cfb0 msgr2=0x7f5bc80d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:56.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.818+0000 7f5bcf048700 1 -- 172.21.15.112:0/1961941665 shutdown_connections 2023-10-06T04:39:56.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.818+0000 7f5bcf048700 1 -- 172.21.15.112:0/1961941665 wait complete. 2023-10-06T04:39:56.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.819+0000 7f5bcf048700 1 Processor -- start 2023-10-06T04:39:56.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.820+0000 7f5bcf048700 1 -- start start 2023-10-06T04:39:56.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.820+0000 7f5bcf048700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bc806d3b0 0x7f5bc8152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.820+0000 7f5bcf048700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bc8159a20 0x7f5bc806db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.820+0000 7f5bcf048700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bc815a9f0 0x7f5bc806e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.820+0000 7f5bcf048700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc815cd40 con 0x7f5bc815a9f0 2023-10-06T04:39:56.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.820+0000 7f5bcf048700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc80b4ef0 con 0x7f5bc806d3b0 2023-10-06T04:39:56.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.820+0000 7f5bcf048700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc815c4a0 con 0x7f5bc8159a20 2023-10-06T04:39:56.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.820+0000 7f5bcd5e5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bc815a9f0 0x7f5bc806e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.820+0000 7f5bcd5e5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bc815a9f0 0x7f5bc806e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34618/0 (socket says 172.21.15.112:34618) 2023-10-06T04:39:56.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.820+0000 7f5bcd5e5700 1 -- 172.21.15.112:0/3480958663 learned_addr learned my addr 172.21.15.112:0/3480958663 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:56.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.821+0000 7f5bccde4700 1 --2- 172.21.15.112:0/3480958663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bc806d3b0 0x7f5bc8152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.821+0000 7f5bbffff700 1 --2- 172.21.15.112:0/3480958663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bc8159a20 0x7f5bc806db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.821+0000 7f5bcd5e5700 1 -- 172.21.15.112:0/3480958663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bc8159a20 msgr2=0x7f5bc806db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.821+0000 7f5bcd5e5700 1 --2- 172.21.15.112:0/3480958663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bc8159a20 0x7f5bc806db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.821+0000 7f5bcd5e5700 1 -- 172.21.15.112:0/3480958663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bc806d3b0 msgr2=0x7f5bc8152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:56.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.821+0000 7f5bcd5e5700 1 --2- 172.21.15.112:0/3480958663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bc806d3b0 0x7f5bc8152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:56.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.821+0000 7f5bcd5e5700 1 -- 172.21.15.112:0/3480958663 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc00094f0 con 0x7f5bc815a9f0 2023-10-06T04:39:56.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.821+0000 7f5bbffff700 1 --2- 172.21.15.112:0/3480958663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bc8159a20 0x7f5bc806db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:56.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.821+0000 7f5bccde4700 1 --2- 172.21.15.112:0/3480958663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bc806d3b0 0x7f5bc8152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:56.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.821+0000 7f5bcd5e5700 1 --2- 172.21.15.112:0/3480958663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bc815a9f0 0x7f5bc806e040 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00099b0 tx=0x7f5bc0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:56.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.821+0000 7f5bbcff9700 1 -- 172.21.15.112:0/3480958663 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0025440 con 0x7f5bc815a9f0 2023-10-06T04:39:56.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.821+0000 7f5bbcff9700 1 -- 172.21.15.112:0/3480958663 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc00255c0 con 0x7f5bc815a9f0 2023-10-06T04:39:56.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.821+0000 7f5bcf048700 1 -- 172.21.15.112:0/3480958663 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc815c780 con 0x7f5bc815a9f0 2023-10-06T04:39:56.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.821+0000 7f5bbcff9700 1 -- 172.21.15.112:0/3480958663 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0025980 con 0x7f5bc815a9f0 2023-10-06T04:39:56.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.821+0000 7f5bcf048700 1 -- 172.21.15.112:0/3480958663 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc8152870 con 0x7f5bc815a9f0 2023-10-06T04:39:56.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.822+0000 7f5bbcff9700 1 -- 172.21.15.112:0/3480958663 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5bc0011420 con 0x7f5bc815a9f0 2023-10-06T04:39:56.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.822+0000 7f5bcf048700 1 -- 172.21.15.112:0/3480958663 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc80b4cc0 con 0x7f5bc815a9f0 2023-10-06T04:39:56.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.823+0000 7f5bbcff9700 1 --2- 172.21.15.112:0/3480958663 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5bb4066f30 0x7f5bb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:56.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.823+0000 7f5bbcff9700 1 -- 172.21.15.112:0/3480958663 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f5bc00869c0 con 0x7f5bc815a9f0 2023-10-06T04:39:56.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.823+0000 7f5bccde4700 1 --2- 172.21.15.112:0/3480958663 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5bb4066f30 0x7f5bb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:56.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.823+0000 7f5bccde4700 1 --2- 172.21.15.112:0/3480958663 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5bb4066f30 0x7f5bb40693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4007780 tx=0x7f5bc400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:56.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:56.827+0000 7f5bbcff9700 1 -- 172.21.15.112:0/3480958663 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5bc80b4cc0 con 0x7f5bc815a9f0 2023-10-06T04:39:56.944 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:39:56.947 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:39:57.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.012+0000 7f5bcf048700 1 -- 172.21.15.112:0/3480958663 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5bc80b4cc0 con 0x7f5bc815a9f0 2023-10-06T04:39:57.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.807+0000 7f5bbcff9700 1 -- 172.21.15.112:0/3480958663 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5bc80b4cc0 con 0x7f5bc815a9f0 2023-10-06T04:39:57.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.810+0000 7f5bcf048700 1 -- 172.21.15.112:0/3480958663 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5bb4066f30 msgr2=0x7f5bb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.810+0000 7f5bcf048700 1 --2- 172.21.15.112:0/3480958663 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5bb4066f30 0x7f5bb40693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4007780 tx=0x7f5bc400b040 comp rx=0 tx=0).stop 2023-10-06T04:39:57.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.810+0000 7f5bcf048700 1 -- 172.21.15.112:0/3480958663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bc815a9f0 msgr2=0x7f5bc806e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.810+0000 7f5bcf048700 1 --2- 172.21.15.112:0/3480958663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bc815a9f0 0x7f5bc806e040 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00099b0 tx=0x7f5bc0017000 comp rx=0 tx=0).stop 2023-10-06T04:39:57.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.810+0000 7f5bcf048700 1 -- 172.21.15.112:0/3480958663 shutdown_connections 2023-10-06T04:39:57.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.810+0000 7f5bcf048700 1 --2- 172.21.15.112:0/3480958663 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5bb4066f30 0x7f5bb40693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.810+0000 7f5bcf048700 1 --2- 172.21.15.112:0/3480958663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bc815a9f0 0x7f5bc806e040 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.810+0000 7f5bcf048700 1 --2- 172.21.15.112:0/3480958663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bc806d3b0 0x7f5bc8152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.810+0000 7f5bcf048700 1 --2- 172.21.15.112:0/3480958663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bc8159a20 0x7f5bc806db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.810+0000 7f5bcf048700 1 -- 172.21.15.112:0/3480958663 >> 172.21.15.112:0/3480958663 conn(0x7f5bc806cfb0 msgr2=0x7f5bc80aed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:57.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.810+0000 7f5bcf048700 1 -- 172.21.15.112:0/3480958663 shutdown_connections 2023-10-06T04:39:57.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.810+0000 7f5bcf048700 1 -- 172.21.15.112:0/3480958663 wait complete. 2023-10-06T04:39:57.814 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2023-10-06T04:39:57.826 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T04:39:57.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.985+0000 7fba85296700 1 Processor -- start 2023-10-06T04:39:57.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.985+0000 7fba85296700 1 -- start start 2023-10-06T04:39:57.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.986+0000 7fba85296700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba80157030 0x7fba800c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.986+0000 7fba85296700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fba800d0a90 0x7fba800cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.986+0000 7fba85296700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba800c5970 con 0x7fba8015d240 2023-10-06T04:39:57.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.986+0000 7fba85296700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba800c6340 con 0x7fba800d0a90 2023-10-06T04:39:57.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.986+0000 7fba85296700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8015dc20 con 0x7fba80157030 2023-10-06T04:39:57.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.986+0000 7fba84a95700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fba800d0a90 0x7fba800cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.986+0000 7fba84a95700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fba800d0a90 0x7fba800cc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34622/0 (socket says 172.21.15.112:34622) 2023-10-06T04:39:57.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.986+0000 7fba84a95700 1 -- 172.21.15.112:0/3471103735 learned_addr learned my addr 172.21.15.112:0/3471103735 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:57.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.986+0000 7fba84a95700 1 -- 172.21.15.112:0/3471103735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba80157030 msgr2=0x7fba800c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:57.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.986+0000 7fba7ffff700 1 --2- 172.21.15.112:0/3471103735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba80157030 0x7fba800c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.986+0000 7fba84a95700 1 --2- 172.21.15.112:0/3471103735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba80157030 0x7fba800c5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.986+0000 7fba84a95700 1 -- 172.21.15.112:0/3471103735 >> v1:172.21.15.179:6789/0 conn(0x7fba8015d240 legacy=0x7fba800d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:57.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.986+0000 7fba84a95700 1 -- 172.21.15.112:0/3471103735 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8015df00 con 0x7fba800d0a90 2023-10-06T04:39:57.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.986+0000 7fba7ffff700 1 --2- 172.21.15.112:0/3471103735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba80157030 0x7fba800c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:57.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.986+0000 7fba84a95700 1 --2- 172.21.15.112:0/3471103735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba800d0a90 0x7fba800cc7e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fba78009f20 tx=0x7fba78009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d051099a2f59faaf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:57.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.987+0000 7fba7effd700 1 -- 172.21.15.112:0/3471103735 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7800e070 con 0x7fba800d0a90 2023-10-06T04:39:57.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.987+0000 7fba7effd700 1 -- 172.21.15.112:0/3471103735 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7800ba40 con 0x7fba800d0a90 2023-10-06T04:39:57.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.987+0000 7fba7effd700 1 -- 172.21.15.112:0/3471103735 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba780092e0 con 0x7fba800d0a90 2023-10-06T04:39:57.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.987+0000 7fba85296700 1 -- 172.21.15.112:0/3471103735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba800d0a90 msgr2=0x7fba800cc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.987+0000 7fba85296700 1 --2- 172.21.15.112:0/3471103735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba800d0a90 0x7fba800cc7e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fba78009f20 tx=0x7fba78009840 comp rx=0 tx=0).stop 2023-10-06T04:39:57.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.987+0000 7fba85296700 1 -- 172.21.15.112:0/3471103735 shutdown_connections 2023-10-06T04:39:57.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.987+0000 7fba85296700 1 --2- 172.21.15.112:0/3471103735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba800d0a90 0x7fba800cc7e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.987+0000 7fba85296700 1 --2- 172.21.15.112:0/3471103735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba80157030 0x7fba800c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.987+0000 7fba85296700 1 -- 172.21.15.112:0/3471103735 >> 172.21.15.112:0/3471103735 conn(0x7fba8006c7d0 msgr2=0x7fba8006cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:57.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.987+0000 7fba85296700 1 -- 172.21.15.112:0/3471103735 shutdown_connections 2023-10-06T04:39:57.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.987+0000 7fba85296700 1 -- 172.21.15.112:0/3471103735 wait complete. 2023-10-06T04:39:57.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.988+0000 7fba85296700 1 Processor -- start 2023-10-06T04:39:57.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.988+0000 7fba85296700 1 -- start start 2023-10-06T04:39:57.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.989+0000 7fba85296700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba800d0a90 0x7fba8016a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.989+0000 7fba85296700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba80157030 0x7fba8014dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.989+0000 7fba85296700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba8015d240 0x7fba8016ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.989+0000 7fba85296700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8016a840 con 0x7fba8015d240 2023-10-06T04:39:57.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.989+0000 7fba85296700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba80169840 con 0x7fba800d0a90 2023-10-06T04:39:57.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.989+0000 7fba85296700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8016d900 con 0x7fba80157030 2023-10-06T04:39:57.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.989+0000 7fba84a95700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba8015d240 0x7fba8016ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.989+0000 7fba84a95700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba8015d240 0x7fba8016ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34626/0 (socket says 172.21.15.112:34626) 2023-10-06T04:39:57.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.989+0000 7fba84a95700 1 -- 172.21.15.112:0/3748217301 learned_addr learned my addr 172.21.15.112:0/3748217301 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:57.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.989+0000 7fba7ffff700 1 --2- 172.21.15.112:0/3748217301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba800d0a90 0x7fba8016a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.989+0000 7fba7f7fe700 1 --2- 172.21.15.112:0/3748217301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba80157030 0x7fba8014dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.989+0000 7fba84a95700 1 -- 172.21.15.112:0/3748217301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba80157030 msgr2=0x7fba8014dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.989+0000 7fba84a95700 1 --2- 172.21.15.112:0/3748217301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba80157030 0x7fba8014dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.989+0000 7fba84a95700 1 -- 172.21.15.112:0/3748217301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba800d0a90 msgr2=0x7fba8016a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:57.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.989+0000 7fba84a95700 1 --2- 172.21.15.112:0/3748217301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba800d0a90 0x7fba8016a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:57.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.989+0000 7fba84a95700 1 -- 172.21.15.112:0/3748217301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba78009ae0 con 0x7fba8015d240 2023-10-06T04:39:57.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.990+0000 7fba84a95700 1 --2- 172.21.15.112:0/3748217301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba8015d240 0x7fba8016ce40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fba78003000 tx=0x7fba78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:57.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.990+0000 7fba67fff700 1 -- 172.21.15.112:0/3748217301 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba780094e0 con 0x7fba8015d240 2023-10-06T04:39:57.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.990+0000 7fba67fff700 1 -- 172.21.15.112:0/3748217301 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba780092e0 con 0x7fba8015d240 2023-10-06T04:39:57.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.990+0000 7fba85296700 1 -- 172.21.15.112:0/3748217301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8016dbe0 con 0x7fba8015d240 2023-10-06T04:39:57.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.990+0000 7fba67fff700 1 -- 172.21.15.112:0/3748217301 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7801e430 con 0x7fba8015d240 2023-10-06T04:39:57.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.990+0000 7fba85296700 1 -- 172.21.15.112:0/3748217301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba80169de0 con 0x7fba8015d240 2023-10-06T04:39:57.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.991+0000 7fba85296700 1 -- 172.21.15.112:0/3748217301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba80169fd0 con 0x7fba8015d240 2023-10-06T04:39:57.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.991+0000 7fba67fff700 1 -- 172.21.15.112:0/3748217301 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba7801e860 con 0x7fba8015d240 2023-10-06T04:39:57.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.991+0000 7fba67fff700 1 --2- 172.21.15.112:0/3748217301 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fba6c066f30 0x7fba6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:57.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.991+0000 7fba67fff700 1 -- 172.21.15.112:0/3748217301 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fba78086030 con 0x7fba8015d240 2023-10-06T04:39:57.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.991+0000 7fba7ffff700 1 --2- 172.21.15.112:0/3748217301 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fba6c066f30 0x7fba6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:57.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.992+0000 7fba7ffff700 1 --2- 172.21.15.112:0/3748217301 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fba6c066f30 0x7fba6c0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fba7000adc0 tx=0x7fba70006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:57.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:57.996+0000 7fba67fff700 1 -- 172.21.15.112:0/3748217301 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba780532a0 con 0x7fba8015d240 2023-10-06T04:39:58.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:58.179+0000 7fba85296700 1 -- 172.21.15.112:0/3748217301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fba8005f230 con 0x7fba8015d240 2023-10-06T04:39:58.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:58.816+0000 7fba67fff700 1 -- 172.21.15.112:0/3748217301 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fba780568c0 con 0x7fba8015d240 2023-10-06T04:39:58.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:58.819+0000 7fba85296700 1 -- 172.21.15.112:0/3748217301 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fba6c066f30 msgr2=0x7fba6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:58.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:58.819+0000 7fba85296700 1 --2- 172.21.15.112:0/3748217301 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fba6c066f30 0x7fba6c0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fba7000adc0 tx=0x7fba70006f90 comp rx=0 tx=0).stop 2023-10-06T04:39:58.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:58.819+0000 7fba85296700 1 -- 172.21.15.112:0/3748217301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba8015d240 msgr2=0x7fba8016ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:58.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:58.819+0000 7fba85296700 1 --2- 172.21.15.112:0/3748217301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba8015d240 0x7fba8016ce40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fba78003000 tx=0x7fba78017000 comp rx=0 tx=0).stop 2023-10-06T04:39:58.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:58.819+0000 7fba85296700 1 -- 172.21.15.112:0/3748217301 shutdown_connections 2023-10-06T04:39:58.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:58.819+0000 7fba85296700 1 --2- 172.21.15.112:0/3748217301 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fba6c066f30 0x7fba6c0693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:58.819+0000 7fba85296700 1 --2- 172.21.15.112:0/3748217301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba8015d240 0x7fba8016ce40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:58.819+0000 7fba85296700 1 --2- 172.21.15.112:0/3748217301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba800d0a90 0x7fba8016a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:58.819+0000 7fba85296700 1 --2- 172.21.15.112:0/3748217301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba80157030 0x7fba8014dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:58.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:58.819+0000 7fba85296700 1 -- 172.21.15.112:0/3748217301 >> 172.21.15.112:0/3748217301 conn(0x7fba8006c7d0 msgr2=0x7fba800ce190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:58.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:58.819+0000 7fba85296700 1 -- 172.21.15.112:0/3748217301 shutdown_connections 2023-10-06T04:39:58.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:58.819+0000 7fba85296700 1 -- 172.21.15.112:0/3748217301 wait complete. 2023-10-06T04:39:58.823 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2023-10-06T04:39:58.836 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T04:39:58.836 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T04:39:58.836 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T04:39:58.836 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:39:58.836 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T04:39:58.836 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T04:39:58.837 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T04:39:58.837 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:39:58.837 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T04:39:58.837 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T04:39:58.837 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T04:39:58.837 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:39:58.838 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T04:39:58.838 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T04:39:58.838 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T04:39:58.838 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:39:58.845 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T04:39:58.845 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T04:39:58.846 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T04:39:58.846 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T04:39:58.849 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T04:39:58.849 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T04:39:58.850 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T04:39:58.850 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T04:39:58.888 INFO:tasks.ceph.mds.a:Started 2023-10-06T04:39:58.888 DEBUG:teuthology.parallel:result is None 2023-10-06T04:39:58.889 INFO:tasks.ceph.mds.c:Started 2023-10-06T04:39:58.889 DEBUG:teuthology.parallel:result is None 2023-10-06T04:39:58.892 INFO:tasks.ceph.mds.b:Started 2023-10-06T04:39:58.892 DEBUG:teuthology.parallel:result is None 2023-10-06T04:39:58.892 INFO:tasks.ceph.mds.d:Started 2023-10-06T04:39:58.893 DEBUG:teuthology.parallel:result is None 2023-10-06T04:39:58.893 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T04:39:58.961 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2023-10-06T04:39:58.961 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2023-10-06T04:39:58.972 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-06T04:39:58.972 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-06T04:39:59.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.013+0000 7f522c8df700 1 Processor -- start 2023-10-06T04:39:59.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.013+0000 7f522c8df700 1 -- start start 2023-10-06T04:39:59.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.014+0000 7f522c8df700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5228143270 0x7f52280b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:59.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.014+0000 7f522c8df700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522806e0b0 0x7f5228159e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:59.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.014+0000 7f522c8df700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f522815a360 con 0x7f52280cd100 2023-10-06T04:39:59.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.014+0000 7f522c8df700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5228143640 con 0x7f5228143270 2023-10-06T04:39:59.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.014+0000 7f522c8df700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52280cd650 con 0x7f522806e0b0 2023-10-06T04:39:59.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.014+0000 7f5226d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5228143270 0x7f52280b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:59.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.014+0000 7f522659c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f52280cd100 0x7f522806d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60828/0 (socket says 172.21.15.112:60828) 2023-10-06T04:39:59.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.014+0000 7f5226d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5228143270 0x7f52280b64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39196/0 (socket says 172.21.15.112:39196) 2023-10-06T04:39:59.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.014+0000 7f522659c700 1 -- 172.21.15.112:0/3010543862 learned_addr learned my addr 172.21.15.112:0/3010543862 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:59.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.014+0000 7f522759e700 1 --2- 172.21.15.112:0/3010543862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522806e0b0 0x7f5228159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:59.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.014+0000 7f5226d9d700 1 -- 172.21.15.112:0/3010543862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522806e0b0 msgr2=0x7f5228159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:39:59.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.014+0000 7f5226d9d700 1 --2- 172.21.15.112:0/3010543862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522806e0b0 0x7f5228159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:59.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.014+0000 7f5226d9d700 1 -- 172.21.15.112:0/3010543862 >> v1:172.21.15.112:6789/0 conn(0x7f52280cd100 legacy=0x7f522806d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:59.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.014+0000 7f5226d9d700 1 -- 172.21.15.112:0/3010543862 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52280b4350 con 0x7f5228143270 2023-10-06T04:39:59.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.014+0000 7f5225d9b700 1 -- 172.21.15.112:0/3010543862 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2869069458 0 0) 0x7f522815a360 con 0x7f52280cd100 2023-10-06T04:39:59.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.014+0000 7f522759e700 1 --2- 172.21.15.112:0/3010543862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522806e0b0 0x7f5228159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:39:59.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.014+0000 7f5226d9d700 1 --2- 172.21.15.112:0/3010543862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5228143270 0x7f52280b64a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f52180098e0 tx=0x7f52180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8810f6de060da4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:59.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.014+0000 7f5225d9b700 1 -- 172.21.15.112:0/3010543862 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218009e80 con 0x7f5228143270 2023-10-06T04:39:59.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.014+0000 7f5225d9b700 1 -- 172.21.15.112:0/3010543862 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521800b860 con 0x7f5228143270 2023-10-06T04:39:59.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.014+0000 7f5225d9b700 1 -- 172.21.15.112:0/3010543862 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521800bbe0 con 0x7f5228143270 2023-10-06T04:39:59.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.015+0000 7f522c8df700 1 -- 172.21.15.112:0/3010543862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5228143270 msgr2=0x7f52280b64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:59.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.015+0000 7f522c8df700 1 --2- 172.21.15.112:0/3010543862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5228143270 0x7f52280b64a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f52180098e0 tx=0x7f52180091a0 comp rx=0 tx=0).stop 2023-10-06T04:39:59.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.015+0000 7f522c8df700 1 -- 172.21.15.112:0/3010543862 shutdown_connections 2023-10-06T04:39:59.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.015+0000 7f522c8df700 1 --2- 172.21.15.112:0/3010543862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522806e0b0 0x7f5228159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:59.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.015+0000 7f522c8df700 1 --2- 172.21.15.112:0/3010543862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5228143270 0x7f52280b64a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:59.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.015+0000 7f522c8df700 1 -- 172.21.15.112:0/3010543862 >> 172.21.15.112:0/3010543862 conn(0x7f522806d2a0 msgr2=0x7f52280b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:59.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.015+0000 7f522c8df700 1 -- 172.21.15.112:0/3010543862 shutdown_connections 2023-10-06T04:39:59.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.015+0000 7f522c8df700 1 -- 172.21.15.112:0/3010543862 wait complete. 2023-10-06T04:39:59.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.016+0000 7f522c8df700 1 Processor -- start 2023-10-06T04:39:59.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.016+0000 7f522c8df700 1 -- start start 2023-10-06T04:39:59.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.017+0000 7f522c8df700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f522806e0b0 0x7f522816d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:59.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.017+0000 7f522c8df700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52280cd100 0x7f52280b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:59.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.017+0000 7f522c8df700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52280cc0a0 0x7f52280c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:59.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.017+0000 7f522c8df700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52280b2470 con 0x7f52280cc0a0 2023-10-06T04:39:59.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.017+0000 7f522c8df700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522816d960 con 0x7f522806e0b0 2023-10-06T04:39:59.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.017+0000 7f522c8df700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52280b1580 con 0x7f52280cd100 2023-10-06T04:39:59.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.017+0000 7f522759e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52280cc0a0 0x7f52280c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:59.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.017+0000 7f522759e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52280cc0a0 0x7f52280c8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39202/0 (socket says 172.21.15.112:39202) 2023-10-06T04:39:59.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.017+0000 7f522759e700 1 -- 172.21.15.112:0/3354312946 learned_addr learned my addr 172.21.15.112:0/3354312946 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:59.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.017+0000 7f522659c700 1 --2- 172.21.15.112:0/3354312946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52280cd100 0x7f52280b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:59.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.017+0000 7f5226d9d700 1 --2- 172.21.15.112:0/3354312946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f522806e0b0 0x7f522816d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:59.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.018+0000 7f522759e700 1 -- 172.21.15.112:0/3354312946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52280cd100 msgr2=0x7f52280b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:59.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.018+0000 7f522759e700 1 --2- 172.21.15.112:0/3354312946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52280cd100 0x7f52280b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:59.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.018+0000 7f522759e700 1 -- 172.21.15.112:0/3354312946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f522806e0b0 msgr2=0x7f522816d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:59.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.018+0000 7f522759e700 1 --2- 172.21.15.112:0/3354312946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f522806e0b0 0x7f522816d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:59.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.018+0000 7f522759e700 1 -- 172.21.15.112:0/3354312946 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5218009420 con 0x7f52280cc0a0 2023-10-06T04:39:59.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.018+0000 7f522759e700 1 --2- 172.21.15.112:0/3354312946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52280cc0a0 0x7f52280c8bf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f522000cf90 tx=0x7f52200078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:59.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.018+0000 7f520effd700 1 -- 172.21.15.112:0/3354312946 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522000ae60 con 0x7f52280cc0a0 2023-10-06T04:39:59.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.018+0000 7f520effd700 1 -- 172.21.15.112:0/3354312946 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5220015440 con 0x7f52280cc0a0 2023-10-06T04:39:59.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.018+0000 7f520effd700 1 -- 172.21.15.112:0/3354312946 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220015800 con 0x7f52280cc0a0 2023-10-06T04:39:59.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.018+0000 7f522c8df700 1 -- 172.21.15.112:0/3354312946 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52280b1860 con 0x7f52280cc0a0 2023-10-06T04:39:59.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.018+0000 7f522c8df700 1 -- 172.21.15.112:0/3354312946 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52280b1e20 con 0x7f52280cc0a0 2023-10-06T04:39:59.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.019+0000 7f522c8df700 1 -- 172.21.15.112:0/3354312946 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52280b2620 con 0x7f52280cc0a0 2023-10-06T04:39:59.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.019+0000 7f520effd700 1 -- 172.21.15.112:0/3354312946 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f522000d440 con 0x7f52280cc0a0 2023-10-06T04:39:59.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.020+0000 7f520effd700 1 --2- 172.21.15.112:0/3354312946 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5214066f30 0x7f52140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:59.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.020+0000 7f520effd700 1 -- 172.21.15.112:0/3354312946 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f5220084fa0 con 0x7f52280cc0a0 2023-10-06T04:39:59.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.020+0000 7f5226d9d700 1 --2- 172.21.15.112:0/3354312946 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5214066f30 0x7f52140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:59.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.021+0000 7f5226d9d700 1 --2- 172.21.15.112:0/3354312946 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5214066f30 0x7f52140693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f52280641c0 tx=0x7f5218017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:59.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.027+0000 7f520effd700 1 -- 172.21.15.112:0/3354312946 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52200523b0 con 0x7f52280cc0a0 2023-10-06T04:39:59.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.226+0000 7f522c8df700 1 -- 172.21.15.112:0/3354312946 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f522805f230 con 0x7f52280cc0a0 2023-10-06T04:39:59.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.826+0000 7f520effd700 1 -- 172.21.15.112:0/3354312946 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) v1 ==== 97+0+0 (secure 0 0 0) 0x7f522001a080 con 0x7f52280cc0a0 2023-10-06T04:39:59.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.829+0000 7f522c8df700 1 -- 172.21.15.112:0/3354312946 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5214066f30 msgr2=0x7f52140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:59.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.829+0000 7f522c8df700 1 --2- 172.21.15.112:0/3354312946 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5214066f30 0x7f52140693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f52280641c0 tx=0x7f5218017000 comp rx=0 tx=0).stop 2023-10-06T04:39:59.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.829+0000 7f522c8df700 1 -- 172.21.15.112:0/3354312946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52280cc0a0 msgr2=0x7f52280c8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:59.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.829+0000 7f522c8df700 1 --2- 172.21.15.112:0/3354312946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52280cc0a0 0x7f52280c8bf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f522000cf90 tx=0x7f52200078a0 comp rx=0 tx=0).stop 2023-10-06T04:39:59.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.829+0000 7f522c8df700 1 -- 172.21.15.112:0/3354312946 shutdown_connections 2023-10-06T04:39:59.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.829+0000 7f522c8df700 1 --2- 172.21.15.112:0/3354312946 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5214066f30 0x7f52140693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:59.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.829+0000 7f522c8df700 1 --2- 172.21.15.112:0/3354312946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52280cc0a0 0x7f52280c8bf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:59.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.829+0000 7f522c8df700 1 --2- 172.21.15.112:0/3354312946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f522806e0b0 0x7f522816d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:59.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.829+0000 7f522c8df700 1 --2- 172.21.15.112:0/3354312946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52280cd100 0x7f52280b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:59.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.829+0000 7f522c8df700 1 -- 172.21.15.112:0/3354312946 >> 172.21.15.112:0/3354312946 conn(0x7f522806d2a0 msgr2=0x7f522815a020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:59.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.829+0000 7f522c8df700 1 -- 172.21.15.112:0/3354312946 shutdown_connections 2023-10-06T04:39:59.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.829+0000 7f522c8df700 1 -- 172.21.15.112:0/3354312946 wait complete. 2023-10-06T04:39:59.833 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2023-10-06T04:39:59.847 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T04:39:59.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.959+0000 7f6653cbc700 1 Processor -- start 2023-10-06T04:39:59.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.959+0000 7f6653cbc700 1 -- start start 2023-10-06T04:39:59.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.960+0000 7f6653cbc700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f664c0b0e70 0x7f664c0b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:59.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.960+0000 7f6653cbc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664c0cd740 con 0x7f664c159d50 2023-10-06T04:39:59.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.960+0000 7f6653cbc700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664c0b17d0 con 0x7f664c0b3040 2023-10-06T04:39:59.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.960+0000 7f6653cbc700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f664c0b3490 con 0x7f664c0b0e70 2023-10-06T04:39:59.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.960+0000 7f6651a58700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f664c159d50 0x7f664c15a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60834/0 (socket says 172.21.15.112:60834) 2023-10-06T04:39:59.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.960+0000 7f6651a58700 1 -- 172.21.15.112:0/837064569 learned_addr learned my addr 172.21.15.112:0/837064569 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:39:59.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.960+0000 7f6652259700 1 --2- 172.21.15.112:0/837064569 >> v2:172.21.15.179:3300/0 conn(0x7f664c0b0e70 0x7f664c0b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:59.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.960+0000 7f6650a56700 1 -- 172.21.15.112:0/837064569 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584012742 0 0) 0x7f664c0cd740 con 0x7f664c159d50 2023-10-06T04:39:59.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.961+0000 7f6650a56700 1 -- 172.21.15.112:0/837064569 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6638003570 con 0x7f664c159d50 2023-10-06T04:39:59.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.961+0000 7f6650a56700 1 -- 172.21.15.112:0/837064569 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420923053 0 0) 0x7f664c0b17d0 con 0x7f664c0b3040 2023-10-06T04:39:59.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.961+0000 7f6650a56700 1 -- 172.21.15.112:0/837064569 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f664c0cd740 con 0x7f664c0b3040 2023-10-06T04:39:59.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.961+0000 7f6652259700 1 -- 172.21.15.112:0/837064569 >> v1:172.21.15.179:6789/0 conn(0x7f664c0b3040 legacy=0x7f664c0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:59.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.961+0000 7f6652259700 1 -- 172.21.15.112:0/837064569 >> v1:172.21.15.112:6789/0 conn(0x7f664c159d50 legacy=0x7f664c15a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:59.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.961+0000 7f6652259700 1 -- 172.21.15.112:0/837064569 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664c0ccb30 con 0x7f664c0b0e70 2023-10-06T04:39:59.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.961+0000 7f6652259700 1 --2- 172.21.15.112:0/837064569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f664c0b0e70 0x7f664c0b1290 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6644009e60 tx=0x7f6644009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2661dbbf2bee297 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:59.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.961+0000 7f6650a56700 1 -- 172.21.15.112:0/837064569 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664400e070 con 0x7f664c0b0e70 2023-10-06T04:39:59.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.961+0000 7f6650a56700 1 -- 172.21.15.112:0/837064569 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664400bab0 con 0x7f664c0b0e70 2023-10-06T04:39:59.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.961+0000 7f6650a56700 1 -- 172.21.15.112:0/837064569 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664400be70 con 0x7f664c0b0e70 2023-10-06T04:39:59.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.961+0000 7f6653cbc700 1 -- 172.21.15.112:0/837064569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f664c0b0e70 msgr2=0x7f664c0b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:59.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.962+0000 7f6653cbc700 1 --2- 172.21.15.112:0/837064569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f664c0b0e70 0x7f664c0b1290 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6644009e60 tx=0x7f6644009780 comp rx=0 tx=0).stop 2023-10-06T04:39:59.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.962+0000 7f6653cbc700 1 -- 172.21.15.112:0/837064569 shutdown_connections 2023-10-06T04:39:59.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.962+0000 7f6653cbc700 1 --2- 172.21.15.112:0/837064569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f664c0b0e70 0x7f664c0b1290 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:59.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.962+0000 7f6653cbc700 1 -- 172.21.15.112:0/837064569 >> 172.21.15.112:0/837064569 conn(0x7f664c099b60 msgr2=0x7f664c06cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:39:59.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.962+0000 7f6653cbc700 1 -- 172.21.15.112:0/837064569 shutdown_connections 2023-10-06T04:39:59.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.962+0000 7f6653cbc700 1 -- 172.21.15.112:0/837064569 wait complete. 2023-10-06T04:39:59.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.963+0000 7f6653cbc700 1 Processor -- start 2023-10-06T04:39:59.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.963+0000 7f6653cbc700 1 -- start start 2023-10-06T04:39:59.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.963+0000 7f6653cbc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f664c0b0e70 0x7f664c1537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:59.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.963+0000 7f6653cbc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f664c0b3040 0x7f664c0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:59.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.963+0000 7f6653cbc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f664c159d50 0x7f664c0b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:59.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.963+0000 7f6653cbc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664c153cf0 con 0x7f664c0b3040 2023-10-06T04:39:59.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.963+0000 7f6653cbc700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664c15c170 con 0x7f664c159d50 2023-10-06T04:39:59.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.963+0000 7f6653cbc700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f664c0b4790 con 0x7f664c0b0e70 2023-10-06T04:39:59.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.964+0000 7f6651257700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f664c0b3040 0x7f664c0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:59.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.964+0000 7f6651257700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f664c0b3040 0x7f664c0b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39206/0 (socket says 172.21.15.112:39206) 2023-10-06T04:39:59.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.964+0000 7f6651257700 1 -- 172.21.15.112:0/1243962146 learned_addr learned my addr 172.21.15.112:0/1243962146 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:39:59.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.964+0000 7f6652259700 1 --2- 172.21.15.112:0/1243962146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f664c159d50 0x7f664c0b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:59.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.964+0000 7f6651a58700 1 --2- 172.21.15.112:0/1243962146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f664c0b0e70 0x7f664c1537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:59.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.964+0000 7f6651257700 1 -- 172.21.15.112:0/1243962146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f664c0b0e70 msgr2=0x7f664c1537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:59.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.964+0000 7f6651257700 1 --2- 172.21.15.112:0/1243962146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f664c0b0e70 0x7f664c1537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:59.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.964+0000 7f6651257700 1 -- 172.21.15.112:0/1243962146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f664c159d50 msgr2=0x7f664c0b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:39:59.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.964+0000 7f6651257700 1 --2- 172.21.15.112:0/1243962146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f664c159d50 0x7f664c0b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:39:59.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.964+0000 7f6651257700 1 -- 172.21.15.112:0/1243962146 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6644009a20 con 0x7f664c0b3040 2023-10-06T04:39:59.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.964+0000 7f6652259700 1 --2- 172.21.15.112:0/1243962146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f664c159d50 0x7f664c0b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:39:59.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.964+0000 7f6651257700 1 --2- 172.21.15.112:0/1243962146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f664c0b3040 0x7f664c0b5cf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f663c00c7c0 tx=0x7f663c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:59.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.964+0000 7f6641ffb700 1 -- 172.21.15.112:0/1243962146 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c016070 con 0x7f664c0b3040 2023-10-06T04:39:59.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.964+0000 7f6641ffb700 1 -- 172.21.15.112:0/1243962146 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663c011680 con 0x7f664c0b3040 2023-10-06T04:39:59.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.964+0000 7f6653cbc700 1 -- 172.21.15.112:0/1243962146 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f664c0b4a70 con 0x7f664c0b3040 2023-10-06T04:39:59.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.964+0000 7f6641ffb700 1 -- 172.21.15.112:0/1243962146 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c011a20 con 0x7f664c0b3040 2023-10-06T04:39:59.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.964+0000 7f6653cbc700 1 -- 172.21.15.112:0/1243962146 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f664c0b5030 con 0x7f664c0b3040 2023-10-06T04:39:59.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.965+0000 7f6653cbc700 1 -- 172.21.15.112:0/1243962146 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f664c15c330 con 0x7f664c0b3040 2023-10-06T04:39:59.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.966+0000 7f6641ffb700 1 -- 172.21.15.112:0/1243962146 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f663c012440 con 0x7f664c0b3040 2023-10-06T04:39:59.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.966+0000 7f6641ffb700 1 --2- 172.21.15.112:0/1243962146 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6630066f30 0x7f66300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:39:59.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.966+0000 7f6641ffb700 1 -- 172.21.15.112:0/1243962146 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f663c084190 con 0x7f664c0b3040 2023-10-06T04:39:59.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.966+0000 7f6651a58700 1 --2- 172.21.15.112:0/1243962146 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6630066f30 0x7f66300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:39:59.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.966+0000 7f6651a58700 1 --2- 172.21.15.112:0/1243962146 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6630066f30 0x7f66300693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f66480058d0 tx=0x7f6648009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:39:59.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:39:59.970+0000 7f6641ffb700 1 -- 172.21.15.112:0/1243962146 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f663c0515f0 con 0x7f664c0b3040 2023-10-06T04:40:00.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.226+0000 7f6653cbc700 1 -- 172.21.15.112:0/1243962146 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f664c05f230 con 0x7f664c0b3040 2023-10-06T04:40:00.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.227+0000 7f6641ffb700 1 -- 172.21.15.112:0/1243962146 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f663c054c10 con 0x7f664c0b3040 2023-10-06T04:40:00.229 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:00.229 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-10-06T04:40:00.230 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2023-10-06T04:40:00.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.230 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2023-10-06T04:40:00.230 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBFjx9lHRsgFBAAVmrOzSO916joB3iUPDqY/A==", 2023-10-06T04:40:00.230 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.230 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-10-06T04:40:00.230 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-10-06T04:40:00.230 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-10-06T04:40:00.230 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-10-06T04:40:00.231 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.231 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2023-10-06T04:40:00.231 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBFjx9lXB84HxAANT7HE/+7+jhEqpoLHpocaw==", 2023-10-06T04:40:00.231 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.231 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-10-06T04:40:00.231 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-10-06T04:40:00.231 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-10-06T04:40:00.231 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-10-06T04:40:00.231 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.232 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2023-10-06T04:40:00.232 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBFjx9lmKDeGhAAJiJU058HFfg3HIqUE4rpLw==", 2023-10-06T04:40:00.232 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.232 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-10-06T04:40:00.232 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-10-06T04:40:00.232 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-10-06T04:40:00.232 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-10-06T04:40:00.232 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.232 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2023-10-06T04:40:00.232 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBFjx9l1gX3JRAARGmfsEFVUNfw6k/Dzf+lwg==", 2023-10-06T04:40:00.233 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.233 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-10-06T04:40:00.233 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-10-06T04:40:00.233 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-10-06T04:40:00.233 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-10-06T04:40:00.233 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.233 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2023-10-06T04:40:00.233 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBJjx9l3iwcBhAADAPEZKqdlv7ygDYgh1NPNQ==", 2023-10-06T04:40:00.233 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.233 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:00.234 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-10-06T04:40:00.234 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-10-06T04:40:00.234 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.234 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2023-10-06T04:40:00.234 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBMjx9lSs0FAxAAmUyr5D3QwnXAmrzU6KwbbA==", 2023-10-06T04:40:00.234 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.234 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:00.234 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-10-06T04:40:00.234 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-10-06T04:40:00.235 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.235 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2023-10-06T04:40:00.235 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBPjx9l6MuOAxAAUZ4aY+DF3CKXwTalTP+tkg==", 2023-10-06T04:40:00.235 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.235 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:00.235 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-10-06T04:40:00.235 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-10-06T04:40:00.235 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.236 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2023-10-06T04:40:00.236 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBSjx9lIidoARAAIqNp0Q6fV9q2jnXSPQT/AQ==", 2023-10-06T04:40:00.236 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.236 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:00.236 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-10-06T04:40:00.236 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-10-06T04:40:00.236 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.236 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2023-10-06T04:40:00.236 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBYjx9lSdbVAhAAZPqGYaBw04sdD3ix8I0TMw==", 2023-10-06T04:40:00.236 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.236 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:00.237 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-10-06T04:40:00.237 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-10-06T04:40:00.237 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.237 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2023-10-06T04:40:00.237 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBbjx9lRtlmABAA1GGXcZC5Usx6BEh8FEKfUA==", 2023-10-06T04:40:00.237 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.237 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:00.237 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-10-06T04:40:00.237 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-10-06T04:40:00.238 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.238 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2023-10-06T04:40:00.238 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBejx9lUsAXABAA73gmQkPcFxFG+KEQ/M2zZQ==", 2023-10-06T04:40:00.238 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.238 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:00.238 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-10-06T04:40:00.238 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-10-06T04:40:00.238 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.239 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2023-10-06T04:40:00.239 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBhjx9lgwj5ARAA1GZF4aAi7GaqJQkK5+psIg==", 2023-10-06T04:40:00.239 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.239 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-10-06T04:40:00.239 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-10-06T04:40:00.239 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-10-06T04:40:00.239 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.239 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2023-10-06T04:40:00.239 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBFjx9lB529KRAAcgqvfkVELgnt0AojZQSDhA==", 2023-10-06T04:40:00.239 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.239 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-10-06T04:40:00.240 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2023-10-06T04:40:00.240 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2023-10-06T04:40:00.240 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2023-10-06T04:40:00.240 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.240 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2023-10-06T04:40:00.240 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBFjx9li3gaMhAAgQc9tI4BBq9G8ZdSr5dJMQ==", 2023-10-06T04:40:00.240 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.240 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-10-06T04:40:00.240 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2023-10-06T04:40:00.240 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2023-10-06T04:40:00.241 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2023-10-06T04:40:00.241 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.241 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2023-10-06T04:40:00.241 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBFjx9lczInLxAArt0EQqtNqzeINPY76QdgXw==", 2023-10-06T04:40:00.241 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.241 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-10-06T04:40:00.241 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2023-10-06T04:40:00.241 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2023-10-06T04:40:00.241 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2023-10-06T04:40:00.242 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.242 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2023-10-06T04:40:00.242 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBFjx9lVvxxNxAAIFHE41UvuBDhZ0R1hmIfnQ==", 2023-10-06T04:40:00.242 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.242 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-10-06T04:40:00.242 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2023-10-06T04:40:00.242 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2023-10-06T04:40:00.242 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2023-10-06T04:40:00.242 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.243 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2023-10-06T04:40:00.243 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBEjx9lzs4PNBAA7bcdaNChkJ0iF06FJ+7VCA==", 2023-10-06T04:40:00.243 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.243 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2023-10-06T04:40:00.243 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-10-06T04:40:00.243 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-10-06T04:40:00.243 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-10-06T04:40:00.243 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.243 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-mds", 2023-10-06T04:40:00.244 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBmjx9lsVWKLRAAHgwQOrIPBWe8iQnT4+Hu+g==", 2023-10-06T04:40:00.244 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.244 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T04:40:00.244 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.244 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T04:40:00.244 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBmjx9lD16KLRAAZDbCXYOLJZDg+5ua1Ri9bA==", 2023-10-06T04:40:00.244 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.244 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T04:40:00.244 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.245 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-osd", 2023-10-06T04:40:00.245 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBmjx9llmWKLRAAgi60LLwITNBxUwm5Komttg==", 2023-10-06T04:40:00.245 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.245 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T04:40:00.245 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.245 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T04:40:00.245 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBmjx9lqm2KLRAAk6EZ1nvEgRLmh9c3BQsJVA==", 2023-10-06T04:40:00.245 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.245 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T04:40:00.246 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.246 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T04:40:00.246 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBmjx9lgneKLRAABLVbjonAdb/Db4UnMMUcQg==", 2023-10-06T04:40:00.246 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.246 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T04:40:00.246 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.246 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T04:40:00.246 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBmjx9lU3+KLRAAXHhy0DbgRNmpP5zHHlgQPw==", 2023-10-06T04:40:00.247 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.247 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T04:40:00.247 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.247 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2023-10-06T04:40:00.247 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBFjx9lnh4bERAAeV5SyL28+JjhcjhWw1IQ+g==", 2023-10-06T04:40:00.247 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.247 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2023-10-06T04:40:00.247 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2023-10-06T04:40:00.247 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-10-06T04:40:00.247 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:00.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:00.248 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2023-10-06T04:40:00.248 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBFjx9lr+KZDBAAqTnvWgCJxJ4/OZuod+I3IA==", 2023-10-06T04:40:00.248 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-10-06T04:40:00.248 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2023-10-06T04:40:00.248 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2023-10-06T04:40:00.248 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-10-06T04:40:00.248 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.248 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:00.248 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2023-10-06T04:40:00.249 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-10-06T04:40:00.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.229+0000 7f6653cbc700 1 -- 172.21.15.112:0/1243962146 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6630066f30 msgr2=0x7f66300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.229+0000 7f6653cbc700 1 --2- 172.21.15.112:0/1243962146 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6630066f30 0x7f66300693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f66480058d0 tx=0x7f6648009040 comp rx=0 tx=0).stop 2023-10-06T04:40:00.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.229+0000 7f6653cbc700 1 -- 172.21.15.112:0/1243962146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f664c0b3040 msgr2=0x7f664c0b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.229+0000 7f6653cbc700 1 --2- 172.21.15.112:0/1243962146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f664c0b3040 0x7f664c0b5cf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f663c00c7c0 tx=0x7f663c007dd0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.229+0000 7f6653cbc700 1 -- 172.21.15.112:0/1243962146 shutdown_connections 2023-10-06T04:40:00.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.229+0000 7f6653cbc700 1 --2- 172.21.15.112:0/1243962146 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6630066f30 0x7f66300693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.229+0000 7f6653cbc700 1 --2- 172.21.15.112:0/1243962146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f664c159d50 0x7f664c0b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.229+0000 7f6653cbc700 1 --2- 172.21.15.112:0/1243962146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f664c0b0e70 0x7f664c1537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.229+0000 7f6653cbc700 1 --2- 172.21.15.112:0/1243962146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f664c0b3040 0x7f664c0b5cf0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.229+0000 7f6653cbc700 1 -- 172.21.15.112:0/1243962146 >> 172.21.15.112:0/1243962146 conn(0x7f664c099b60 msgr2=0x7f664c1554f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:00.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.229+0000 7f6653cbc700 1 -- 172.21.15.112:0/1243962146 shutdown_connections 2023-10-06T04:40:00.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.229+0000 7f6653cbc700 1 -- 172.21.15.112:0/1243962146 wait complete. 2023-10-06T04:40:00.252 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T04:40:00.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.366+0000 7fc83fb14700 1 Processor -- start 2023-10-06T04:40:00.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.366+0000 7fc83fb14700 1 -- start start 2023-10-06T04:40:00.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.367+0000 7fc83fb14700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8380d1410 0x7fc8380cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.367+0000 7fc83fb14700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8380cf2c0 con 0x7fc8380d0350 2023-10-06T04:40:00.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.367+0000 7fc83fb14700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8380cbd70 con 0x7fc83815cd20 2023-10-06T04:40:00.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.367+0000 7fc83fb14700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380cecb0 con 0x7fc8380d1410 2023-10-06T04:40:00.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.367+0000 7fc83e0b1700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc8380d0350 0x7fc83815d0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60850/0 (socket says 172.21.15.112:60850) 2023-10-06T04:40:00.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.367+0000 7fc83e0b1700 1 -- 172.21.15.112:0/271978057 learned_addr learned my addr 172.21.15.112:0/271978057 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:00.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.367+0000 7fc83d0af700 1 --2- 172.21.15.112:0/271978057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8380d1410 0x7fc8380cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.367+0000 7fc83c8ae700 1 -- 172.21.15.112:0/271978057 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400428903 0 0) 0x7fc8380cf2c0 con 0x7fc8380d0350 2023-10-06T04:40:00.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.367+0000 7fc83c8ae700 1 -- 172.21.15.112:0/271978057 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc824003570 con 0x7fc8380d0350 2023-10-06T04:40:00.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83c8ae700 1 -- 172.21.15.112:0/271978057 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3711575098 0 0) 0x7fc8380cbd70 con 0x7fc83815cd20 2023-10-06T04:40:00.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83c8ae700 1 -- 172.21.15.112:0/271978057 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8380cf2c0 con 0x7fc83815cd20 2023-10-06T04:40:00.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83c8ae700 1 -- 172.21.15.112:0/271978057 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 988141019 0 0) 0x7fc824003570 con 0x7fc8380d0350 2023-10-06T04:40:00.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83c8ae700 1 -- 172.21.15.112:0/271978057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8380d1410 msgr2=0x7fc8380cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:00.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83c8ae700 1 --2- 172.21.15.112:0/271978057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8380d1410 0x7fc8380cf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83c8ae700 1 -- 172.21.15.112:0/271978057 >> v1:172.21.15.179:6789/0 conn(0x7fc83815cd20 legacy=0x7fc8380ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83c8ae700 1 -- 172.21.15.112:0/271978057 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8380cbfc0 con 0x7fc8380d0350 2023-10-06T04:40:00.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83c8ae700 1 -- 172.21.15.112:0/271978057 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7fc8300017f0 con 0x7fc8380d0350 2023-10-06T04:40:00.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83d0af700 1 --2- 172.21.15.112:0/271978057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8380d1410 0x7fc8380cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:00.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83c8ae700 1 -- 172.21.15.112:0/271978057 >> v1:172.21.15.112:6789/0 conn(0x7fc8380d0350 legacy=0x7fc83815d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83c8ae700 1 --2- 172.21.15.112:0/271978057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8380d1410 0x7fc824003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83c8ae700 1 --2- 172.21.15.112:0/271978057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc824004160 0x7fc824004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83c8ae700 1 --2- 172.21.15.112:0/271978057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc824004d50 0x7fc8240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83c8ae700 1 -- 172.21.15.112:0/271978057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380cecb0 con 0x7fc824004d50 2023-10-06T04:40:00.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83c8ae700 1 -- 172.21.15.112:0/271978057 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82400bc20 con 0x7fc824004160 2023-10-06T04:40:00.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83c8ae700 1 -- 172.21.15.112:0/271978057 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82400bde0 con 0x7fc8380d1410 2023-10-06T04:40:00.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83e0b1700 1 --2- 172.21.15.112:0/271978057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc824004d50 0x7fc8240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83d8b0700 1 --2- 172.21.15.112:0/271978057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8380d1410 0x7fc824003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83d0af700 1 --2- 172.21.15.112:0/271978057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc824004160 0x7fc824004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83e0b1700 1 -- 172.21.15.112:0/271978057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8380d1410 msgr2=0x7fc824003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:00.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83e0b1700 1 --2- 172.21.15.112:0/271978057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8380d1410 0x7fc824003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83e0b1700 1 -- 172.21.15.112:0/271978057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc824004160 msgr2=0x7fc824004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83e0b1700 1 --2- 172.21.15.112:0/271978057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc824004160 0x7fc824004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83e0b1700 1 -- 172.21.15.112:0/271978057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc828009420 con 0x7fc824004d50 2023-10-06T04:40:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83e0b1700 1 --2- 172.21.15.112:0/271978057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc824004d50 0x7fc8240051c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc83000a8a0 tx=0x7fc830002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d0ae7cf99e2526 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83c8ae700 1 -- 172.21.15.112:0/271978057 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8300070d0 con 0x7fc824004d50 2023-10-06T04:40:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83c8ae700 1 -- 172.21.15.112:0/271978057 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc830007230 con 0x7fc824004d50 2023-10-06T04:40:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.368+0000 7fc83c8ae700 1 -- 172.21.15.112:0/271978057 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8300075f0 con 0x7fc824004d50 2023-10-06T04:40:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.369+0000 7fc83fb14700 1 -- 172.21.15.112:0/271978057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc824004d50 msgr2=0x7fc8240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.369+0000 7fc83fb14700 1 --2- 172.21.15.112:0/271978057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc824004d50 0x7fc8240051c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc83000a8a0 tx=0x7fc830002190 comp rx=0 tx=0).stop 2023-10-06T04:40:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.369+0000 7fc83e0b1700 1 -- 172.21.15.112:0/271978057 reap_dead start 2023-10-06T04:40:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.369+0000 7fc83fb14700 1 -- 172.21.15.112:0/271978057 shutdown_connections 2023-10-06T04:40:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.369+0000 7fc83fb14700 1 -- 172.21.15.112:0/271978057 >> 172.21.15.112:0/271978057 conn(0x7fc83806cfb0 msgr2=0x7fc8380d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:00.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.369+0000 7fc83fb14700 1 -- 172.21.15.112:0/271978057 shutdown_connections 2023-10-06T04:40:00.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.369+0000 7fc83fb14700 1 -- 172.21.15.112:0/271978057 wait complete. 2023-10-06T04:40:00.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.371+0000 7fc83fb14700 1 Processor -- start 2023-10-06T04:40:00.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.371+0000 7fc83fb14700 1 -- start start 2023-10-06T04:40:00.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.371+0000 7fc83fb14700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc824004d50 0x7fc838156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.371+0000 7fc83fb14700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc83814d230 0x7fc83815a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.371+0000 7fc83fb14700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc83815ab90 0x7fc8380b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.371+0000 7fc83fb14700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83815b000 con 0x7fc824004d50 2023-10-06T04:40:00.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.371+0000 7fc83fb14700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc838155ce0 con 0x7fc83815ab90 2023-10-06T04:40:00.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.371+0000 7fc83fb14700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8381550d0 con 0x7fc83814d230 2023-10-06T04:40:00.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.371+0000 7fc83d8b0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc824004d50 0x7fc838156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.371+0000 7fc83d8b0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc824004d50 0x7fc838156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39220/0 (socket says 172.21.15.112:39220) 2023-10-06T04:40:00.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.371+0000 7fc83d8b0700 1 -- 172.21.15.112:0/3364236991 learned_addr learned my addr 172.21.15.112:0/3364236991 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:00.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.372+0000 7fc83d8b0700 1 -- 172.21.15.112:0/3364236991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc83814d230 msgr2=0x7fc83815a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.372+0000 7fc83d8b0700 1 --2- 172.21.15.112:0/3364236991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc83814d230 0x7fc83815a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.372+0000 7fc83d8b0700 1 -- 172.21.15.112:0/3364236991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc83815ab90 msgr2=0x7fc8380b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.372+0000 7fc83d8b0700 1 --2- 172.21.15.112:0/3364236991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc83815ab90 0x7fc8380b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.372+0000 7fc83d8b0700 1 -- 172.21.15.112:0/3364236991 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8381553b0 con 0x7fc824004d50 2023-10-06T04:40:00.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.372+0000 7fc83d8b0700 1 --2- 172.21.15.112:0/3364236991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc824004d50 0x7fc838156170 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc834007a80 tx=0x7fc834007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:00.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.372+0000 7fc82dffb700 1 -- 172.21.15.112:0/3364236991 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83400f9a0 con 0x7fc824004d50 2023-10-06T04:40:00.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.372+0000 7fc82dffb700 1 -- 172.21.15.112:0/3364236991 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83400fb20 con 0x7fc824004d50 2023-10-06T04:40:00.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.372+0000 7fc83fb14700 1 -- 172.21.15.112:0/3364236991 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc838155690 con 0x7fc824004d50 2023-10-06T04:40:00.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.372+0000 7fc82dffb700 1 -- 172.21.15.112:0/3364236991 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83400fee0 con 0x7fc824004d50 2023-10-06T04:40:00.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.372+0000 7fc83fb14700 1 -- 172.21.15.112:0/3364236991 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8381566b0 con 0x7fc824004d50 2023-10-06T04:40:00.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.373+0000 7fc83fb14700 1 -- 172.21.15.112:0/3364236991 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83805f230 con 0x7fc824004d50 2023-10-06T04:40:00.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.373+0000 7fc82dffb700 1 -- 172.21.15.112:0/3364236991 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc834013600 con 0x7fc824004d50 2023-10-06T04:40:00.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.374+0000 7fc82dffb700 1 --2- 172.21.15.112:0/3364236991 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc81c066f30 0x7fc81c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.374+0000 7fc82dffb700 1 -- 172.21.15.112:0/3364236991 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc834084b70 con 0x7fc824004d50 2023-10-06T04:40:00.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.374+0000 7fc83d0af700 1 --2- 172.21.15.112:0/3364236991 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc81c066f30 0x7fc81c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.374+0000 7fc83d0af700 1 --2- 172.21.15.112:0/3364236991 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc81c066f30 0x7fc81c0693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc838157ad0 tx=0x7fc8280091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:00.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.378+0000 7fc82dffb700 1 -- 172.21.15.112:0/3364236991 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc834051fd0 con 0x7fc824004d50 2023-10-06T04:40:00.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.641+0000 7fc83fb14700 1 -- 172.21.15.112:0/3364236991 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fc8380cef50 con 0x7fc824004d50 2023-10-06T04:40:00.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.644+0000 7fc82dffb700 1 -- 172.21.15.112:0/3364236991 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc8340555f0 con 0x7fc824004d50 2023-10-06T04:40:00.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.646+0000 7fc83fb14700 1 -- 172.21.15.112:0/3364236991 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc81c066f30 msgr2=0x7fc81c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.646+0000 7fc83fb14700 1 --2- 172.21.15.112:0/3364236991 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc81c066f30 0x7fc81c0693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc838157ad0 tx=0x7fc8280091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.647+0000 7fc83fb14700 1 -- 172.21.15.112:0/3364236991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc824004d50 msgr2=0x7fc838156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.647+0000 7fc83fb14700 1 --2- 172.21.15.112:0/3364236991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc824004d50 0x7fc838156170 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc834007a80 tx=0x7fc834007d30 comp rx=0 tx=0).stop 2023-10-06T04:40:00.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.647+0000 7fc83fb14700 1 -- 172.21.15.112:0/3364236991 shutdown_connections 2023-10-06T04:40:00.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.647+0000 7fc83fb14700 1 --2- 172.21.15.112:0/3364236991 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc81c066f30 0x7fc81c0693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.647+0000 7fc83fb14700 1 --2- 172.21.15.112:0/3364236991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc83815ab90 0x7fc8380b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.647+0000 7fc83fb14700 1 --2- 172.21.15.112:0/3364236991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc824004d50 0x7fc838156170 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.647+0000 7fc83fb14700 1 --2- 172.21.15.112:0/3364236991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc83814d230 0x7fc83815a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.647+0000 7fc83fb14700 1 -- 172.21.15.112:0/3364236991 >> 172.21.15.112:0/3364236991 conn(0x7fc83806cfb0 msgr2=0x7fc83815dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:00.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.647+0000 7fc83fb14700 1 -- 172.21.15.112:0/3364236991 shutdown_connections 2023-10-06T04:40:00.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.647+0000 7fc83fb14700 1 -- 172.21.15.112:0/3364236991 wait complete. 2023-10-06T04:40:00.661 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T04:40:00.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.774+0000 7f67bc0ae700 1 Processor -- start 2023-10-06T04:40:00.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.774+0000 7f67bc0ae700 1 -- start start 2023-10-06T04:40:00.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.775+0000 7f67bc0ae700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f67b40d1410 0x7f67b40cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.775+0000 7f67bc0ae700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f67b40d0350 0x7f67b40cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.775+0000 7f67bc0ae700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b40cf2c0 con 0x7f67b415cd20 2023-10-06T04:40:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.775+0000 7f67bc0ae700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b40cbd70 con 0x7f67b40d1410 2023-10-06T04:40:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.775+0000 7f67bc0ae700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b40cecb0 con 0x7f67b40d0350 2023-10-06T04:40:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.775+0000 7f67b9e4a700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f67b415cd20 0x7f67b40ad870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60866/0 (socket says 172.21.15.112:60866) 2023-10-06T04:40:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.775+0000 7f67b9e4a700 1 -- 172.21.15.112:0/3633804767 learned_addr learned my addr 172.21.15.112:0/3633804767 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.775+0000 7f67b9649700 1 --2- 172.21.15.112:0/3633804767 >> v2:172.21.15.112:3300/0 conn(0x7f67b40d1410 0x7f67b40cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.775+0000 7f67ba64b700 1 --2- 172.21.15.112:0/3633804767 >> v2:172.21.15.179:3300/0 conn(0x7f67b40d0350 0x7f67b40cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.775+0000 7f67b9649700 1 -- 172.21.15.112:0/3633804767 >> v2:172.21.15.179:3300/0 conn(0x7f67b40d0350 msgr2=0x7f67b40cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.775+0000 7f67b9649700 1 --2- 172.21.15.112:0/3633804767 >> v2:172.21.15.179:3300/0 conn(0x7f67b40d0350 0x7f67b40cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.775+0000 7f67b9649700 1 -- 172.21.15.112:0/3633804767 >> v1:172.21.15.112:6789/0 conn(0x7f67b415cd20 legacy=0x7f67b40ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.775+0000 7f67b8e48700 1 -- 172.21.15.112:0/3633804767 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975253694 0 0) 0x7f67b40cf2c0 con 0x7f67b415cd20 2023-10-06T04:40:00.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.775+0000 7f67b9649700 1 -- 172.21.15.112:0/3633804767 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b40cbfc0 con 0x7f67b40d1410 2023-10-06T04:40:00.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.775+0000 7f67b9649700 1 --2- 172.21.15.112:0/3633804767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67b40d1410 0x7f67b40cf750 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f67b4088870 tx=0x7f67a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8827fd61d2746e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:00.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.776+0000 7f67b8e48700 1 -- 172.21.15.112:0/3633804767 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a800e070 con 0x7f67b40d1410 2023-10-06T04:40:00.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.776+0000 7f67b8e48700 1 -- 172.21.15.112:0/3633804767 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a800bc30 con 0x7f67b40d1410 2023-10-06T04:40:00.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.776+0000 7f67b8e48700 1 -- 172.21.15.112:0/3633804767 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a8012430 con 0x7f67b40d1410 2023-10-06T04:40:00.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.776+0000 7f67bc0ae700 1 -- 172.21.15.112:0/3633804767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67b40d1410 msgr2=0x7f67b40cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.776+0000 7f67bc0ae700 1 --2- 172.21.15.112:0/3633804767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67b40d1410 0x7f67b40cf750 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f67b4088870 tx=0x7f67a8009780 comp rx=0 tx=0).stop 2023-10-06T04:40:00.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.776+0000 7f67bc0ae700 1 -- 172.21.15.112:0/3633804767 shutdown_connections 2023-10-06T04:40:00.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.776+0000 7f67bc0ae700 1 --2- 172.21.15.112:0/3633804767 >> v2:172.21.15.179:3300/0 conn(0x7f67b40d0350 0x7f67b40cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.776+0000 7f67bc0ae700 1 --2- 172.21.15.112:0/3633804767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67b40d1410 0x7f67b40cf750 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.776+0000 7f67bc0ae700 1 -- 172.21.15.112:0/3633804767 >> 172.21.15.112:0/3633804767 conn(0x7f67b406cfb0 msgr2=0x7f67b40d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:00.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.776+0000 7f67bc0ae700 1 -- 172.21.15.112:0/3633804767 shutdown_connections 2023-10-06T04:40:00.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.776+0000 7f67bc0ae700 1 -- 172.21.15.112:0/3633804767 wait complete. 2023-10-06T04:40:00.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.777+0000 7f67bc0ae700 1 Processor -- start 2023-10-06T04:40:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.777+0000 7f67bc0ae700 1 -- start start 2023-10-06T04:40:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.778+0000 7f67bc0ae700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67b40d0350 0x7f67b40aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.778+0000 7f67bc0ae700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67b40d1410 0x7f67b40b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.778+0000 7f67bc0ae700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67b415cd20 0x7f67b40b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.778+0000 7f67bc0ae700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b40af250 con 0x7f67b40d0350 2023-10-06T04:40:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.778+0000 7f67bc0ae700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b40ae880 con 0x7f67b415cd20 2023-10-06T04:40:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.778+0000 7f67bc0ae700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b40adc70 con 0x7f67b40d1410 2023-10-06T04:40:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.778+0000 7f67b9e4a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67b40d0350 0x7f67b40aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.778+0000 7f67b9e4a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67b40d0350 0x7f67b40aed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39236/0 (socket says 172.21.15.112:39236) 2023-10-06T04:40:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.778+0000 7f67b9e4a700 1 -- 172.21.15.112:0/4034461017 learned_addr learned my addr 172.21.15.112:0/4034461017 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.778+0000 7f67b9649700 1 --2- 172.21.15.112:0/4034461017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67b40d1410 0x7f67b40b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.778+0000 7f67ba64b700 1 --2- 172.21.15.112:0/4034461017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67b415cd20 0x7f67b40b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.778+0000 7f67b9e4a700 1 -- 172.21.15.112:0/4034461017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67b40d1410 msgr2=0x7f67b40b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.778+0000 7f67b9e4a700 1 --2- 172.21.15.112:0/4034461017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67b40d1410 0x7f67b40b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.778+0000 7f67b9e4a700 1 -- 172.21.15.112:0/4034461017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67b415cd20 msgr2=0x7f67b40b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.778+0000 7f67b9e4a700 1 --2- 172.21.15.112:0/4034461017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67b415cd20 0x7f67b40b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.778+0000 7f67b9e4a700 1 -- 172.21.15.112:0/4034461017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a8009a20 con 0x7f67b40d0350 2023-10-06T04:40:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.778+0000 7f67ba64b700 1 --2- 172.21.15.112:0/4034461017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67b415cd20 0x7f67b40b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.779+0000 7f67b9e4a700 1 --2- 172.21.15.112:0/4034461017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67b40d0350 0x7f67b40aed10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00c5b0 tx=0x7f67ac001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.779+0000 7f67b1ffb700 1 -- 172.21.15.112:0/4034461017 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac005b30 con 0x7f67b40d0350 2023-10-06T04:40:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.779+0000 7f67b1ffb700 1 -- 172.21.15.112:0/4034461017 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ac005c90 con 0x7f67b40d0350 2023-10-06T04:40:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.779+0000 7f67b1ffb700 1 -- 172.21.15.112:0/4034461017 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac007300 con 0x7f67b40d0350 2023-10-06T04:40:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.779+0000 7f67bc0ae700 1 -- 172.21.15.112:0/4034461017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b40adf50 con 0x7f67b40d0350 2023-10-06T04:40:00.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.779+0000 7f67bc0ae700 1 -- 172.21.15.112:0/4034461017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b40ae510 con 0x7f67b40d0350 2023-10-06T04:40:00.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.780+0000 7f67bc0ae700 1 -- 172.21.15.112:0/4034461017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b405f230 con 0x7f67b40d0350 2023-10-06T04:40:00.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.780+0000 7f67b1ffb700 1 -- 172.21.15.112:0/4034461017 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f67ac0076b0 con 0x7f67b40d0350 2023-10-06T04:40:00.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.780+0000 7f67b1ffb700 1 --2- 172.21.15.112:0/4034461017 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f67a0066f30 0x7f67a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:00.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.780+0000 7f67b1ffb700 1 -- 172.21.15.112:0/4034461017 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f67ac083810 con 0x7f67b40d0350 2023-10-06T04:40:00.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.780+0000 7f67b9649700 1 --2- 172.21.15.112:0/4034461017 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f67a0066f30 0x7f67a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:00.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.781+0000 7f67b9649700 1 --2- 172.21.15.112:0/4034461017 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f67a0066f30 0x7f67a00693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f67a8009fd0 tx=0x7f67a8019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:00.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:00.785+0000 7f67b1ffb700 1 -- 172.21.15.112:0/4034461017 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67ac050c70 con 0x7f67b40d0350 2023-10-06T04:40:01.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.043+0000 7f67bc0ae700 1 -- 172.21.15.112:0/4034461017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f67b40cef50 con 0x7f67b40d0350 2023-10-06T04:40:01.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.048+0000 7f67b1ffb700 1 -- 172.21.15.112:0/4034461017 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f67ac017020 con 0x7f67b40d0350 2023-10-06T04:40:01.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.050+0000 7f67bc0ae700 1 -- 172.21.15.112:0/4034461017 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f67a0066f30 msgr2=0x7f67a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.050+0000 7f67bc0ae700 1 --2- 172.21.15.112:0/4034461017 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f67a0066f30 0x7f67a00693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f67a8009fd0 tx=0x7f67a8019000 comp rx=0 tx=0).stop 2023-10-06T04:40:01.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.050+0000 7f67bc0ae700 1 -- 172.21.15.112:0/4034461017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67b40d0350 msgr2=0x7f67b40aed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.050+0000 7f67bc0ae700 1 --2- 172.21.15.112:0/4034461017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67b40d0350 0x7f67b40aed10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00c5b0 tx=0x7f67ac001070 comp rx=0 tx=0).stop 2023-10-06T04:40:01.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.050+0000 7f67bc0ae700 1 -- 172.21.15.112:0/4034461017 shutdown_connections 2023-10-06T04:40:01.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.050+0000 7f67bc0ae700 1 --2- 172.21.15.112:0/4034461017 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f67a0066f30 0x7f67a00693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.050+0000 7f67bc0ae700 1 --2- 172.21.15.112:0/4034461017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67b415cd20 0x7f67b40b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.050+0000 7f67bc0ae700 1 --2- 172.21.15.112:0/4034461017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67b40d0350 0x7f67b40aed10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.050+0000 7f67bc0ae700 1 --2- 172.21.15.112:0/4034461017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67b40d1410 0x7f67b40b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.050+0000 7f67bc0ae700 1 -- 172.21.15.112:0/4034461017 >> 172.21.15.112:0/4034461017 conn(0x7f67b406cfb0 msgr2=0x7f67b406dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:01.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.051+0000 7f67bc0ae700 1 -- 172.21.15.112:0/4034461017 shutdown_connections 2023-10-06T04:40:01.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.051+0000 7f67bc0ae700 1 -- 172.21.15.112:0/4034461017 wait complete. 2023-10-06T04:40:01.064 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T04:40:01.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.176+0000 7f3ab7281700 1 Processor -- start 2023-10-06T04:40:01.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.176+0000 7f3ab7281700 1 -- start start 2023-10-06T04:40:01.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.177+0000 7f3ab7281700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3ab015cd20 0x7f3ab00ad870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.177+0000 7f3ab7281700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3ab00d0350 0x7f3ab00addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.177+0000 7f3ab7281700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab00cf2c0 con 0x7f3ab00d1410 2023-10-06T04:40:01.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.177+0000 7f3ab7281700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab00cbd70 con 0x7f3ab015cd20 2023-10-06T04:40:01.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.177+0000 7f3ab7281700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab00cecb0 con 0x7f3ab00d0350 2023-10-06T04:40:01.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.177+0000 7f3ab501d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3ab015cd20 0x7f3ab00ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.177+0000 7f3ab481c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3ab00d1410 0x7f3ab00cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60880/0 (socket says 172.21.15.112:60880) 2023-10-06T04:40:01.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.177+0000 7f3ab481c700 1 -- 172.21.15.112:0/2737691540 learned_addr learned my addr 172.21.15.112:0/2737691540 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:01.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.178+0000 7f3ab501d700 1 -- 172.21.15.112:0/2737691540 >> v2:172.21.15.179:3300/0 conn(0x7f3ab00d0350 msgr2=0x7f3ab00addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:01.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.178+0000 7f3ab501d700 1 --2- 172.21.15.112:0/2737691540 >> v2:172.21.15.179:3300/0 conn(0x7f3ab00d0350 0x7f3ab00addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.178+0000 7f3ab501d700 1 -- 172.21.15.112:0/2737691540 >> v1:172.21.15.112:6789/0 conn(0x7f3ab00d1410 legacy=0x7f3ab00cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.178+0000 7f3ab501d700 1 -- 172.21.15.112:0/2737691540 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab00cbfc0 con 0x7f3ab015cd20 2023-10-06T04:40:01.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.178+0000 7f3aa7fff700 1 -- 172.21.15.112:0/2737691540 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1514125297 0 0) 0x7f3ab00cf2c0 con 0x7f3ab00d1410 2023-10-06T04:40:01.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.178+0000 7f3ab501d700 1 --2- 172.21.15.112:0/2737691540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab015cd20 0x7f3ab00ad870 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0088870 tx=0x7f3aac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb4072941b895c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:01.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.178+0000 7f3aa7fff700 1 -- 172.21.15.112:0/2737691540 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac00b6b0 con 0x7f3ab015cd20 2023-10-06T04:40:01.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.178+0000 7f3aa7fff700 1 -- 172.21.15.112:0/2737691540 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac00b830 con 0x7f3ab015cd20 2023-10-06T04:40:01.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.178+0000 7f3aa7fff700 1 -- 172.21.15.112:0/2737691540 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac00bbf0 con 0x7f3ab015cd20 2023-10-06T04:40:01.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.178+0000 7f3ab7281700 1 -- 172.21.15.112:0/2737691540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab015cd20 msgr2=0x7f3ab00ad870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.178+0000 7f3ab7281700 1 --2- 172.21.15.112:0/2737691540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab015cd20 0x7f3ab00ad870 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0088870 tx=0x7f3aac0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.179+0000 7f3ab7281700 1 -- 172.21.15.112:0/2737691540 shutdown_connections 2023-10-06T04:40:01.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.179+0000 7f3ab7281700 1 --2- 172.21.15.112:0/2737691540 >> v2:172.21.15.179:3300/0 conn(0x7f3ab00d0350 0x7f3ab00addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.179+0000 7f3ab7281700 1 --2- 172.21.15.112:0/2737691540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab015cd20 0x7f3ab00ad870 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.179+0000 7f3ab7281700 1 -- 172.21.15.112:0/2737691540 >> 172.21.15.112:0/2737691540 conn(0x7f3ab006cfb0 msgr2=0x7f3ab00d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:01.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.179+0000 7f3ab7281700 1 -- 172.21.15.112:0/2737691540 shutdown_connections 2023-10-06T04:40:01.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.179+0000 7f3ab7281700 1 -- 172.21.15.112:0/2737691540 wait complete. 2023-10-06T04:40:01.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.180+0000 7f3ab7281700 1 Processor -- start 2023-10-06T04:40:01.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.180+0000 7f3ab7281700 1 -- start start 2023-10-06T04:40:01.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3ab7281700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ab00d0350 0x7f3ab00b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3ab7281700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ab00d1410 0x7f3ab01543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3ab7281700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab015cd20 0x7f3ab00b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3ab7281700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00b4110 con 0x7f3ab015cd20 2023-10-06T04:40:01.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3ab7281700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00b43f0 con 0x7f3ab00d1410 2023-10-06T04:40:01.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3ab7281700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00b46d0 con 0x7f3ab00d0350 2023-10-06T04:40:01.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3ab581e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab015cd20 0x7f3ab00b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3ab581e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab015cd20 0x7f3ab00b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39252/0 (socket says 172.21.15.112:39252) 2023-10-06T04:40:01.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3ab581e700 1 -- 172.21.15.112:0/3427949718 learned_addr learned my addr 172.21.15.112:0/3427949718 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:01.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3ab581e700 1 -- 172.21.15.112:0/3427949718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ab00d0350 msgr2=0x7f3ab00b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3ab581e700 1 --2- 172.21.15.112:0/3427949718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ab00d0350 0x7f3ab00b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3ab581e700 1 -- 172.21.15.112:0/3427949718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ab00d1410 msgr2=0x7f3ab01543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3ab481c700 1 --2- 172.21.15.112:0/3427949718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ab00d1410 0x7f3ab01543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3ab581e700 1 --2- 172.21.15.112:0/3427949718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ab00d1410 0x7f3ab01543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3ab581e700 1 -- 172.21.15.112:0/3427949718 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac009420 con 0x7f3ab015cd20 2023-10-06T04:40:01.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3ab481c700 1 --2- 172.21.15.112:0/3427949718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ab00d1410 0x7f3ab01543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:01.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3ab581e700 1 --2- 172.21.15.112:0/3427949718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab015cd20 0x7f3ab00b3810 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3aa800bb30 tx=0x7f3aa80097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:01.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3aa57fa700 1 -- 172.21.15.112:0/3427949718 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa800c9d0 con 0x7f3ab015cd20 2023-10-06T04:40:01.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3aa57fa700 1 -- 172.21.15.112:0/3427949718 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa800cb70 con 0x7f3ab015cd20 2023-10-06T04:40:01.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3ab7281700 1 -- 172.21.15.112:0/3427949718 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab00b49b0 con 0x7f3ab015cd20 2023-10-06T04:40:01.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3aa57fa700 1 -- 172.21.15.112:0/3427949718 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8014410 con 0x7f3ab015cd20 2023-10-06T04:40:01.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.181+0000 7f3ab7281700 1 -- 172.21.15.112:0/3427949718 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab0154930 con 0x7f3ab015cd20 2023-10-06T04:40:01.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.182+0000 7f3ab7281700 1 -- 172.21.15.112:0/3427949718 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab00b4ed0 con 0x7f3ab015cd20 2023-10-06T04:40:01.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.183+0000 7f3aa57fa700 1 -- 172.21.15.112:0/3427949718 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3aa80147c0 con 0x7f3ab015cd20 2023-10-06T04:40:01.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.183+0000 7f3aa57fa700 1 --2- 172.21.15.112:0/3427949718 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3a94066f30 0x7f3a940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.183+0000 7f3ab501d700 1 --2- 172.21.15.112:0/3427949718 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3a94066f30 0x7f3a940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.183+0000 7f3aa57fa700 1 -- 172.21.15.112:0/3427949718 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3aa8084440 con 0x7f3ab015cd20 2023-10-06T04:40:01.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.184+0000 7f3ab501d700 1 --2- 172.21.15.112:0/3427949718 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3a94066f30 0x7f3a940693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0088870 tx=0x7f3aac017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:01.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.187+0000 7f3aa57fa700 1 -- 172.21.15.112:0/3427949718 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3aa804c5a0 con 0x7f3ab015cd20 2023-10-06T04:40:01.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.442+0000 7f3ab7281700 1 -- 172.21.15.112:0/3427949718 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f3ab005f230 con 0x7f3ab015cd20 2023-10-06T04:40:01.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.447+0000 7f3aa57fa700 1 -- 172.21.15.112:0/3427949718 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3ab00b4ed0 con 0x7f3ab015cd20 2023-10-06T04:40:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.449+0000 7f3ab7281700 1 -- 172.21.15.112:0/3427949718 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3a94066f30 msgr2=0x7f3a940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.449+0000 7f3ab7281700 1 --2- 172.21.15.112:0/3427949718 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3a94066f30 0x7f3a940693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0088870 tx=0x7f3aac017000 comp rx=0 tx=0).stop 2023-10-06T04:40:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.449+0000 7f3ab7281700 1 -- 172.21.15.112:0/3427949718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab015cd20 msgr2=0x7f3ab00b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.449+0000 7f3ab7281700 1 --2- 172.21.15.112:0/3427949718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab015cd20 0x7f3ab00b3810 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3aa800bb30 tx=0x7f3aa80097e0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.449+0000 7f3ab7281700 1 -- 172.21.15.112:0/3427949718 shutdown_connections 2023-10-06T04:40:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.449+0000 7f3ab7281700 1 --2- 172.21.15.112:0/3427949718 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3a94066f30 0x7f3a940693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.449+0000 7f3ab7281700 1 --2- 172.21.15.112:0/3427949718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab015cd20 0x7f3ab00b3810 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.449+0000 7f3ab7281700 1 --2- 172.21.15.112:0/3427949718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ab00d0350 0x7f3ab00b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.449+0000 7f3ab7281700 1 --2- 172.21.15.112:0/3427949718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ab00d1410 0x7f3ab01543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.449+0000 7f3ab7281700 1 -- 172.21.15.112:0/3427949718 >> 172.21.15.112:0/3427949718 conn(0x7f3ab006cfb0 msgr2=0x7f3ab01562e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:01.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.449+0000 7f3ab7281700 1 -- 172.21.15.112:0/3427949718 shutdown_connections 2023-10-06T04:40:01.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.449+0000 7f3ab7281700 1 -- 172.21.15.112:0/3427949718 wait complete. 2023-10-06T04:40:01.463 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T04:40:01.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.576+0000 7fc8a7b7d700 1 Processor -- start 2023-10-06T04:40:01.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.576+0000 7fc8a7b7d700 1 -- start start 2023-10-06T04:40:01.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.577+0000 7fc8a7b7d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a015cd20 0x7fc8a00ad870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.577+0000 7fc8a7b7d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc8a00d1410 0x7fc8a00addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.577+0000 7fc8a7b7d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc8a00d0350 0x7fc8a00cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.577+0000 7fc8a7b7d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a00cf2c0 con 0x7fc8a00d0350 2023-10-06T04:40:01.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.577+0000 7fc8a7b7d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a00cecb0 con 0x7fc8a00d1410 2023-10-06T04:40:01.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.577+0000 7fc8a7b7d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a00cbfc0 con 0x7fc8a015cd20 2023-10-06T04:40:01.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.577+0000 7fc8a611a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc8a00d0350 0x7fc8a00cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.577+0000 7fc8a611a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc8a00d0350 0x7fc8a00cf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39254/0 (socket says 172.21.15.112:39254) 2023-10-06T04:40:01.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.577+0000 7fc8a611a700 1 -- 172.21.15.112:0/646726290 learned_addr learned my addr 172.21.15.112:0/646726290 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:01.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.578+0000 7fc8a5919700 1 --2- 172.21.15.112:0/646726290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a015cd20 0x7fc8a00ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.578+0000 7fc8a5118700 1 --2- 172.21.15.112:0/646726290 >> v2:172.21.15.179:3300/0 conn(0x7fc8a00d1410 0x7fc8a00addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.578+0000 7fc8a611a700 1 -- 172.21.15.112:0/646726290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a015cd20 msgr2=0x7fc8a00ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:01.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.578+0000 7fc8a611a700 1 --2- 172.21.15.112:0/646726290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a015cd20 0x7fc8a00ad870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.578+0000 7fc8a611a700 1 -- 172.21.15.112:0/646726290 >> v2:172.21.15.179:3300/0 conn(0x7fc8a00d1410 msgr2=0x7fc8a00addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:01.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.578+0000 7fc8a611a700 1 --2- 172.21.15.112:0/646726290 >> v2:172.21.15.179:3300/0 conn(0x7fc8a00d1410 0x7fc8a00addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.578+0000 7fc8a611a700 1 -- 172.21.15.112:0/646726290 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a00cef50 con 0x7fc8a00d0350 2023-10-06T04:40:01.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.578+0000 7fc8a611a700 1 --2- 172.21.15.112:0/646726290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8a00d0350 0x7fc8a00cf750 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0089430 tx=0x7fc898009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65fdf689f09392c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:01.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.578+0000 7fc8a4917700 1 -- 172.21.15.112:0/646726290 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89800e070 con 0x7fc8a00d0350 2023-10-06T04:40:01.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.578+0000 7fc8a4917700 1 -- 172.21.15.112:0/646726290 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89800ba50 con 0x7fc8a00d0350 2023-10-06T04:40:01.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.578+0000 7fc8a4917700 1 -- 172.21.15.112:0/646726290 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8980092e0 con 0x7fc8a00d0350 2023-10-06T04:40:01.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.579+0000 7fc8a7b7d700 1 -- 172.21.15.112:0/646726290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8a00d0350 msgr2=0x7fc8a00cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.579+0000 7fc8a7b7d700 1 --2- 172.21.15.112:0/646726290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8a00d0350 0x7fc8a00cf750 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0089430 tx=0x7fc898009840 comp rx=0 tx=0).stop 2023-10-06T04:40:01.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.579+0000 7fc8a7b7d700 1 -- 172.21.15.112:0/646726290 shutdown_connections 2023-10-06T04:40:01.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.579+0000 7fc8a7b7d700 1 --2- 172.21.15.112:0/646726290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a015cd20 0x7fc8a00ad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.579+0000 7fc8a7b7d700 1 --2- 172.21.15.112:0/646726290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8a00d0350 0x7fc8a00cf750 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.579+0000 7fc8a7b7d700 1 --2- 172.21.15.112:0/646726290 >> v2:172.21.15.179:3300/0 conn(0x7fc8a00d1410 0x7fc8a00addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.579+0000 7fc8a7b7d700 1 -- 172.21.15.112:0/646726290 >> 172.21.15.112:0/646726290 conn(0x7fc8a006cfb0 msgr2=0x7fc8a00d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:01.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.579+0000 7fc8a7b7d700 1 -- 172.21.15.112:0/646726290 shutdown_connections 2023-10-06T04:40:01.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.579+0000 7fc8a7b7d700 1 -- 172.21.15.112:0/646726290 wait complete. 2023-10-06T04:40:01.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.580+0000 7fc8a7b7d700 1 Processor -- start 2023-10-06T04:40:01.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.580+0000 7fc8a7b7d700 1 -- start start 2023-10-06T04:40:01.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc8a7b7d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8a00d0350 0x7fc8a01560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc8a7b7d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8a00d1410 0x7fc8a014d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc8a7b7d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a015cd20 0x7fc8a00b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc8a7b7d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a00b1240 con 0x7fc8a00d0350 2023-10-06T04:40:01.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc8a7b7d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a00b0630 con 0x7fc8a00d1410 2023-10-06T04:40:01.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc8a7b7d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a00b0910 con 0x7fc8a015cd20 2023-10-06T04:40:01.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc8a5919700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8a00d0350 0x7fc8a01560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc8a5919700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8a00d0350 0x7fc8a01560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39258/0 (socket says 172.21.15.112:39258) 2023-10-06T04:40:01.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc8a5919700 1 -- 172.21.15.112:0/416217912 learned_addr learned my addr 172.21.15.112:0/416217912 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:01.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc8a611a700 1 --2- 172.21.15.112:0/416217912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a015cd20 0x7fc8a00b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc8a5118700 1 --2- 172.21.15.112:0/416217912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8a00d1410 0x7fc8a014d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc8a5919700 1 -- 172.21.15.112:0/416217912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a015cd20 msgr2=0x7fc8a00b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc8a5919700 1 --2- 172.21.15.112:0/416217912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a015cd20 0x7fc8a00b16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc8a5919700 1 -- 172.21.15.112:0/416217912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8a00d1410 msgr2=0x7fc8a014d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc8a5919700 1 --2- 172.21.15.112:0/416217912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8a00d1410 0x7fc8a014d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc8a5919700 1 -- 172.21.15.112:0/416217912 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc898009ae0 con 0x7fc8a00d0350 2023-10-06T04:40:01.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc8a611a700 1 --2- 172.21.15.112:0/416217912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a015cd20 0x7fc8a00b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:01.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc8a5919700 1 --2- 172.21.15.112:0/416217912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8a00d0350 0x7fc8a01560d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc89000d860 tx=0x7fc890008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:01.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc89dffb700 1 -- 172.21.15.112:0/416217912 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc890009610 con 0x7fc8a00d0350 2023-10-06T04:40:01.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc89dffb700 1 -- 172.21.15.112:0/416217912 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc890009770 con 0x7fc8a00d0350 2023-10-06T04:40:01.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc8a7b7d700 1 -- 172.21.15.112:0/416217912 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a00b0bf0 con 0x7fc8a00d0350 2023-10-06T04:40:01.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc89dffb700 1 -- 172.21.15.112:0/416217912 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc890009b30 con 0x7fc8a00d0350 2023-10-06T04:40:01.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.581+0000 7fc8a7b7d700 1 -- 172.21.15.112:0/416217912 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a0156610 con 0x7fc8a00d0350 2023-10-06T04:40:01.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.582+0000 7fc8a7b7d700 1 -- 172.21.15.112:0/416217912 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a005f230 con 0x7fc8a00d0350 2023-10-06T04:40:01.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.582+0000 7fc89dffb700 1 -- 172.21.15.112:0/416217912 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc89001e460 con 0x7fc8a00d0350 2023-10-06T04:40:01.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.583+0000 7fc89dffb700 1 --2- 172.21.15.112:0/416217912 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc88c066f30 0x7fc88c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.583+0000 7fc89dffb700 1 -- 172.21.15.112:0/416217912 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc8900849b0 con 0x7fc8a00d0350 2023-10-06T04:40:01.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.583+0000 7fc8a5118700 1 --2- 172.21.15.112:0/416217912 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc88c066f30 0x7fc88c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.583+0000 7fc8a5118700 1 --2- 172.21.15.112:0/416217912 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc88c066f30 0x7fc88c0693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00b6310 tx=0x7fc894008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:01.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.587+0000 7fc89dffb700 1 -- 172.21.15.112:0/416217912 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc890051e10 con 0x7fc8a00d0350 2023-10-06T04:40:01.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.848+0000 7fc8a7b7d700 1 -- 172.21.15.112:0/416217912 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fc8a00b1520 con 0x7fc8a00d0350 2023-10-06T04:40:01.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.853+0000 7fc89dffb700 1 -- 172.21.15.112:0/416217912 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc890055430 con 0x7fc8a00d0350 2023-10-06T04:40:01.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.855+0000 7fc8a7b7d700 1 -- 172.21.15.112:0/416217912 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc88c066f30 msgr2=0x7fc88c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.855+0000 7fc8a7b7d700 1 --2- 172.21.15.112:0/416217912 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc88c066f30 0x7fc88c0693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00b6310 tx=0x7fc894008040 comp rx=0 tx=0).stop 2023-10-06T04:40:01.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.855+0000 7fc8a7b7d700 1 -- 172.21.15.112:0/416217912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8a00d0350 msgr2=0x7fc8a01560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.855+0000 7fc8a7b7d700 1 --2- 172.21.15.112:0/416217912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8a00d0350 0x7fc8a01560d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc89000d860 tx=0x7fc890008040 comp rx=0 tx=0).stop 2023-10-06T04:40:01.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.855+0000 7fc8a7b7d700 1 -- 172.21.15.112:0/416217912 shutdown_connections 2023-10-06T04:40:01.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.855+0000 7fc8a7b7d700 1 --2- 172.21.15.112:0/416217912 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc88c066f30 0x7fc88c0693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.855+0000 7fc8a7b7d700 1 --2- 172.21.15.112:0/416217912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a015cd20 0x7fc8a00b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.855+0000 7fc8a7b7d700 1 --2- 172.21.15.112:0/416217912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8a00d0350 0x7fc8a01560d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.855+0000 7fc8a7b7d700 1 --2- 172.21.15.112:0/416217912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8a00d1410 0x7fc8a014d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.855+0000 7fc8a7b7d700 1 -- 172.21.15.112:0/416217912 >> 172.21.15.112:0/416217912 conn(0x7fc8a006cfb0 msgr2=0x7fc8a01587a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:01.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.855+0000 7fc8a7b7d700 1 -- 172.21.15.112:0/416217912 shutdown_connections 2023-10-06T04:40:01.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.855+0000 7fc8a7b7d700 1 -- 172.21.15.112:0/416217912 wait complete. 2023-10-06T04:40:01.869 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T04:40:01.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.982+0000 7fcc9b56b700 1 Processor -- start 2023-10-06T04:40:01.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.982+0000 7fcc9b56b700 1 -- start start 2023-10-06T04:40:01.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.983+0000 7fcc9b56b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcc94143270 0x7fcc940b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.983+0000 7fcc9b56b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcc940cd100 0x7fcc94159e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.983+0000 7fcc9b56b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc9415a360 con 0x7fcc9406d9a0 2023-10-06T04:40:01.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.983+0000 7fcc9b56b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc94143640 con 0x7fcc940cd100 2023-10-06T04:40:01.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.983+0000 7fcc9b56b700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc940cd650 con 0x7fcc94143270 2023-10-06T04:40:01.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.983+0000 7fcc99d68700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcc940cd100 0x7fcc94159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.983+0000 7fcc9ad6a700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fcc9406d9a0 0x7fcc940b4e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60888/0 (socket says 172.21.15.112:60888) 2023-10-06T04:40:01.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.983+0000 7fcc9ad6a700 1 -- 172.21.15.112:0/1403056997 learned_addr learned my addr 172.21.15.112:0/1403056997 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:01.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.983+0000 7fcc9a569700 1 --2- 172.21.15.112:0/1403056997 >> v2:172.21.15.179:3300/0 conn(0x7fcc94143270 0x7fcc940b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.983+0000 7fcc99d68700 1 -- 172.21.15.112:0/1403056997 >> v2:172.21.15.179:3300/0 conn(0x7fcc94143270 msgr2=0x7fcc940b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:01.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.983+0000 7fcc99d68700 1 --2- 172.21.15.112:0/1403056997 >> v2:172.21.15.179:3300/0 conn(0x7fcc94143270 0x7fcc940b64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.983+0000 7fcc99d68700 1 -- 172.21.15.112:0/1403056997 >> v1:172.21.15.112:6789/0 conn(0x7fcc9406d9a0 legacy=0x7fcc940b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.983+0000 7fcc99d68700 1 -- 172.21.15.112:0/1403056997 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc940b4350 con 0x7fcc940cd100 2023-10-06T04:40:01.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.983+0000 7fcc99567700 1 -- 172.21.15.112:0/1403056997 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834420297 0 0) 0x7fcc9415a360 con 0x7fcc9406d9a0 2023-10-06T04:40:01.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.983+0000 7fcc9a569700 1 --2- 172.21.15.112:0/1403056997 >> v2:172.21.15.179:3300/0 conn(0x7fcc94143270 0x7fcc940b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:01.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.983+0000 7fcc99d68700 1 --2- 172.21.15.112:0/1403056997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc940cd100 0x7fcc94159e20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcc9406f120 tx=0x7fcc880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1da026bd84468c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:01.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.983+0000 7fcc99567700 1 -- 172.21.15.112:0/1403056997 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8800b6b0 con 0x7fcc940cd100 2023-10-06T04:40:01.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.984+0000 7fcc99567700 1 -- 172.21.15.112:0/1403056997 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8800b810 con 0x7fcc940cd100 2023-10-06T04:40:01.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.984+0000 7fcc99567700 1 -- 172.21.15.112:0/1403056997 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8800bbb0 con 0x7fcc940cd100 2023-10-06T04:40:01.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.984+0000 7fcc9b56b700 1 -- 172.21.15.112:0/1403056997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc940cd100 msgr2=0x7fcc94159e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.984+0000 7fcc9b56b700 1 --2- 172.21.15.112:0/1403056997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc940cd100 0x7fcc94159e20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcc9406f120 tx=0x7fcc880091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.984+0000 7fcc9b56b700 1 -- 172.21.15.112:0/1403056997 shutdown_connections 2023-10-06T04:40:01.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.984+0000 7fcc9b56b700 1 --2- 172.21.15.112:0/1403056997 >> v2:172.21.15.179:3300/0 conn(0x7fcc94143270 0x7fcc940b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.984+0000 7fcc9b56b700 1 --2- 172.21.15.112:0/1403056997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc940cd100 0x7fcc94159e20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.984+0000 7fcc9b56b700 1 -- 172.21.15.112:0/1403056997 >> 172.21.15.112:0/1403056997 conn(0x7fcc9406d2a0 msgr2=0x7fcc940b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:01.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.984+0000 7fcc9b56b700 1 -- 172.21.15.112:0/1403056997 shutdown_connections 2023-10-06T04:40:01.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.984+0000 7fcc9b56b700 1 -- 172.21.15.112:0/1403056997 wait complete. 2023-10-06T04:40:01.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.985+0000 7fcc9b56b700 1 Processor -- start 2023-10-06T04:40:01.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.985+0000 7fcc9b56b700 1 -- start start 2023-10-06T04:40:01.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.986+0000 7fcc9b56b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc9406d9a0 0x7fcc9416a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.986+0000 7fcc9b56b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc940cd100 0x7fcc940c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.986+0000 7fcc9b56b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc94143270 0x7fcc9416c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.986+0000 7fcc9b56b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9415d330 con 0x7fcc940cd100 2023-10-06T04:40:01.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.986+0000 7fcc9b56b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9415dbd0 con 0x7fcc94143270 2023-10-06T04:40:01.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.986+0000 7fcc9b56b700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9416ab00 con 0x7fcc9406d9a0 2023-10-06T04:40:01.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.986+0000 7fcc99d68700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc940cd100 0x7fcc940c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.986+0000 7fcc99d68700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc940cd100 0x7fcc940c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39278/0 (socket says 172.21.15.112:39278) 2023-10-06T04:40:01.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.986+0000 7fcc99d68700 1 -- 172.21.15.112:0/20110771 learned_addr learned my addr 172.21.15.112:0/20110771 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:01.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.986+0000 7fcc9a569700 1 --2- 172.21.15.112:0/20110771 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc9406d9a0 0x7fcc9416a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.986+0000 7fcc9ad6a700 1 --2- 172.21.15.112:0/20110771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc94143270 0x7fcc9416c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.986+0000 7fcc99d68700 1 -- 172.21.15.112:0/20110771 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc9406d9a0 msgr2=0x7fcc9416a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.986+0000 7fcc99d68700 1 --2- 172.21.15.112:0/20110771 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc9406d9a0 0x7fcc9416a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.986+0000 7fcc99d68700 1 -- 172.21.15.112:0/20110771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc94143270 msgr2=0x7fcc9416c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:01.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.986+0000 7fcc99d68700 1 --2- 172.21.15.112:0/20110771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc94143270 0x7fcc9416c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:01.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.986+0000 7fcc99d68700 1 -- 172.21.15.112:0/20110771 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc88009420 con 0x7fcc940cd100 2023-10-06T04:40:01.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.987+0000 7fcc99d68700 1 --2- 172.21.15.112:0/20110771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc940cd100 0x7fcc940c6540 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcc94063c90 tx=0x7fcc88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:01.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.987+0000 7fcc927fc700 1 -- 172.21.15.112:0/20110771 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc88011420 con 0x7fcc940cd100 2023-10-06T04:40:01.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.987+0000 7fcc927fc700 1 -- 172.21.15.112:0/20110771 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc880115a0 con 0x7fcc940cd100 2023-10-06T04:40:01.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.987+0000 7fcc9b56b700 1 -- 172.21.15.112:0/20110771 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc940c6d90 con 0x7fcc940cd100 2023-10-06T04:40:01.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.987+0000 7fcc927fc700 1 -- 172.21.15.112:0/20110771 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc88011960 con 0x7fcc940cd100 2023-10-06T04:40:01.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.987+0000 7fcc9b56b700 1 -- 172.21.15.112:0/20110771 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9415d860 con 0x7fcc940cd100 2023-10-06T04:40:01.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.988+0000 7fcc9b56b700 1 -- 172.21.15.112:0/20110771 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9415dd40 con 0x7fcc940cd100 2023-10-06T04:40:01.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.989+0000 7fcc927fc700 1 -- 172.21.15.112:0/20110771 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc88011d50 con 0x7fcc940cd100 2023-10-06T04:40:01.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.989+0000 7fcc927fc700 1 --2- 172.21.15.112:0/20110771 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcc80066f30 0x7fcc800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:01.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.989+0000 7fcc927fc700 1 -- 172.21.15.112:0/20110771 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fcc88086560 con 0x7fcc940cd100 2023-10-06T04:40:01.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.989+0000 7fcc9a569700 1 --2- 172.21.15.112:0/20110771 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcc80066f30 0x7fcc800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:01.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.989+0000 7fcc9a569700 1 --2- 172.21.15.112:0/20110771 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcc80066f30 0x7fcc800693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcc940d0f60 tx=0x7fcc8c007670 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:01.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:01.992+0000 7fcc927fc700 1 -- 172.21.15.112:0/20110771 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc88053a80 con 0x7fcc940cd100 2023-10-06T04:40:02.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.253+0000 7fcc9b56b700 1 -- 172.21.15.112:0/20110771 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fcc9405f230 con 0x7fcc940cd100 2023-10-06T04:40:02.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.259+0000 7fcc927fc700 1 -- 172.21.15.112:0/20110771 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcc880150a0 con 0x7fcc940cd100 2023-10-06T04:40:02.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.261+0000 7fcc9b56b700 1 -- 172.21.15.112:0/20110771 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcc80066f30 msgr2=0x7fcc800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.261+0000 7fcc9b56b700 1 --2- 172.21.15.112:0/20110771 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcc80066f30 0x7fcc800693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcc940d0f60 tx=0x7fcc8c007670 comp rx=0 tx=0).stop 2023-10-06T04:40:02.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.261+0000 7fcc9b56b700 1 -- 172.21.15.112:0/20110771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc940cd100 msgr2=0x7fcc940c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.261+0000 7fcc9b56b700 1 --2- 172.21.15.112:0/20110771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc940cd100 0x7fcc940c6540 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcc94063c90 tx=0x7fcc88017000 comp rx=0 tx=0).stop 2023-10-06T04:40:02.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.261+0000 7fcc9b56b700 1 -- 172.21.15.112:0/20110771 shutdown_connections 2023-10-06T04:40:02.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.261+0000 7fcc9b56b700 1 --2- 172.21.15.112:0/20110771 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcc80066f30 0x7fcc800693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.261+0000 7fcc9b56b700 1 --2- 172.21.15.112:0/20110771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc94143270 0x7fcc9416c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.261+0000 7fcc9b56b700 1 --2- 172.21.15.112:0/20110771 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc9406d9a0 0x7fcc9416a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.261+0000 7fcc9b56b700 1 --2- 172.21.15.112:0/20110771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc940cd100 0x7fcc940c6540 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.261+0000 7fcc9b56b700 1 -- 172.21.15.112:0/20110771 >> 172.21.15.112:0/20110771 conn(0x7fcc9406d2a0 msgr2=0x7fcc9406de20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:02.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.261+0000 7fcc9b56b700 1 -- 172.21.15.112:0/20110771 shutdown_connections 2023-10-06T04:40:02.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.261+0000 7fcc9b56b700 1 -- 172.21.15.112:0/20110771 wait complete. 2023-10-06T04:40:02.275 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T04:40:02.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.387+0000 7fba1ca6f700 1 Processor -- start 2023-10-06T04:40:02.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.387+0000 7fba1ca6f700 1 -- start start 2023-10-06T04:40:02.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.388+0000 7fba1ca6f700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba18068350 0x7fba18159850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.388+0000 7fba1ca6f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba18158b90 con 0x7fba181580b0 2023-10-06T04:40:02.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.388+0000 7fba1ca6f700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1815b5e0 con 0x7fba18067eb0 2023-10-06T04:40:02.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.388+0000 7fba1ca6f700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1815c1f0 con 0x7fba18068350 2023-10-06T04:40:02.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.388+0000 7fba1659c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fba181580b0 0x7fba18158480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60896/0 (socket says 172.21.15.112:60896) 2023-10-06T04:40:02.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.388+0000 7fba1659c700 1 -- 172.21.15.112:0/3076034229 learned_addr learned my addr 172.21.15.112:0/3076034229 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:02.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.388+0000 7fba16d9d700 1 --2- 172.21.15.112:0/3076034229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba18068350 0x7fba18159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.388+0000 7fba15d9b700 1 -- 172.21.15.112:0/3076034229 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207834988 0 0) 0x7fba18158b90 con 0x7fba181580b0 2023-10-06T04:40:02.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba15d9b700 1 -- 172.21.15.112:0/3076034229 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba04003570 con 0x7fba181580b0 2023-10-06T04:40:02.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba15d9b700 1 -- 172.21.15.112:0/3076034229 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827344671 0 0) 0x7fba1815b5e0 con 0x7fba18067eb0 2023-10-06T04:40:02.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba15d9b700 1 -- 172.21.15.112:0/3076034229 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba18158b90 con 0x7fba18067eb0 2023-10-06T04:40:02.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba15d9b700 1 -- 172.21.15.112:0/3076034229 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2609752899 0 0) 0x7fba04003570 con 0x7fba181580b0 2023-10-06T04:40:02.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba15d9b700 1 -- 172.21.15.112:0/3076034229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba18068350 msgr2=0x7fba18159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:02.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba15d9b700 1 --2- 172.21.15.112:0/3076034229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba18068350 0x7fba18159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba15d9b700 1 -- 172.21.15.112:0/3076034229 >> v1:172.21.15.179:6789/0 conn(0x7fba18067eb0 legacy=0x7fba18159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba15d9b700 1 -- 172.21.15.112:0/3076034229 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1815b8c0 con 0x7fba181580b0 2023-10-06T04:40:02.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba15d9b700 1 -- 172.21.15.112:0/3076034229 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7fba08001470 con 0x7fba181580b0 2023-10-06T04:40:02.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba15d9b700 1 -- 172.21.15.112:0/3076034229 >> v1:172.21.15.112:6789/0 conn(0x7fba181580b0 legacy=0x7fba18158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba15d9b700 1 --2- 172.21.15.112:0/3076034229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba04003c20 0x7fba04004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba15d9b700 1 --2- 172.21.15.112:0/3076034229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba04004810 0x7fba04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba15d9b700 1 --2- 172.21.15.112:0/3076034229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba18068350 0x7fba040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba15d9b700 1 -- 172.21.15.112:0/3076034229 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1815c1f0 con 0x7fba04004810 2023-10-06T04:40:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba15d9b700 1 -- 172.21.15.112:0/3076034229 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0400bb40 con 0x7fba04003c20 2023-10-06T04:40:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba15d9b700 1 -- 172.21.15.112:0/3076034229 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0400bd00 con 0x7fba18068350 2023-10-06T04:40:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba0dd9b700 1 --2- 172.21.15.112:0/3076034229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba04004810 0x7fba04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba1659c700 1 --2- 172.21.15.112:0/3076034229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba04003c20 0x7fba04004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba16d9d700 1 --2- 172.21.15.112:0/3076034229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba18068350 0x7fba040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba0dd9b700 1 -- 172.21.15.112:0/3076034229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba18068350 msgr2=0x7fba040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba0dd9b700 1 --2- 172.21.15.112:0/3076034229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba18068350 0x7fba040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba0dd9b700 1 -- 172.21.15.112:0/3076034229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba04003c20 msgr2=0x7fba04004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba0dd9b700 1 --2- 172.21.15.112:0/3076034229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba04003c20 0x7fba04004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba0dd9b700 1 -- 172.21.15.112:0/3076034229 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba04003570 con 0x7fba04004810 2023-10-06T04:40:02.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba1659c700 1 --2- 172.21.15.112:0/3076034229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba04003c20 0x7fba04004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:02.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba0dd9b700 1 --2- 172.21.15.112:0/3076034229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba04004810 0x7fba04004c80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fba00001a50 tx=0x7fba00007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1de0b7c8a4928a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:02.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba15d9b700 1 -- 172.21.15.112:0/3076034229 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0000c5d0 con 0x7fba04004810 2023-10-06T04:40:02.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba15d9b700 1 -- 172.21.15.112:0/3076034229 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0000c730 con 0x7fba04004810 2023-10-06T04:40:02.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.389+0000 7fba15d9b700 1 -- 172.21.15.112:0/3076034229 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0000cad0 con 0x7fba04004810 2023-10-06T04:40:02.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.390+0000 7fba1ca6f700 1 -- 172.21.15.112:0/3076034229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba04004810 msgr2=0x7fba04004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.390+0000 7fba1ca6f700 1 --2- 172.21.15.112:0/3076034229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba04004810 0x7fba04004c80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fba00001a50 tx=0x7fba00007d30 comp rx=0 tx=0).stop 2023-10-06T04:40:02.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.390+0000 7fba16d9d700 1 -- 172.21.15.112:0/3076034229 reap_dead start 2023-10-06T04:40:02.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.390+0000 7fba1ca6f700 1 -- 172.21.15.112:0/3076034229 shutdown_connections 2023-10-06T04:40:02.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.390+0000 7fba1ca6f700 1 -- 172.21.15.112:0/3076034229 >> 172.21.15.112:0/3076034229 conn(0x7fba180ce5c0 msgr2=0x7fba180ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:02.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.390+0000 7fba1ca6f700 1 -- 172.21.15.112:0/3076034229 shutdown_connections 2023-10-06T04:40:02.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.390+0000 7fba1ca6f700 1 -- 172.21.15.112:0/3076034229 wait complete. 2023-10-06T04:40:02.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.391+0000 7fba1ca6f700 1 Processor -- start 2023-10-06T04:40:02.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.391+0000 7fba1ca6f700 1 -- start start 2023-10-06T04:40:02.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.392+0000 7fba1ca6f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba04004810 0x7fba180c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.392+0000 7fba1ca6f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba180c34f0 0x7fba1814bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.392+0000 7fba1ca6f700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba18153fa0 0x7fba18154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.392+0000 7fba1ca6f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba18154950 con 0x7fba04004810 2023-10-06T04:40:02.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.392+0000 7fba1ca6f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba180c7e10 con 0x7fba180c34f0 2023-10-06T04:40:02.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.392+0000 7fba1ca6f700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba180c3960 con 0x7fba18153fa0 2023-10-06T04:40:02.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.392+0000 7fba1659c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba04004810 0x7fba180c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.392+0000 7fba1659c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba04004810 0x7fba180c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39310/0 (socket says 172.21.15.112:39310) 2023-10-06T04:40:02.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.392+0000 7fba1659c700 1 -- 172.21.15.112:0/1329790075 learned_addr learned my addr 172.21.15.112:0/1329790075 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:02.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.392+0000 7fba0dd9b700 1 --2- 172.21.15.112:0/1329790075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba180c34f0 0x7fba1814bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.392+0000 7fba16d9d700 1 --2- 172.21.15.112:0/1329790075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba18153fa0 0x7fba18154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.392+0000 7fba1659c700 1 -- 172.21.15.112:0/1329790075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba18153fa0 msgr2=0x7fba18154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.392+0000 7fba1659c700 1 --2- 172.21.15.112:0/1329790075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba18153fa0 0x7fba18154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.392+0000 7fba1659c700 1 -- 172.21.15.112:0/1329790075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba180c34f0 msgr2=0x7fba1814bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.392+0000 7fba1659c700 1 --2- 172.21.15.112:0/1329790075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba180c34f0 0x7fba1814bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.392+0000 7fba1659c700 1 -- 172.21.15.112:0/1329790075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba180c7200 con 0x7fba04004810 2023-10-06T04:40:02.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.392+0000 7fba16d9d700 1 --2- 172.21.15.112:0/1329790075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba18153fa0 0x7fba18154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:02.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.393+0000 7fba1659c700 1 --2- 172.21.15.112:0/1329790075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba04004810 0x7fba180c6b70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fba0800ebc0 tx=0x7fba08000c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:02.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.393+0000 7fba0effd700 1 -- 172.21.15.112:0/1329790075 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0800c760 con 0x7fba04004810 2023-10-06T04:40:02.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.393+0000 7fba0effd700 1 -- 172.21.15.112:0/1329790075 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0800c8c0 con 0x7fba04004810 2023-10-06T04:40:02.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.393+0000 7fba1ca6f700 1 -- 172.21.15.112:0/1329790075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba180c74e0 con 0x7fba04004810 2023-10-06T04:40:02.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.393+0000 7fba0effd700 1 -- 172.21.15.112:0/1329790075 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0800cc80 con 0x7fba04004810 2023-10-06T04:40:02.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.393+0000 7fba1ca6f700 1 -- 172.21.15.112:0/1329790075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba180c7aa0 con 0x7fba04004810 2023-10-06T04:40:02.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.394+0000 7fba1ca6f700 1 -- 172.21.15.112:0/1329790075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1805f230 con 0x7fba04004810 2023-10-06T04:40:02.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.394+0000 7fba0effd700 1 -- 172.21.15.112:0/1329790075 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba0801d460 con 0x7fba04004810 2023-10-06T04:40:02.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.394+0000 7fba0effd700 1 --2- 172.21.15.112:0/1329790075 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb9f8066f30 0x7fb9f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.395+0000 7fba0effd700 1 -- 172.21.15.112:0/1329790075 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fba080842a0 con 0x7fba04004810 2023-10-06T04:40:02.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.395+0000 7fba0dd9b700 1 --2- 172.21.15.112:0/1329790075 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb9f8066f30 0x7fb9f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.395+0000 7fba0dd9b700 1 --2- 172.21.15.112:0/1329790075 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb9f8066f30 0x7fb9f80693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fba18157b10 tx=0x7fba00015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:02.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.399+0000 7fba0effd700 1 -- 172.21.15.112:0/1329790075 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba08051700 con 0x7fba04004810 2023-10-06T04:40:02.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.660+0000 7fba1ca6f700 1 -- 172.21.15.112:0/1329790075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fba1815bba0 con 0x7fba04004810 2023-10-06T04:40:02.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.665+0000 7fba0effd700 1 -- 172.21.15.112:0/1329790075 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fba08054d20 con 0x7fba04004810 2023-10-06T04:40:02.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.668+0000 7fba1ca6f700 1 -- 172.21.15.112:0/1329790075 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb9f8066f30 msgr2=0x7fb9f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.668+0000 7fba1ca6f700 1 --2- 172.21.15.112:0/1329790075 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb9f8066f30 0x7fb9f80693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fba18157b10 tx=0x7fba00015000 comp rx=0 tx=0).stop 2023-10-06T04:40:02.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.668+0000 7fba1ca6f700 1 -- 172.21.15.112:0/1329790075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba04004810 msgr2=0x7fba180c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.668+0000 7fba1ca6f700 1 --2- 172.21.15.112:0/1329790075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba04004810 0x7fba180c6b70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fba0800ebc0 tx=0x7fba08000c30 comp rx=0 tx=0).stop 2023-10-06T04:40:02.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.668+0000 7fba1ca6f700 1 -- 172.21.15.112:0/1329790075 shutdown_connections 2023-10-06T04:40:02.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.668+0000 7fba1ca6f700 1 --2- 172.21.15.112:0/1329790075 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb9f8066f30 0x7fb9f80693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.668+0000 7fba1ca6f700 1 --2- 172.21.15.112:0/1329790075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba18153fa0 0x7fba18154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.668+0000 7fba1ca6f700 1 --2- 172.21.15.112:0/1329790075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba04004810 0x7fba180c6b70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.668+0000 7fba1ca6f700 1 --2- 172.21.15.112:0/1329790075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba180c34f0 0x7fba1814bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.668+0000 7fba1ca6f700 1 -- 172.21.15.112:0/1329790075 >> 172.21.15.112:0/1329790075 conn(0x7fba180ce5c0 msgr2=0x7fba1815a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:02.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.668+0000 7fba1ca6f700 1 -- 172.21.15.112:0/1329790075 shutdown_connections 2023-10-06T04:40:02.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.668+0000 7fba1ca6f700 1 -- 172.21.15.112:0/1329790075 wait complete. 2023-10-06T04:40:02.682 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:02.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.795+0000 7f98c3283700 1 Processor -- start 2023-10-06T04:40:02.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.796+0000 7f98c3283700 1 -- start start 2023-10-06T04:40:02.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.796+0000 7f98c3283700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f98bc15aa00 0x7f98bc1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.796+0000 7f98c3283700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98bc06a4b0 con 0x7f98bc067eb0 2023-10-06T04:40:02.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.796+0000 7f98c3283700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98bc158b30 con 0x7f98bc15a020 2023-10-06T04:40:02.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.796+0000 7f98c3283700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98bc15b500 con 0x7f98bc15aa00 2023-10-06T04:40:02.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.797+0000 7f98c081e700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f98bc067eb0 0x7f98bc069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60902/0 (socket says 172.21.15.112:60902) 2023-10-06T04:40:02.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.797+0000 7f98c081e700 1 -- 172.21.15.112:0/2126252356 learned_addr learned my addr 172.21.15.112:0/2126252356 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:02.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.797+0000 7f98b3fff700 1 -- 172.21.15.112:0/2126252356 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784291263 0 0) 0x7f98bc06a4b0 con 0x7f98bc067eb0 2023-10-06T04:40:02.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.797+0000 7f98c101f700 1 --2- 172.21.15.112:0/2126252356 >> v2:172.21.15.179:3300/0 conn(0x7f98bc15aa00 0x7f98bc1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.797+0000 7f98b3fff700 1 -- 172.21.15.112:0/2126252356 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98a8003570 con 0x7f98bc067eb0 2023-10-06T04:40:02.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.797+0000 7f98b3fff700 1 -- 172.21.15.112:0/2126252356 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 776049310 0 0) 0x7f98a8003570 con 0x7f98bc067eb0 2023-10-06T04:40:02.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.797+0000 7f98b3fff700 1 -- 172.21.15.112:0/2126252356 >> v2:172.21.15.179:3300/0 conn(0x7f98bc15aa00 msgr2=0x7f98bc1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:02.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.797+0000 7f98b3fff700 1 --2- 172.21.15.112:0/2126252356 >> v2:172.21.15.179:3300/0 conn(0x7f98bc15aa00 0x7f98bc1585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.797+0000 7f98b3fff700 1 -- 172.21.15.112:0/2126252356 >> v1:172.21.15.179:6789/0 conn(0x7f98bc15a020 legacy=0x7f98bc069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.797+0000 7f98b3fff700 1 -- 172.21.15.112:0/2126252356 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98bc15b7e0 con 0x7f98bc067eb0 2023-10-06T04:40:02.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.797+0000 7f98b3fff700 1 -- 172.21.15.112:0/2126252356 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f98ac001470 con 0x7f98bc067eb0 2023-10-06T04:40:02.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.797+0000 7f98b3fff700 1 -- 172.21.15.112:0/2126252356 >> v1:172.21.15.112:6789/0 conn(0x7f98bc067eb0 legacy=0x7f98bc069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.797+0000 7f98b3fff700 1 --2- 172.21.15.112:0/2126252356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98a8003a60 0x7f98a8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.797+0000 7f98b3fff700 1 --2- 172.21.15.112:0/2126252356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98a8004810 0x7f98a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.797+0000 7f98b3fff700 1 --2- 172.21.15.112:0/2126252356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98a80051c0 0x7f98a800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.797+0000 7f98b3fff700 1 -- 172.21.15.112:0/2126252356 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc15b500 con 0x7f98a8003a60 2023-10-06T04:40:02.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.797+0000 7f98b3fff700 1 -- 172.21.15.112:0/2126252356 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a800c0d0 con 0x7f98a80051c0 2023-10-06T04:40:02.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.797+0000 7f98b3fff700 1 -- 172.21.15.112:0/2126252356 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a800c290 con 0x7f98a8004810 2023-10-06T04:40:02.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.797+0000 7f98c101f700 1 --2- 172.21.15.112:0/2126252356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98a8003a60 0x7f98a8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.797+0000 7f98c081e700 1 --2- 172.21.15.112:0/2126252356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98a8004810 0x7f98a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.797+0000 7f98c1820700 1 --2- 172.21.15.112:0/2126252356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98a80051c0 0x7f98a800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.798+0000 7f98c101f700 1 -- 172.21.15.112:0/2126252356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98a8004810 msgr2=0x7f98a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:02.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.798+0000 7f98c101f700 1 --2- 172.21.15.112:0/2126252356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98a8004810 0x7f98a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.798+0000 7f98c101f700 1 -- 172.21.15.112:0/2126252356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98a80051c0 msgr2=0x7f98a800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:02.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.798+0000 7f98c101f700 1 --2- 172.21.15.112:0/2126252356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98a80051c0 0x7f98a800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.798+0000 7f98c101f700 1 -- 172.21.15.112:0/2126252356 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a8003570 con 0x7f98a8003a60 2023-10-06T04:40:02.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.798+0000 7f98c1820700 1 -- 172.21.15.112:0/2126252356 reap_dead start 2023-10-06T04:40:02.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.798+0000 7f98c101f700 1 --2- 172.21.15.112:0/2126252356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98a8003a60 0x7f98a8003e70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f98b8009c00 tx=0x7f98b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd66a9cb8893695 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:02.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.798+0000 7f98b3fff700 1 -- 172.21.15.112:0/2126252356 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b800e710 con 0x7f98a8003a60 2023-10-06T04:40:02.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.798+0000 7f98b3fff700 1 -- 172.21.15.112:0/2126252356 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b800e870 con 0x7f98a8003a60 2023-10-06T04:40:02.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.798+0000 7f98b3fff700 1 -- 172.21.15.112:0/2126252356 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b800ec30 con 0x7f98a8003a60 2023-10-06T04:40:02.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.798+0000 7f98c3283700 1 -- 172.21.15.112:0/2126252356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98a8003a60 msgr2=0x7f98a8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.798+0000 7f98c3283700 1 --2- 172.21.15.112:0/2126252356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98a8003a60 0x7f98a8003e70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f98b8009c00 tx=0x7f98b80091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.798+0000 7f98c3283700 1 -- 172.21.15.112:0/2126252356 shutdown_connections 2023-10-06T04:40:02.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.798+0000 7f98c3283700 1 --2- 172.21.15.112:0/2126252356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98a8003a60 0x7f98a8003e70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.798+0000 7f98c3283700 1 -- 172.21.15.112:0/2126252356 >> 172.21.15.112:0/2126252356 conn(0x7f98bc0ce5e0 msgr2=0x7f98bc0ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:02.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.798+0000 7f98c3283700 1 -- 172.21.15.112:0/2126252356 shutdown_connections 2023-10-06T04:40:02.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.798+0000 7f98c3283700 1 -- 172.21.15.112:0/2126252356 wait complete. 2023-10-06T04:40:02.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.799+0000 7f98c3283700 1 Processor -- start 2023-10-06T04:40:02.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.800+0000 7f98c3283700 1 -- start start 2023-10-06T04:40:02.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.800+0000 7f98c3283700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98a8003a60 0x7f98bc0a6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.800+0000 7f98c3283700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98bc0c3f20 0x7f98bc0c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.800+0000 7f98c3283700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98bc0c7b80 0x7f98bc0c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.800+0000 7f98c3283700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc167500 con 0x7f98bc0c7b80 2023-10-06T04:40:02.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.800+0000 7f98c3283700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc0c8560 con 0x7f98bc0c3f20 2023-10-06T04:40:02.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.800+0000 7f98c3283700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc0c6e00 con 0x7f98a8003a60 2023-10-06T04:40:02.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.801+0000 7f98c1820700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98bc0c7b80 0x7f98bc0c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.801+0000 7f98c1820700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98bc0c7b80 0x7f98bc0c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39334/0 (socket says 172.21.15.112:39334) 2023-10-06T04:40:02.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.801+0000 7f98c1820700 1 -- 172.21.15.112:0/619537925 learned_addr learned my addr 172.21.15.112:0/619537925 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:02.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.801+0000 7f98c101f700 1 --2- 172.21.15.112:0/619537925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98a8003a60 0x7f98bc0a6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.801+0000 7f98c081e700 1 --2- 172.21.15.112:0/619537925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98bc0c3f20 0x7f98bc0c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.801+0000 7f98c1820700 1 -- 172.21.15.112:0/619537925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98a8003a60 msgr2=0x7f98bc0a6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.801+0000 7f98c1820700 1 --2- 172.21.15.112:0/619537925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98a8003a60 0x7f98bc0a6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.801+0000 7f98c1820700 1 -- 172.21.15.112:0/619537925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98bc0c3f20 msgr2=0x7f98bc0c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.801+0000 7f98c1820700 1 --2- 172.21.15.112:0/619537925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98bc0c3f20 0x7f98bc0c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.801+0000 7f98c1820700 1 -- 172.21.15.112:0/619537925 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98bc0c70e0 con 0x7f98bc0c7b80 2023-10-06T04:40:02.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.801+0000 7f98c101f700 1 --2- 172.21.15.112:0/619537925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98a8003a60 0x7f98bc0a6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:02.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.801+0000 7f98c1820700 1 --2- 172.21.15.112:0/619537925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98bc0c7b80 0x7f98bc0c8020 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f98bc06b7e0 tx=0x7f98b4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:02.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.801+0000 7f98b17fa700 1 -- 172.21.15.112:0/619537925 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b4006db0 con 0x7f98bc0c7b80 2023-10-06T04:40:02.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.801+0000 7f98b17fa700 1 -- 172.21.15.112:0/619537925 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b4003030 con 0x7f98bc0c7b80 2023-10-06T04:40:02.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.801+0000 7f98b17fa700 1 -- 172.21.15.112:0/619537925 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b40033f0 con 0x7f98bc0c7b80 2023-10-06T04:40:02.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.801+0000 7f98c3283700 1 -- 172.21.15.112:0/619537925 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98bc0c73c0 con 0x7f98bc0c7b80 2023-10-06T04:40:02.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.801+0000 7f98c3283700 1 -- 172.21.15.112:0/619537925 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98bc0c4390 con 0x7f98bc0c7b80 2023-10-06T04:40:02.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.802+0000 7f98c3283700 1 -- 172.21.15.112:0/619537925 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98bc167650 con 0x7f98bc0c7b80 2023-10-06T04:40:02.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.802+0000 7f98b17fa700 1 -- 172.21.15.112:0/619537925 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98b4001790 con 0x7f98bc0c7b80 2023-10-06T04:40:02.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.803+0000 7f98b17fa700 1 --2- 172.21.15.112:0/619537925 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f98a0066f30 0x7f98a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:02.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.803+0000 7f98b17fa700 1 -- 172.21.15.112:0/619537925 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f98b4083290 con 0x7f98bc0c7b80 2023-10-06T04:40:02.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.803+0000 7f98c101f700 1 --2- 172.21.15.112:0/619537925 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f98a0066f30 0x7f98a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:02.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.803+0000 7f98c101f700 1 --2- 172.21.15.112:0/619537925 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f98a0066f30 0x7f98a00693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f98b80091e0 tx=0x7f98b801a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:02.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.807+0000 7f98b17fa700 1 -- 172.21.15.112:0/619537925 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98bc167650 con 0x7f98bc0c7b80 2023-10-06T04:40:02.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.990+0000 7f98c3283700 1 -- 172.21.15.112:0/619537925 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98bc05f230 con 0x7f98bc0c7b80 2023-10-06T04:40:02.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.991+0000 7f98b17fa700 1 -- 172.21.15.112:0/619537925 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+13698 (secure 0 0 0) 0x7f98b401d090 con 0x7f98bc0c7b80 2023-10-06T04:40:02.994 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:02.994 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":27,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:39:59.832474+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:02.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.993+0000 7f98c3283700 1 -- 172.21.15.112:0/619537925 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f98a0066f30 msgr2=0x7f98a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.993+0000 7f98c3283700 1 --2- 172.21.15.112:0/619537925 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f98a0066f30 0x7f98a00693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f98b80091e0 tx=0x7f98b801a000 comp rx=0 tx=0).stop 2023-10-06T04:40:02.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.993+0000 7f98c3283700 1 -- 172.21.15.112:0/619537925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98bc0c7b80 msgr2=0x7f98bc0c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:02.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.993+0000 7f98c3283700 1 --2- 172.21.15.112:0/619537925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98bc0c7b80 0x7f98bc0c8020 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f98bc06b7e0 tx=0x7f98b4009040 comp rx=0 tx=0).stop 2023-10-06T04:40:02.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.993+0000 7f98c3283700 1 -- 172.21.15.112:0/619537925 shutdown_connections 2023-10-06T04:40:02.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.993+0000 7f98c3283700 1 --2- 172.21.15.112:0/619537925 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f98a0066f30 0x7f98a00693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.993+0000 7f98c3283700 1 --2- 172.21.15.112:0/619537925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98bc0c7b80 0x7f98bc0c8020 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.993+0000 7f98c3283700 1 --2- 172.21.15.112:0/619537925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98a8003a60 0x7f98bc0a6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.993+0000 7f98c3283700 1 --2- 172.21.15.112:0/619537925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98bc0c3f20 0x7f98bc0c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:02.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.993+0000 7f98c3283700 1 -- 172.21.15.112:0/619537925 >> 172.21.15.112:0/619537925 conn(0x7f98bc0ce5e0 msgr2=0x7f98bc0c4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:02.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.994+0000 7f98c3283700 1 -- 172.21.15.112:0/619537925 shutdown_connections 2023-10-06T04:40:02.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:02.994+0000 7f98c3283700 1 -- 172.21.15.112:0/619537925 wait complete. 2023-10-06T04:40:03.008 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:13.929254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:39:14.321892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T04:40:03.008 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:40:03.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.124+0000 7f44f4ad8700 1 Processor -- start 2023-10-06T04:40:03.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.124+0000 7f44f4ad8700 1 -- start start 2023-10-06T04:40:03.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.125+0000 7f44f4ad8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f44f00b1920 0x7f44f006aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.125+0000 7f44f4ad8700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f44f006b000 0x7f44f00ac680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.125+0000 7f44f4ad8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f006b420 con 0x7f44f00cbb30 2023-10-06T04:40:03.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.125+0000 7f44f4ad8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f00aa050 con 0x7f44f00b1920 2023-10-06T04:40:03.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.125+0000 7f44f4ad8700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f00aa330 con 0x7f44f006b000 2023-10-06T04:40:03.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.125+0000 7f44eeffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f44f00b1920 0x7f44f006aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.125+0000 7f44ef7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f44f00cbb30 0x7f44f00a9800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60908/0 (socket says 172.21.15.112:60908) 2023-10-06T04:40:03.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.125+0000 7f44eeffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f44f00b1920 0x7f44f006aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39342/0 (socket says 172.21.15.112:39342) 2023-10-06T04:40:03.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.125+0000 7f44eeffd700 1 -- 172.21.15.112:0/422495880 learned_addr learned my addr 172.21.15.112:0/422495880 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:03.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.125+0000 7f44effff700 1 --2- 172.21.15.112:0/422495880 >> v2:172.21.15.179:3300/0 conn(0x7f44f006b000 0x7f44f00ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.125+0000 7f44eeffd700 1 -- 172.21.15.112:0/422495880 >> v2:172.21.15.179:3300/0 conn(0x7f44f006b000 msgr2=0x7f44f00ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:03.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.125+0000 7f44eeffd700 1 --2- 172.21.15.112:0/422495880 >> v2:172.21.15.179:3300/0 conn(0x7f44f006b000 0x7f44f00ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.125+0000 7f44eeffd700 1 -- 172.21.15.112:0/422495880 >> v1:172.21.15.112:6789/0 conn(0x7f44f00cbb30 legacy=0x7f44f00a9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.125+0000 7f44ee7fc700 1 -- 172.21.15.112:0/422495880 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647777566 0 0) 0x7f44f006b420 con 0x7f44f00cbb30 2023-10-06T04:40:03.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.125+0000 7f44eeffd700 1 -- 172.21.15.112:0/422495880 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f00aa610 con 0x7f44f00b1920 2023-10-06T04:40:03.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.125+0000 7f44eeffd700 1 --2- 172.21.15.112:0/422495880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f00b1920 0x7f44f006aac0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f44f006be40 tx=0x7f44e400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65a094528c7b4c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:03.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.125+0000 7f44ee7fc700 1 -- 172.21.15.112:0/422495880 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e400dc50 con 0x7f44f00b1920 2023-10-06T04:40:03.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.125+0000 7f44ee7fc700 1 -- 172.21.15.112:0/422495880 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e400ddb0 con 0x7f44f00b1920 2023-10-06T04:40:03.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.125+0000 7f44ee7fc700 1 -- 172.21.15.112:0/422495880 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e40196d0 con 0x7f44f00b1920 2023-10-06T04:40:03.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.126+0000 7f44f4ad8700 1 -- 172.21.15.112:0/422495880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f00b1920 msgr2=0x7f44f006aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.126+0000 7f44f4ad8700 1 --2- 172.21.15.112:0/422495880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f00b1920 0x7f44f006aac0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f44f006be40 tx=0x7f44e400b4f0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.126+0000 7f44f4ad8700 1 -- 172.21.15.112:0/422495880 shutdown_connections 2023-10-06T04:40:03.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.126+0000 7f44f4ad8700 1 --2- 172.21.15.112:0/422495880 >> v2:172.21.15.179:3300/0 conn(0x7f44f006b000 0x7f44f00ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.126+0000 7f44f4ad8700 1 --2- 172.21.15.112:0/422495880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f00b1920 0x7f44f006aac0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.126+0000 7f44f4ad8700 1 -- 172.21.15.112:0/422495880 >> 172.21.15.112:0/422495880 conn(0x7f44f00af260 msgr2=0x7f44f00af660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:03.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.126+0000 7f44f4ad8700 1 -- 172.21.15.112:0/422495880 shutdown_connections 2023-10-06T04:40:03.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.126+0000 7f44f4ad8700 1 -- 172.21.15.112:0/422495880 wait complete. 2023-10-06T04:40:03.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.127+0000 7f44f4ad8700 1 Processor -- start 2023-10-06T04:40:03.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.127+0000 7f44f4ad8700 1 -- start start 2023-10-06T04:40:03.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.128+0000 7f44f4ad8700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44f006b000 0x7f44f0147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.128+0000 7f44f4ad8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f00b1920 0x7f44f0099290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.128+0000 7f44f4ad8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44f00cbb30 0x7f44f0158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.128+0000 7f44f4ad8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f01597f0 con 0x7f44f00b1920 2023-10-06T04:40:03.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.128+0000 7f44f4ad8700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f0165270 con 0x7f44f00cbb30 2023-10-06T04:40:03.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.128+0000 7f44f4ad8700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f0096a20 con 0x7f44f006b000 2023-10-06T04:40:03.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.128+0000 7f44eeffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f00b1920 0x7f44f0099290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.128+0000 7f44eeffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f00b1920 0x7f44f0099290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39350/0 (socket says 172.21.15.112:39350) 2023-10-06T04:40:03.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.128+0000 7f44eeffd700 1 -- 172.21.15.112:0/2575679579 learned_addr learned my addr 172.21.15.112:0/2575679579 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:03.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.128+0000 7f44effff700 1 --2- 172.21.15.112:0/2575679579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44f00cbb30 0x7f44f0158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.128+0000 7f44ef7fe700 1 --2- 172.21.15.112:0/2575679579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44f006b000 0x7f44f0147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.128+0000 7f44eeffd700 1 -- 172.21.15.112:0/2575679579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44f006b000 msgr2=0x7f44f0147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.128+0000 7f44eeffd700 1 --2- 172.21.15.112:0/2575679579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44f006b000 0x7f44f0147ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.128+0000 7f44eeffd700 1 -- 172.21.15.112:0/2575679579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44f00cbb30 msgr2=0x7f44f0158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.128+0000 7f44eeffd700 1 --2- 172.21.15.112:0/2575679579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44f00cbb30 0x7f44f0158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.128+0000 7f44eeffd700 1 -- 172.21.15.112:0/2575679579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e400b790 con 0x7f44f00b1920 2023-10-06T04:40:03.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.128+0000 7f44effff700 1 --2- 172.21.15.112:0/2575679579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44f00cbb30 0x7f44f0158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:03.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.128+0000 7f44eeffd700 1 --2- 172.21.15.112:0/2575679579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f00b1920 0x7f44f0099290 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f44f0071ad0 tx=0x7f44e401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:03.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.129+0000 7f44d77fe700 1 -- 172.21.15.112:0/2575679579 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4010470 con 0x7f44f00b1920 2023-10-06T04:40:03.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.129+0000 7f44d77fe700 1 -- 172.21.15.112:0/2575679579 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e40105d0 con 0x7f44f00b1920 2023-10-06T04:40:03.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.129+0000 7f44f4ad8700 1 -- 172.21.15.112:0/2575679579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f0096d00 con 0x7f44f00b1920 2023-10-06T04:40:03.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.129+0000 7f44d77fe700 1 -- 172.21.15.112:0/2575679579 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4010950 con 0x7f44f00b1920 2023-10-06T04:40:03.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.129+0000 7f44f4ad8700 1 -- 172.21.15.112:0/2575679579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f0157770 con 0x7f44f00b1920 2023-10-06T04:40:03.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.130+0000 7f44f4ad8700 1 -- 172.21.15.112:0/2575679579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f0096e90 con 0x7f44f00b1920 2023-10-06T04:40:03.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.130+0000 7f44d77fe700 1 -- 172.21.15.112:0/2575679579 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f44e4022030 con 0x7f44f00b1920 2023-10-06T04:40:03.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.130+0000 7f44d77fe700 1 --2- 172.21.15.112:0/2575679579 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f44dc066f30 0x7f44dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.130+0000 7f44d77fe700 1 -- 172.21.15.112:0/2575679579 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f44e4014070 con 0x7f44f00b1920 2023-10-06T04:40:03.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.130+0000 7f44ef7fe700 1 --2- 172.21.15.112:0/2575679579 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f44dc066f30 0x7f44dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.131+0000 7f44ef7fe700 1 --2- 172.21.15.112:0/2575679579 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f44dc066f30 0x7f44dc0693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f44e0001750 tx=0x7f44e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:03.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.135+0000 7f44d77fe700 1 -- 172.21.15.112:0/2575679579 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44e4055990 con 0x7f44f00b1920 2023-10-06T04:40:03.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.318+0000 7f44f4ad8700 1 -- 172.21.15.112:0/2575679579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f44f005f230 con 0x7f44f00b1920 2023-10-06T04:40:03.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.319+0000 7f44d77fe700 1 -- 172.21.15.112:0/2575679579 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f44e4058fb0 con 0x7f44f00b1920 2023-10-06T04:40:03.321 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-10-06T04:40:03.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.321+0000 7f44f4ad8700 1 -- 172.21.15.112:0/2575679579 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f44dc066f30 msgr2=0x7f44dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.321+0000 7f44f4ad8700 1 --2- 172.21.15.112:0/2575679579 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f44dc066f30 0x7f44dc0693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f44e0001750 tx=0x7f44e0009040 comp rx=0 tx=0).stop 2023-10-06T04:40:03.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.321+0000 7f44f4ad8700 1 -- 172.21.15.112:0/2575679579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f00b1920 msgr2=0x7f44f0099290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.321+0000 7f44f4ad8700 1 --2- 172.21.15.112:0/2575679579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f00b1920 0x7f44f0099290 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f44f0071ad0 tx=0x7f44e401b000 comp rx=0 tx=0).stop 2023-10-06T04:40:03.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.321+0000 7f44f4ad8700 1 -- 172.21.15.112:0/2575679579 shutdown_connections 2023-10-06T04:40:03.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.321+0000 7f44f4ad8700 1 --2- 172.21.15.112:0/2575679579 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f44dc066f30 0x7f44dc0693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.321+0000 7f44f4ad8700 1 --2- 172.21.15.112:0/2575679579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44f00cbb30 0x7f44f0158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.321+0000 7f44f4ad8700 1 --2- 172.21.15.112:0/2575679579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44f006b000 0x7f44f0147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.321+0000 7f44f4ad8700 1 --2- 172.21.15.112:0/2575679579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f00b1920 0x7f44f0099290 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.321+0000 7f44f4ad8700 1 -- 172.21.15.112:0/2575679579 >> 172.21.15.112:0/2575679579 conn(0x7f44f00af260 msgr2=0x7f44f0153980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:03.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.321+0000 7f44f4ad8700 1 -- 172.21.15.112:0/2575679579 shutdown_connections 2023-10-06T04:40:03.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.321+0000 7f44f4ad8700 1 -- 172.21.15.112:0/2575679579 wait complete. 2023-10-06T04:40:03.335 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:40:03.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.450+0000 7f42a7bc5700 1 Processor -- start 2023-10-06T04:40:03.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.450+0000 7f42a7bc5700 1 -- start start 2023-10-06T04:40:03.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.451+0000 7f42a7bc5700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f42a0159a20 0x7f42a00cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.451+0000 7f42a7bc5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a015af50 con 0x7f42a015c720 2023-10-06T04:40:03.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.451+0000 7f42a7bc5700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a015e370 con 0x7f42a006d3b0 2023-10-06T04:40:03.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.451+0000 7f42a7bc5700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a00cca70 con 0x7f42a0159a20 2023-10-06T04:40:03.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.451+0000 7f42a6162700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f42a015c720 0x7f42a015dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60912/0 (socket says 172.21.15.112:60912) 2023-10-06T04:40:03.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.451+0000 7f42a6162700 1 -- 172.21.15.112:0/19875625 learned_addr learned my addr 172.21.15.112:0/19875625 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:03.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.451+0000 7f42a5961700 1 --2- 172.21.15.112:0/19875625 >> v2:172.21.15.179:3300/0 conn(0x7f42a0159a20 0x7f42a00cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.451+0000 7f42a495f700 1 -- 172.21.15.112:0/19875625 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4099438299 0 0) 0x7f42a015af50 con 0x7f42a015c720 2023-10-06T04:40:03.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.451+0000 7f42a495f700 1 -- 172.21.15.112:0/19875625 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f428c003570 con 0x7f42a015c720 2023-10-06T04:40:03.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.451+0000 7f42a495f700 1 -- 172.21.15.112:0/19875625 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1866667422 0 0) 0x7f428c003570 con 0x7f42a015c720 2023-10-06T04:40:03.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.451+0000 7f42a495f700 1 -- 172.21.15.112:0/19875625 >> v2:172.21.15.179:3300/0 conn(0x7f42a0159a20 msgr2=0x7f42a00cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:03.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.451+0000 7f42a495f700 1 --2- 172.21.15.112:0/19875625 >> v2:172.21.15.179:3300/0 conn(0x7f42a0159a20 0x7f42a00cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.451+0000 7f42a495f700 1 -- 172.21.15.112:0/19875625 >> v1:172.21.15.179:6789/0 conn(0x7f42a006d3b0 legacy=0x7f42a015d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.451+0000 7f42a495f700 1 -- 172.21.15.112:0/19875625 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a00cae50 con 0x7f42a015c720 2023-10-06T04:40:03.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a495f700 1 -- 172.21.15.112:0/19875625 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f42980017f0 con 0x7f42a015c720 2023-10-06T04:40:03.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a495f700 1 -- 172.21.15.112:0/19875625 >> v1:172.21.15.112:6789/0 conn(0x7f42a015c720 legacy=0x7f42a015dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a495f700 1 --2- 172.21.15.112:0/19875625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f428c003a60 0x7f428c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a495f700 1 --2- 172.21.15.112:0/19875625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f428c004810 0x7f428c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a495f700 1 --2- 172.21.15.112:0/19875625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f428c0051c0 0x7f428c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a495f700 1 -- 172.21.15.112:0/19875625 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a00cca70 con 0x7f428c003a60 2023-10-06T04:40:03.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a495f700 1 -- 172.21.15.112:0/19875625 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c00c160 con 0x7f428c004810 2023-10-06T04:40:03.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a495f700 1 -- 172.21.15.112:0/19875625 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c00c320 con 0x7f428c0051c0 2023-10-06T04:40:03.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a5961700 1 --2- 172.21.15.112:0/19875625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f428c003a60 0x7f428c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a5160700 1 --2- 172.21.15.112:0/19875625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f428c004810 0x7f428c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a6162700 1 --2- 172.21.15.112:0/19875625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f428c0051c0 0x7f428c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a5961700 1 -- 172.21.15.112:0/19875625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f428c0051c0 msgr2=0x7f428c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:03.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a5961700 1 --2- 172.21.15.112:0/19875625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f428c0051c0 0x7f428c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a5961700 1 -- 172.21.15.112:0/19875625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f428c004810 msgr2=0x7f428c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:03.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a5961700 1 --2- 172.21.15.112:0/19875625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f428c004810 0x7f428c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a5961700 1 -- 172.21.15.112:0/19875625 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c003570 con 0x7f428c003a60 2023-10-06T04:40:03.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a5160700 1 --2- 172.21.15.112:0/19875625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f428c004810 0x7f428c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:03.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a6162700 1 -- 172.21.15.112:0/19875625 reap_dead start 2023-10-06T04:40:03.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a5961700 1 --2- 172.21.15.112:0/19875625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f428c003a60 0x7f428c003e70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f429c009c00 tx=0x7f429c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e1a9e3352d521f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:03.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a495f700 1 -- 172.21.15.112:0/19875625 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c00e710 con 0x7f428c003a60 2023-10-06T04:40:03.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a495f700 1 -- 172.21.15.112:0/19875625 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c00e870 con 0x7f428c003a60 2023-10-06T04:40:03.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.452+0000 7f42a495f700 1 -- 172.21.15.112:0/19875625 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c00ec30 con 0x7f428c003a60 2023-10-06T04:40:03.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.453+0000 7f42a7bc5700 1 -- 172.21.15.112:0/19875625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f428c003a60 msgr2=0x7f428c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.453+0000 7f42a7bc5700 1 --2- 172.21.15.112:0/19875625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f428c003a60 0x7f428c003e70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f429c009c00 tx=0x7f429c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.453+0000 7f42a7bc5700 1 -- 172.21.15.112:0/19875625 shutdown_connections 2023-10-06T04:40:03.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.453+0000 7f42a7bc5700 1 --2- 172.21.15.112:0/19875625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f428c003a60 0x7f428c003e70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.453+0000 7f42a7bc5700 1 -- 172.21.15.112:0/19875625 >> 172.21.15.112:0/19875625 conn(0x7f42a006cfb0 msgr2=0x7f42a00d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:03.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.453+0000 7f42a7bc5700 1 -- 172.21.15.112:0/19875625 shutdown_connections 2023-10-06T04:40:03.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.453+0000 7f42a7bc5700 1 -- 172.21.15.112:0/19875625 wait complete. 2023-10-06T04:40:03.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.454+0000 7f42a7bc5700 1 Processor -- start 2023-10-06T04:40:03.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.454+0000 7f42a7bc5700 1 -- start start 2023-10-06T04:40:03.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.455+0000 7f42a7bc5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f428c003a60 0x7f42a016ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.455+0000 7f42a7bc5700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42a016d5e0 0x7f42a016b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.455+0000 7f42a7bc5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42a00add00 0x7f42a016c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.455+0000 7f42a7bc5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a016ddc0 con 0x7f42a00add00 2023-10-06T04:40:03.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.455+0000 7f42a7bc5700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a016e0a0 con 0x7f428c003a60 2023-10-06T04:40:03.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.455+0000 7f42a7bc5700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a016e380 con 0x7f42a016d5e0 2023-10-06T04:40:03.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.455+0000 7f42a6162700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42a00add00 0x7f42a016c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.455+0000 7f42a6162700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42a00add00 0x7f42a016c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39358/0 (socket says 172.21.15.112:39358) 2023-10-06T04:40:03.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.455+0000 7f42a5961700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f428c003a60 0x7f42a016ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.455+0000 7f42a6162700 1 -- 172.21.15.112:0/545302046 learned_addr learned my addr 172.21.15.112:0/545302046 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:03.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.455+0000 7f42a5160700 1 --2- 172.21.15.112:0/545302046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42a016d5e0 0x7f42a016b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.455+0000 7f42a6162700 1 -- 172.21.15.112:0/545302046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42a016d5e0 msgr2=0x7f42a016b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.455+0000 7f42a6162700 1 --2- 172.21.15.112:0/545302046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42a016d5e0 0x7f42a016b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.455+0000 7f42a6162700 1 -- 172.21.15.112:0/545302046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f428c003a60 msgr2=0x7f42a016ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.455+0000 7f42a6162700 1 --2- 172.21.15.112:0/545302046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f428c003a60 0x7f42a016ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.455+0000 7f42a6162700 1 -- 172.21.15.112:0/545302046 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a00b5770 con 0x7f42a00add00 2023-10-06T04:40:03.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.455+0000 7f42a6162700 1 --2- 172.21.15.112:0/545302046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42a00add00 0x7f42a016c940 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4298000f80 tx=0x7f42a0064630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:03.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.455+0000 7f4295ffb700 1 -- 172.21.15.112:0/545302046 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429800eb10 con 0x7f42a00add00 2023-10-06T04:40:03.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.455+0000 7f4295ffb700 1 -- 172.21.15.112:0/545302046 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429800ec90 con 0x7f42a00add00 2023-10-06T04:40:03.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.455+0000 7f42a7bc5700 1 -- 172.21.15.112:0/545302046 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a016da50 con 0x7f42a00add00 2023-10-06T04:40:03.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.455+0000 7f4295ffb700 1 -- 172.21.15.112:0/545302046 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298013420 con 0x7f42a00add00 2023-10-06T04:40:03.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.456+0000 7f42a7bc5700 1 -- 172.21.15.112:0/545302046 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a016b630 con 0x7f42a00add00 2023-10-06T04:40:03.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.456+0000 7f42a7bc5700 1 -- 172.21.15.112:0/545302046 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a00b55b0 con 0x7f42a00add00 2023-10-06T04:40:03.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.457+0000 7f4295ffb700 1 -- 172.21.15.112:0/545302046 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4298013790 con 0x7f42a00add00 2023-10-06T04:40:03.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.457+0000 7f4295ffb700 1 --2- 172.21.15.112:0/545302046 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4284066f30 0x7f42840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.457+0000 7f4295ffb700 1 -- 172.21.15.112:0/545302046 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f42980847d0 con 0x7f42a00add00 2023-10-06T04:40:03.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.457+0000 7f42a5961700 1 --2- 172.21.15.112:0/545302046 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4284066f30 0x7f42840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.458+0000 7f42a5961700 1 --2- 172.21.15.112:0/545302046 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4284066f30 0x7f42840693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f429c0091e0 tx=0x7f429c01a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:03.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.461+0000 7f4295ffb700 1 -- 172.21.15.112:0/545302046 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4298051b90 con 0x7f42a00add00 2023-10-06T04:40:03.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.644+0000 7f42a7bc5700 1 -- 172.21.15.112:0/545302046 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f42a005f230 con 0x7f42a00add00 2023-10-06T04:40:03.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.645+0000 7f4295ffb700 1 -- 172.21.15.112:0/545302046 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f42980551b0 con 0x7f42a00add00 2023-10-06T04:40:03.647 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-10-06T04:40:03.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.646+0000 7f42a7bc5700 1 -- 172.21.15.112:0/545302046 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4284066f30 msgr2=0x7f42840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.646+0000 7f42a7bc5700 1 --2- 172.21.15.112:0/545302046 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4284066f30 0x7f42840693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f429c0091e0 tx=0x7f429c01a000 comp rx=0 tx=0).stop 2023-10-06T04:40:03.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.646+0000 7f42a7bc5700 1 -- 172.21.15.112:0/545302046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42a00add00 msgr2=0x7f42a016c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.646+0000 7f42a7bc5700 1 --2- 172.21.15.112:0/545302046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42a00add00 0x7f42a016c940 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4298000f80 tx=0x7f42a0064630 comp rx=0 tx=0).stop 2023-10-06T04:40:03.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.647+0000 7f42a7bc5700 1 -- 172.21.15.112:0/545302046 shutdown_connections 2023-10-06T04:40:03.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.647+0000 7f42a7bc5700 1 --2- 172.21.15.112:0/545302046 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4284066f30 0x7f42840693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.647+0000 7f42a7bc5700 1 --2- 172.21.15.112:0/545302046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42a00add00 0x7f42a016c940 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.647+0000 7f42a7bc5700 1 --2- 172.21.15.112:0/545302046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f428c003a60 0x7f42a016ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.647+0000 7f42a7bc5700 1 --2- 172.21.15.112:0/545302046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42a016d5e0 0x7f42a016b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.647+0000 7f42a7bc5700 1 -- 172.21.15.112:0/545302046 >> 172.21.15.112:0/545302046 conn(0x7f42a006cfb0 msgr2=0x7f42a006ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:03.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.647+0000 7f42a7bc5700 1 -- 172.21.15.112:0/545302046 shutdown_connections 2023-10-06T04:40:03.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.647+0000 7f42a7bc5700 1 -- 172.21.15.112:0/545302046 wait complete. 2023-10-06T04:40:03.661 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T04:40:03.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.772+0000 7f682dece700 1 Processor -- start 2023-10-06T04:40:03.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.772+0000 7f682dece700 1 -- start start 2023-10-06T04:40:03.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.773+0000 7f682dece700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6828157a80 0x7f682806b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.773+0000 7f682dece700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68280b2650 con 0x7f682806bb30 2023-10-06T04:40:03.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.773+0000 7f682dece700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68280cdee0 con 0x7f68281576b0 2023-10-06T04:40:03.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.773+0000 7f682dece700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682806bf90 con 0x7f6828157a80 2023-10-06T04:40:03.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.773+0000 7f682d6cd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f682806bb30 0x7f68280af280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60924/0 (socket says 172.21.15.112:60924) 2023-10-06T04:40:03.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.773+0000 7f682d6cd700 1 -- 172.21.15.112:0/2166324673 learned_addr learned my addr 172.21.15.112:0/2166324673 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:03.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.773+0000 7f681ffff700 1 --2- 172.21.15.112:0/2166324673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6828157a80 0x7f682806b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.773+0000 7f681f7fe700 1 -- 172.21.15.112:0/2166324673 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597512601 0 0) 0x7f68280b2650 con 0x7f682806bb30 2023-10-06T04:40:03.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.773+0000 7f681f7fe700 1 -- 172.21.15.112:0/2166324673 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6810003570 con 0x7f682806bb30 2023-10-06T04:40:03.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.773+0000 7f681f7fe700 1 -- 172.21.15.112:0/2166324673 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681201160 0 0) 0x7f68280cdee0 con 0x7f68281576b0 2023-10-06T04:40:03.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.773+0000 7f681f7fe700 1 -- 172.21.15.112:0/2166324673 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68280b2650 con 0x7f68281576b0 2023-10-06T04:40:03.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681f7fe700 1 -- 172.21.15.112:0/2166324673 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 485451041 0 0) 0x7f6810003570 con 0x7f682806bb30 2023-10-06T04:40:03.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681f7fe700 1 -- 172.21.15.112:0/2166324673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6828157a80 msgr2=0x7f682806b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:03.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681f7fe700 1 --2- 172.21.15.112:0/2166324673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6828157a80 0x7f682806b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681f7fe700 1 -- 172.21.15.112:0/2166324673 >> v1:172.21.15.179:6789/0 conn(0x7f68281576b0 legacy=0x7f68280b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681f7fe700 1 -- 172.21.15.112:0/2166324673 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68280b1d20 con 0x7f682806bb30 2023-10-06T04:40:03.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681f7fe700 1 -- 172.21.15.112:0/2166324673 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f6820001470 con 0x7f682806bb30 2023-10-06T04:40:03.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681f7fe700 1 -- 172.21.15.112:0/2166324673 >> v1:172.21.15.112:6789/0 conn(0x7f682806bb30 legacy=0x7f68280af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681f7fe700 1 --2- 172.21.15.112:0/2166324673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6810003c20 0x7f6810004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681f7fe700 1 --2- 172.21.15.112:0/2166324673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6810004810 0x7f6810004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681f7fe700 1 --2- 172.21.15.112:0/2166324673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6828157a80 0x7f6810005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681f7fe700 1 -- 172.21.15.112:0/2166324673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682806bf90 con 0x7f6810004810 2023-10-06T04:40:03.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681f7fe700 1 -- 172.21.15.112:0/2166324673 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681000bbf0 con 0x7f6810003c20 2023-10-06T04:40:03.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681f7fe700 1 -- 172.21.15.112:0/2166324673 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681000bdb0 con 0x7f6828157a80 2023-10-06T04:40:03.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681ffff700 1 --2- 172.21.15.112:0/2166324673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6810004810 0x7f6810004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f682d6cd700 1 --2- 172.21.15.112:0/2166324673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6828157a80 0x7f6810005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f682cecc700 1 --2- 172.21.15.112:0/2166324673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6810003c20 0x7f6810004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681ffff700 1 -- 172.21.15.112:0/2166324673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6828157a80 msgr2=0x7f6810005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:03.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681ffff700 1 --2- 172.21.15.112:0/2166324673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6828157a80 0x7f6810005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681ffff700 1 -- 172.21.15.112:0/2166324673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6810003c20 msgr2=0x7f6810004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:03.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681ffff700 1 --2- 172.21.15.112:0/2166324673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6810003c20 0x7f6810004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681ffff700 1 -- 172.21.15.112:0/2166324673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6810003570 con 0x7f6810004810 2023-10-06T04:40:03.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f682cecc700 1 --2- 172.21.15.112:0/2166324673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6810003c20 0x7f6810004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:03.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f682d6cd700 1 --2- 172.21.15.112:0/2166324673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6828157a80 0x7f6810005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:03.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681ffff700 1 --2- 172.21.15.112:0/2166324673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6810004810 0x7f6810004c80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6818009c00 tx=0x7f68180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8536971574dfc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:03.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681f7fe700 1 -- 172.21.15.112:0/2166324673 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681800e710 con 0x7f6810004810 2023-10-06T04:40:03.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681f7fe700 1 -- 172.21.15.112:0/2166324673 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681800e870 con 0x7f6810004810 2023-10-06T04:40:03.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.774+0000 7f681f7fe700 1 -- 172.21.15.112:0/2166324673 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681800ec30 con 0x7f6810004810 2023-10-06T04:40:03.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.775+0000 7f682dece700 1 -- 172.21.15.112:0/2166324673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6810004810 msgr2=0x7f6810004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.775+0000 7f682dece700 1 --2- 172.21.15.112:0/2166324673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6810004810 0x7f6810004c80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6818009c00 tx=0x7f68180091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.775+0000 7f682d6cd700 1 -- 172.21.15.112:0/2166324673 reap_dead start 2023-10-06T04:40:03.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.775+0000 7f682dece700 1 -- 172.21.15.112:0/2166324673 shutdown_connections 2023-10-06T04:40:03.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.775+0000 7f682dece700 1 -- 172.21.15.112:0/2166324673 >> 172.21.15.112:0/2166324673 conn(0x7f6828068620 msgr2=0x7f68280cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:03.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.775+0000 7f682dece700 1 -- 172.21.15.112:0/2166324673 shutdown_connections 2023-10-06T04:40:03.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.775+0000 7f682dece700 1 -- 172.21.15.112:0/2166324673 wait complete. 2023-10-06T04:40:03.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.776+0000 7f682dece700 1 Processor -- start 2023-10-06T04:40:03.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.776+0000 7f682dece700 1 -- start start 2023-10-06T04:40:03.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f682dece700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6810004810 0x7f682814fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f682dece700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f682815ae10 0x7f6828169790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f682dece700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68281599b0 0x7f6828159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f682dece700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6828150150 con 0x7f6810004810 2023-10-06T04:40:03.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f682dece700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68280c91c0 con 0x7f682815ae10 2023-10-06T04:40:03.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f682dece700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68281591c0 con 0x7f68281599b0 2023-10-06T04:40:03.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f682cecc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6810004810 0x7f682814fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f682cecc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6810004810 0x7f682814fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39372/0 (socket says 172.21.15.112:39372) 2023-10-06T04:40:03.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f682cecc700 1 -- 172.21.15.112:0/21484188 learned_addr learned my addr 172.21.15.112:0/21484188 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:03.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f682d6cd700 1 --2- 172.21.15.112:0/21484188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68281599b0 0x7f6828159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f681ffff700 1 --2- 172.21.15.112:0/21484188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f682815ae10 0x7f6828169790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f682cecc700 1 -- 172.21.15.112:0/21484188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68281599b0 msgr2=0x7f6828159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f682cecc700 1 --2- 172.21.15.112:0/21484188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68281599b0 0x7f6828159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f682cecc700 1 -- 172.21.15.112:0/21484188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f682815ae10 msgr2=0x7f6828169790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f682cecc700 1 --2- 172.21.15.112:0/21484188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f682815ae10 0x7f6828169790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f682cecc700 1 -- 172.21.15.112:0/21484188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682816a030 con 0x7f6810004810 2023-10-06T04:40:03.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f682cecc700 1 --2- 172.21.15.112:0/21484188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6810004810 0x7f682814fc10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f682400ebf0 tx=0x7f6824009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:03.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f681cff9700 1 -- 172.21.15.112:0/21484188 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6824017070 con 0x7f6810004810 2023-10-06T04:40:03.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f681cff9700 1 -- 172.21.15.112:0/21484188 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68240032e0 con 0x7f6810004810 2023-10-06T04:40:03.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f682dece700 1 -- 172.21.15.112:0/21484188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682816a310 con 0x7f6810004810 2023-10-06T04:40:03.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f681cff9700 1 -- 172.21.15.112:0/21484188 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6824006ba0 con 0x7f6810004810 2023-10-06T04:40:03.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f682dece700 1 -- 172.21.15.112:0/21484188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6828159490 con 0x7f6810004810 2023-10-06T04:40:03.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.778+0000 7f682dece700 1 -- 172.21.15.112:0/21484188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68281596b0 con 0x7f6810004810 2023-10-06T04:40:03.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.779+0000 7f681cff9700 1 -- 172.21.15.112:0/21484188 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f682400c750 con 0x7f6810004810 2023-10-06T04:40:03.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.779+0000 7f681cff9700 1 --2- 172.21.15.112:0/21484188 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6814066f30 0x7f68140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:03.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.779+0000 7f681cff9700 1 -- 172.21.15.112:0/21484188 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6824084360 con 0x7f6810004810 2023-10-06T04:40:03.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.779+0000 7f681ffff700 1 --2- 172.21.15.112:0/21484188 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6814066f30 0x7f68140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:03.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.780+0000 7f681ffff700 1 --2- 172.21.15.112:0/21484188 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6814066f30 0x7f68140693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6828156c10 tx=0x7f681801a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:03.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.783+0000 7f681cff9700 1 -- 172.21.15.112:0/21484188 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6824051720 con 0x7f6810004810 2023-10-06T04:40:03.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.969+0000 7f682dece700 1 -- 172.21.15.112:0/21484188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f682805f230 con 0x7f6810004810 2023-10-06T04:40:03.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.970+0000 7f681cff9700 1 -- 172.21.15.112:0/21484188 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+126 (secure 0 0 0) 0x7f6824054d40 con 0x7f6810004810 2023-10-06T04:40:03.972 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:03.973 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2023-10-06T04:40:03.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:03.973 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2023-10-06T04:40:03.973 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": "rbd" 2023-10-06T04:40:03.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:03.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:03.973 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 2, 2023-10-06T04:40:03.973 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2023-10-06T04:40:03.974 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:03.974 INFO:teuthology.orchestra.run.smithi112.stdout:] 2023-10-06T04:40:03.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.971+0000 7f682dece700 1 -- 172.21.15.112:0/21484188 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6814066f30 msgr2=0x7f68140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.972+0000 7f682dece700 1 --2- 172.21.15.112:0/21484188 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6814066f30 0x7f68140693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6828156c10 tx=0x7f681801a000 comp rx=0 tx=0).stop 2023-10-06T04:40:03.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.972+0000 7f682dece700 1 -- 172.21.15.112:0/21484188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6810004810 msgr2=0x7f682814fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:03.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.972+0000 7f682dece700 1 --2- 172.21.15.112:0/21484188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6810004810 0x7f682814fc10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f682400ebf0 tx=0x7f6824009040 comp rx=0 tx=0).stop 2023-10-06T04:40:03.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.972+0000 7f682dece700 1 -- 172.21.15.112:0/21484188 shutdown_connections 2023-10-06T04:40:03.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.972+0000 7f682dece700 1 --2- 172.21.15.112:0/21484188 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6814066f30 0x7f68140693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.972+0000 7f682dece700 1 --2- 172.21.15.112:0/21484188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68281599b0 0x7f6828159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.972+0000 7f682dece700 1 --2- 172.21.15.112:0/21484188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6810004810 0x7f682814fc10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.972+0000 7f682dece700 1 --2- 172.21.15.112:0/21484188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f682815ae10 0x7f6828169790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:03.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.972+0000 7f682dece700 1 -- 172.21.15.112:0/21484188 >> 172.21.15.112:0/21484188 conn(0x7f6828068620 msgr2=0x7f682806d040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:03.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.972+0000 7f682dece700 1 -- 172.21.15.112:0/21484188 shutdown_connections 2023-10-06T04:40:03.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:03.972+0000 7f682dece700 1 -- 172.21.15.112:0/21484188 wait complete. 2023-10-06T04:40:03.986 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T04:40:03.986 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T04:40:04.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.101+0000 7f81dca49700 1 Processor -- start 2023-10-06T04:40:04.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.101+0000 7f81dca49700 1 -- start start 2023-10-06T04:40:04.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81dca49700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f81d806d3b0 0x7f81d815be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81dca49700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d815af50 con 0x7f81d80cbf00 2023-10-06T04:40:04.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81dca49700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d80cae50 con 0x7f81d8159a20 2023-10-06T04:40:04.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81dca49700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d80cca70 con 0x7f81d806d3b0 2023-10-06T04:40:04.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81cffff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f81d80cbf00 0x7f81d815b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60926/0 (socket says 172.21.15.112:60926) 2023-10-06T04:40:04.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81cffff700 1 -- 172.21.15.112:0/136465478 learned_addr learned my addr 172.21.15.112:0/136465478 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:04.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81d6d9d700 1 --2- 172.21.15.112:0/136465478 >> v2:172.21.15.179:3300/0 conn(0x7f81d806d3b0 0x7f81d815be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81d5d9b700 1 -- 172.21.15.112:0/136465478 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259581422 0 0) 0x7f81d815af50 con 0x7f81d80cbf00 2023-10-06T04:40:04.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81d5d9b700 1 -- 172.21.15.112:0/136465478 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c4003570 con 0x7f81d80cbf00 2023-10-06T04:40:04.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81d5d9b700 1 -- 172.21.15.112:0/136465478 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3879340476 0 0) 0x7f81c4003570 con 0x7f81d80cbf00 2023-10-06T04:40:04.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81d5d9b700 1 -- 172.21.15.112:0/136465478 >> v2:172.21.15.179:3300/0 conn(0x7f81d806d3b0 msgr2=0x7f81d815be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:04.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81d5d9b700 1 --2- 172.21.15.112:0/136465478 >> v2:172.21.15.179:3300/0 conn(0x7f81d806d3b0 0x7f81d815be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81d5d9b700 1 -- 172.21.15.112:0/136465478 >> v1:172.21.15.179:6789/0 conn(0x7f81d8159a20 legacy=0x7f81d80cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81d5d9b700 1 -- 172.21.15.112:0/136465478 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d80cb0f0 con 0x7f81d80cbf00 2023-10-06T04:40:04.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81d5d9b700 1 -- 172.21.15.112:0/136465478 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f81c0001470 con 0x7f81d80cbf00 2023-10-06T04:40:04.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81d6d9d700 1 --2- 172.21.15.112:0/136465478 >> v2:172.21.15.179:3300/0 conn(0x7f81d806d3b0 0x7f81d815be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:04.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81d5d9b700 1 -- 172.21.15.112:0/136465478 >> v1:172.21.15.112:6789/0 conn(0x7f81d80cbf00 legacy=0x7f81d815b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81d5d9b700 1 --2- 172.21.15.112:0/136465478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4003a60 0x7f81c4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81d5d9b700 1 --2- 172.21.15.112:0/136465478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c4004810 0x7f81c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81d5d9b700 1 --2- 172.21.15.112:0/136465478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81c40051c0 0x7f81c400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81d5d9b700 1 -- 172.21.15.112:0/136465478 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d80cca70 con 0x7f81c4004810 2023-10-06T04:40:04.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81d5d9b700 1 -- 172.21.15.112:0/136465478 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c400c160 con 0x7f81c40051c0 2023-10-06T04:40:04.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.102+0000 7f81d5d9b700 1 -- 172.21.15.112:0/136465478 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c400c320 con 0x7f81c4003a60 2023-10-06T04:40:04.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.103+0000 7f81cffff700 1 --2- 172.21.15.112:0/136465478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c4004810 0x7f81c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.103+0000 7f81d6d9d700 1 --2- 172.21.15.112:0/136465478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81c40051c0 0x7f81c400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.103+0000 7f81d659c700 1 --2- 172.21.15.112:0/136465478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4003a60 0x7f81c4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.103+0000 7f81cffff700 1 -- 172.21.15.112:0/136465478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4003a60 msgr2=0x7f81c4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:04.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.103+0000 7f81cffff700 1 --2- 172.21.15.112:0/136465478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4003a60 0x7f81c4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.103+0000 7f81cffff700 1 -- 172.21.15.112:0/136465478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81c40051c0 msgr2=0x7f81c400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:04.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.103+0000 7f81cffff700 1 --2- 172.21.15.112:0/136465478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81c40051c0 0x7f81c400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.103+0000 7f81cffff700 1 -- 172.21.15.112:0/136465478 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c4003570 con 0x7f81c4004810 2023-10-06T04:40:04.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.103+0000 7f81d6d9d700 1 -- 172.21.15.112:0/136465478 reap_dead start 2023-10-06T04:40:04.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.103+0000 7f81cffff700 1 --2- 172.21.15.112:0/136465478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c4004810 0x7f81c4004c80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f81d80cc300 tx=0x7f81d8064630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6abea29768503c08 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:04.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.103+0000 7f81d5d9b700 1 -- 172.21.15.112:0/136465478 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c000cbb0 con 0x7f81c4004810 2023-10-06T04:40:04.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.103+0000 7f81d5d9b700 1 -- 172.21.15.112:0/136465478 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c000cd10 con 0x7f81c4004810 2023-10-06T04:40:04.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.103+0000 7f81d5d9b700 1 -- 172.21.15.112:0/136465478 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0005b70 con 0x7f81c4004810 2023-10-06T04:40:04.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.103+0000 7f81dca49700 1 -- 172.21.15.112:0/136465478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c4004810 msgr2=0x7f81c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.103+0000 7f81dca49700 1 --2- 172.21.15.112:0/136465478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c4004810 0x7f81c4004c80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f81d80cc300 tx=0x7f81d8064630 comp rx=0 tx=0).stop 2023-10-06T04:40:04.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.104+0000 7f81dca49700 1 -- 172.21.15.112:0/136465478 shutdown_connections 2023-10-06T04:40:04.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.104+0000 7f81dca49700 1 --2- 172.21.15.112:0/136465478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c4004810 0x7f81c4004c80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.104+0000 7f81dca49700 1 -- 172.21.15.112:0/136465478 >> 172.21.15.112:0/136465478 conn(0x7f81d806cfb0 msgr2=0x7f81d80d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:04.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.104+0000 7f81dca49700 1 -- 172.21.15.112:0/136465478 shutdown_connections 2023-10-06T04:40:04.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.104+0000 7f81dca49700 1 -- 172.21.15.112:0/136465478 wait complete. 2023-10-06T04:40:04.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.105+0000 7f81dca49700 1 Processor -- start 2023-10-06T04:40:04.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.105+0000 7f81dca49700 1 -- start start 2023-10-06T04:40:04.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.105+0000 7f81dca49700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4004810 0x7f81d8146920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.105+0000 7f81dca49700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81d80b41c0 0x7f81d815c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.105+0000 7f81dca49700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81d80b4630 0x7f81d815ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.105+0000 7f81dca49700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d80b5ca0 con 0x7f81d80b41c0 2023-10-06T04:40:04.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.105+0000 7f81dca49700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d80b4c00 con 0x7f81d80b4630 2023-10-06T04:40:04.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.105+0000 7f81dca49700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d80b4ee0 con 0x7f81c4004810 2023-10-06T04:40:04.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.105+0000 7f81cffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81d80b41c0 0x7f81d815c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.106+0000 7f81cffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81d80b41c0 0x7f81d815c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39396/0 (socket says 172.21.15.112:39396) 2023-10-06T04:40:04.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.106+0000 7f81cffff700 1 -- 172.21.15.112:0/1978446667 learned_addr learned my addr 172.21.15.112:0/1978446667 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:04.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.106+0000 7f81d6d9d700 1 --2- 172.21.15.112:0/1978446667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81d80b4630 0x7f81d815ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.106+0000 7f81d659c700 1 --2- 172.21.15.112:0/1978446667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4004810 0x7f81d8146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.106+0000 7f81cffff700 1 -- 172.21.15.112:0/1978446667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4004810 msgr2=0x7f81d8146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.106+0000 7f81cffff700 1 --2- 172.21.15.112:0/1978446667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4004810 0x7f81d8146920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.106+0000 7f81cffff700 1 -- 172.21.15.112:0/1978446667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81d80b4630 msgr2=0x7f81d815ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.106+0000 7f81cffff700 1 --2- 172.21.15.112:0/1978446667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81d80b4630 0x7f81d815ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.106+0000 7f81cffff700 1 -- 172.21.15.112:0/1978446667 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d80b51c0 con 0x7f81d80b41c0 2023-10-06T04:40:04.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.106+0000 7f81d6d9d700 1 --2- 172.21.15.112:0/1978446667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81d80b4630 0x7f81d815ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:04.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.106+0000 7f81d659c700 1 --2- 172.21.15.112:0/1978446667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4004810 0x7f81d8146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:04.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.106+0000 7f81cffff700 1 --2- 172.21.15.112:0/1978446667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81d80b41c0 0x7f81d815c790 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f81c400c130 tx=0x7f81c0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:04.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.106+0000 7f81ce7fc700 1 -- 172.21.15.112:0/1978446667 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0022070 con 0x7f81d80b41c0 2023-10-06T04:40:04.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.106+0000 7f81ce7fc700 1 -- 172.21.15.112:0/1978446667 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c000ce80 con 0x7f81d80b41c0 2023-10-06T04:40:04.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.106+0000 7f81dca49700 1 -- 172.21.15.112:0/1978446667 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d80b54a0 con 0x7f81d80b41c0 2023-10-06T04:40:04.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.106+0000 7f81ce7fc700 1 -- 172.21.15.112:0/1978446667 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c000cbb0 con 0x7f81d80b41c0 2023-10-06T04:40:04.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.106+0000 7f81dca49700 1 -- 172.21.15.112:0/1978446667 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d8146e60 con 0x7f81d80b41c0 2023-10-06T04:40:04.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.107+0000 7f81dca49700 1 -- 172.21.15.112:0/1978446667 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d80b5940 con 0x7f81d80b41c0 2023-10-06T04:40:04.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.107+0000 7f81ce7fc700 1 -- 172.21.15.112:0/1978446667 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f81c001e430 con 0x7f81d80b41c0 2023-10-06T04:40:04.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.108+0000 7f81ce7fc700 1 --2- 172.21.15.112:0/1978446667 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f81b8066f30 0x7f81b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.108+0000 7f81ce7fc700 1 -- 172.21.15.112:0/1978446667 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f81c0084ec0 con 0x7f81d80b41c0 2023-10-06T04:40:04.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.108+0000 7f81d659c700 1 --2- 172.21.15.112:0/1978446667 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f81b8066f30 0x7f81b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.108+0000 7f81d659c700 1 --2- 172.21.15.112:0/1978446667 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f81b8066f30 0x7f81b80693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f81c8000c00 tx=0x7f81c8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:04.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.113+0000 7f81ce7fc700 1 -- 172.21.15.112:0/1978446667 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f81c0052320 con 0x7f81d80b41c0 2023-10-06T04:40:04.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.295+0000 7f81dca49700 1 -- 172.21.15.112:0/1978446667 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f81d805f230 con 0x7f81d80b41c0 2023-10-06T04:40:04.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.839+0000 7f81ce7fc700 1 -- 172.21.15.112:0/1978446667 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7f81c0017020 con 0x7f81d80b41c0 2023-10-06T04:40:04.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.843+0000 7f81dca49700 1 -- 172.21.15.112:0/1978446667 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f81b8066f30 msgr2=0x7f81b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.843+0000 7f81dca49700 1 --2- 172.21.15.112:0/1978446667 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f81b8066f30 0x7f81b80693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f81c8000c00 tx=0x7f81c8009040 comp rx=0 tx=0).stop 2023-10-06T04:40:04.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.843+0000 7f81dca49700 1 -- 172.21.15.112:0/1978446667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81d80b41c0 msgr2=0x7f81d815c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.843+0000 7f81dca49700 1 --2- 172.21.15.112:0/1978446667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81d80b41c0 0x7f81d815c790 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f81c400c130 tx=0x7f81c0015000 comp rx=0 tx=0).stop 2023-10-06T04:40:04.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.844+0000 7f81dca49700 1 -- 172.21.15.112:0/1978446667 shutdown_connections 2023-10-06T04:40:04.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.844+0000 7f81dca49700 1 --2- 172.21.15.112:0/1978446667 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f81b8066f30 0x7f81b80693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.844+0000 7f81dca49700 1 --2- 172.21.15.112:0/1978446667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81d80b4630 0x7f81d815ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.844+0000 7f81dca49700 1 --2- 172.21.15.112:0/1978446667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4004810 0x7f81d8146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.844+0000 7f81dca49700 1 --2- 172.21.15.112:0/1978446667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81d80b41c0 0x7f81d815c790 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.844+0000 7f81dca49700 1 -- 172.21.15.112:0/1978446667 >> 172.21.15.112:0/1978446667 conn(0x7f81d806cfb0 msgr2=0x7f81d80cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:04.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.844+0000 7f81dca49700 1 -- 172.21.15.112:0/1978446667 shutdown_connections 2023-10-06T04:40:04.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.844+0000 7f81dca49700 1 -- 172.21.15.112:0/1978446667 wait complete. 2023-10-06T04:40:04.846 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2023-10-06T04:40:04.858 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T04:40:04.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.978+0000 7f4aa1d11700 1 Processor -- start 2023-10-06T04:40:04.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.978+0000 7f4aa1d11700 1 -- start start 2023-10-06T04:40:04.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.978+0000 7f4aa1d11700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a9c159a20 0x7f4a9c0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.978+0000 7f4aa1d11700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4a9c06d3b0 0x7f4a9c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.978+0000 7f4aa1d11700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4a9c15a9f0 0x7f4a9c15d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.978+0000 7f4aa1d11700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a9c0cca70 con 0x7f4a9c15a9f0 2023-10-06T04:40:04.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.978+0000 7f4aa1d11700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a9c08a080 con 0x7f4a9c06d3b0 2023-10-06T04:40:04.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.978+0000 7f4aa1d11700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c15af50 con 0x7f4a9c159a20 2023-10-06T04:40:04.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.978+0000 7f4a9bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4a9c15a9f0 0x7f4a9c15d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.979+0000 7f4a9bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4a9c15a9f0 0x7f4a9c15d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39412/0 (socket says 172.21.15.112:39412) 2023-10-06T04:40:04.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.979+0000 7f4a9bfff700 1 -- 172.21.15.112:0/748931969 learned_addr learned my addr 172.21.15.112:0/748931969 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:04.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.979+0000 7f4a9affd700 1 --2- 172.21.15.112:0/748931969 >> v2:172.21.15.179:3300/0 conn(0x7f4a9c06d3b0 0x7f4a9c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.979+0000 7f4a9b7fe700 1 --2- 172.21.15.112:0/748931969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a9c159a20 0x7f4a9c0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.979+0000 7f4a9bfff700 1 -- 172.21.15.112:0/748931969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a9c159a20 msgr2=0x7f4a9c0cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:04.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.979+0000 7f4a9bfff700 1 --2- 172.21.15.112:0/748931969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a9c159a20 0x7f4a9c0cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.979+0000 7f4a9bfff700 1 -- 172.21.15.112:0/748931969 >> v2:172.21.15.179:3300/0 conn(0x7f4a9c06d3b0 msgr2=0x7f4a9c0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:04.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.979+0000 7f4a9bfff700 1 --2- 172.21.15.112:0/748931969 >> v2:172.21.15.179:3300/0 conn(0x7f4a9c06d3b0 0x7f4a9c0cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.979+0000 7f4a9bfff700 1 -- 172.21.15.112:0/748931969 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c0cae50 con 0x7f4a9c15a9f0 2023-10-06T04:40:04.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.979+0000 7f4a9bfff700 1 --2- 172.21.15.112:0/748931969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a9c15a9f0 0x7f4a9c15d550 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c089430 tx=0x7f4a94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1afeda8c37a9f3f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:04.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.979+0000 7f4a9a7fc700 1 -- 172.21.15.112:0/748931969 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9400b820 con 0x7f4a9c15a9f0 2023-10-06T04:40:04.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.979+0000 7f4a9a7fc700 1 -- 172.21.15.112:0/748931969 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9400b980 con 0x7f4a9c15a9f0 2023-10-06T04:40:04.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.979+0000 7f4a9a7fc700 1 -- 172.21.15.112:0/748931969 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9400bd20 con 0x7f4a9c15a9f0 2023-10-06T04:40:04.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.980+0000 7f4aa1d11700 1 -- 172.21.15.112:0/748931969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a9c15a9f0 msgr2=0x7f4a9c15d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.980+0000 7f4aa1d11700 1 --2- 172.21.15.112:0/748931969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a9c15a9f0 0x7f4a9c15d550 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c089430 tx=0x7f4a94009250 comp rx=0 tx=0).stop 2023-10-06T04:40:04.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.980+0000 7f4aa1d11700 1 -- 172.21.15.112:0/748931969 shutdown_connections 2023-10-06T04:40:04.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.980+0000 7f4aa1d11700 1 --2- 172.21.15.112:0/748931969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a9c159a20 0x7f4a9c0cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.980+0000 7f4aa1d11700 1 --2- 172.21.15.112:0/748931969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a9c15a9f0 0x7f4a9c15d550 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.980+0000 7f4aa1d11700 1 --2- 172.21.15.112:0/748931969 >> v2:172.21.15.179:3300/0 conn(0x7f4a9c06d3b0 0x7f4a9c0cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.980+0000 7f4aa1d11700 1 -- 172.21.15.112:0/748931969 >> 172.21.15.112:0/748931969 conn(0x7f4a9c06cfb0 msgr2=0x7f4a9c0d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:04.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.980+0000 7f4aa1d11700 1 -- 172.21.15.112:0/748931969 shutdown_connections 2023-10-06T04:40:04.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.980+0000 7f4aa1d11700 1 -- 172.21.15.112:0/748931969 wait complete. 2023-10-06T04:40:04.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.981+0000 7f4aa1d11700 1 Processor -- start 2023-10-06T04:40:04.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.981+0000 7f4aa1d11700 1 -- start start 2023-10-06T04:40:04.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.982+0000 7f4aa1d11700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a9c06d3b0 0x7f4a9c1495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.982+0000 7f4aa1d11700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a9c159a20 0x7f4a9c0ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.982+0000 7f4aa1d11700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a9c15a9f0 0x7f4a9c0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.982+0000 7f4aa1d11700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c15cc30 con 0x7f4a9c15a9f0 2023-10-06T04:40:04.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.982+0000 7f4aa1d11700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c0b1c60 con 0x7f4a9c159a20 2023-10-06T04:40:04.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.982+0000 7f4aa1d11700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c0b1f40 con 0x7f4a9c06d3b0 2023-10-06T04:40:04.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.982+0000 7f4a9bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a9c15a9f0 0x7f4a9c0cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.982+0000 7f4a9bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a9c15a9f0 0x7f4a9c0cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39418/0 (socket says 172.21.15.112:39418) 2023-10-06T04:40:04.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.982+0000 7f4a9bfff700 1 -- 172.21.15.112:0/3063916053 learned_addr learned my addr 172.21.15.112:0/3063916053 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:04.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.982+0000 7f4a9b7fe700 1 --2- 172.21.15.112:0/3063916053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a9c06d3b0 0x7f4a9c1495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.982+0000 7f4a9affd700 1 --2- 172.21.15.112:0/3063916053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a9c159a20 0x7f4a9c0ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.982+0000 7f4a9bfff700 1 -- 172.21.15.112:0/3063916053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a9c06d3b0 msgr2=0x7f4a9c1495c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.982+0000 7f4a9bfff700 1 --2- 172.21.15.112:0/3063916053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a9c06d3b0 0x7f4a9c1495c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.982+0000 7f4a9bfff700 1 -- 172.21.15.112:0/3063916053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a9c159a20 msgr2=0x7f4a9c0ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:04.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.982+0000 7f4a9bfff700 1 --2- 172.21.15.112:0/3063916053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a9c159a20 0x7f4a9c0ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:04.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.982+0000 7f4a9bfff700 1 -- 172.21.15.112:0/3063916053 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a940094f0 con 0x7f4a9c15a9f0 2023-10-06T04:40:04.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.982+0000 7f4a9bfff700 1 --2- 172.21.15.112:0/3063916053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a9c15a9f0 0x7f4a9c0cf000 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4a94009290 tx=0x7f4a94017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:04.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.983+0000 7f4a837fe700 1 -- 172.21.15.112:0/3063916053 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a94011ea0 con 0x7f4a9c15a9f0 2023-10-06T04:40:04.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.983+0000 7f4a837fe700 1 -- 172.21.15.112:0/3063916053 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9401a660 con 0x7f4a9c15a9f0 2023-10-06T04:40:04.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.983+0000 7f4aa1d11700 1 -- 172.21.15.112:0/3063916053 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a9c0b2220 con 0x7f4a9c15a9f0 2023-10-06T04:40:04.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.983+0000 7f4a837fe700 1 -- 172.21.15.112:0/3063916053 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9401aa20 con 0x7f4a9c15a9f0 2023-10-06T04:40:04.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.983+0000 7f4aa1d11700 1 -- 172.21.15.112:0/3063916053 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a9c0b27e0 con 0x7f4a9c15a9f0 2023-10-06T04:40:04.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.984+0000 7f4aa1d11700 1 -- 172.21.15.112:0/3063916053 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a9c0b40f0 con 0x7f4a9c15a9f0 2023-10-06T04:40:04.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.984+0000 7f4a837fe700 1 -- 172.21.15.112:0/3063916053 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a94025440 con 0x7f4a9c15a9f0 2023-10-06T04:40:04.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.984+0000 7f4a837fe700 1 --2- 172.21.15.112:0/3063916053 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4a88066f30 0x7f4a880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:04.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.985+0000 7f4a837fe700 1 -- 172.21.15.112:0/3063916053 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f4a94086180 con 0x7f4a9c15a9f0 2023-10-06T04:40:04.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.985+0000 7f4a9b7fe700 1 --2- 172.21.15.112:0/3063916053 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4a88066f30 0x7f4a880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:04.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.985+0000 7f4a9b7fe700 1 --2- 172.21.15.112:0/3063916053 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4a88066f30 0x7f4a880693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00f610 tx=0x7f4a8c0077f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:04.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:04.989+0000 7f4a837fe700 1 -- 172.21.15.112:0/3063916053 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a94053470 con 0x7f4a9c15a9f0 2023-10-06T04:40:05.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.173+0000 7f4aa1d11700 1 -- 172.21.15.112:0/3063916053 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4a9c0b29d0 con 0x7f4a9c15a9f0 2023-10-06T04:40:05.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.841+0000 7f4a837fe700 1 -- 172.21.15.112:0/3063916053 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4a94009350 con 0x7f4a9c15a9f0 2023-10-06T04:40:05.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.846+0000 7f4aa1d11700 1 -- 172.21.15.112:0/3063916053 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4a88066f30 msgr2=0x7f4a880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:05.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.846+0000 7f4aa1d11700 1 --2- 172.21.15.112:0/3063916053 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4a88066f30 0x7f4a880693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00f610 tx=0x7f4a8c0077f0 comp rx=0 tx=0).stop 2023-10-06T04:40:05.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.846+0000 7f4aa1d11700 1 -- 172.21.15.112:0/3063916053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a9c15a9f0 msgr2=0x7f4a9c0cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:05.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.846+0000 7f4aa1d11700 1 --2- 172.21.15.112:0/3063916053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a9c15a9f0 0x7f4a9c0cf000 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4a94009290 tx=0x7f4a94017000 comp rx=0 tx=0).stop 2023-10-06T04:40:05.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.849+0000 7f4aa1d11700 1 -- 172.21.15.112:0/3063916053 shutdown_connections 2023-10-06T04:40:05.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.849+0000 7f4aa1d11700 1 --2- 172.21.15.112:0/3063916053 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4a88066f30 0x7f4a880693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:05.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.849+0000 7f4aa1d11700 1 --2- 172.21.15.112:0/3063916053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a9c15a9f0 0x7f4a9c0cf000 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:05.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.849+0000 7f4aa1d11700 1 --2- 172.21.15.112:0/3063916053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a9c06d3b0 0x7f4a9c1495c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:05.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.849+0000 7f4aa1d11700 1 --2- 172.21.15.112:0/3063916053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a9c159a20 0x7f4a9c0ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:05.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.849+0000 7f4aa1d11700 1 -- 172.21.15.112:0/3063916053 >> 172.21.15.112:0/3063916053 conn(0x7f4a9c06cfb0 msgr2=0x7f4a9c14a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:05.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.849+0000 7f4aa1d11700 1 -- 172.21.15.112:0/3063916053 shutdown_connections 2023-10-06T04:40:05.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.849+0000 7f4aa1d11700 1 -- 172.21.15.112:0/3063916053 wait complete. 2023-10-06T04:40:05.857 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2023-10-06T04:40:05.870 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T04:40:05.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.986+0000 7f87c2250700 1 Processor -- start 2023-10-06T04:40:05.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.986+0000 7f87c2250700 1 -- start start 2023-10-06T04:40:05.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.987+0000 7f87c2250700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87bc0afe70 0x7f87bc0caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:05.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.987+0000 7f87c2250700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87bc0cc1c0 con 0x7f87bc0cccd0 2023-10-06T04:40:05.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.987+0000 7f87c2250700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87bc157f30 con 0x7f87bc156c30 2023-10-06T04:40:05.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.987+0000 7f87c2250700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc1570a0 con 0x7f87bc0afe70 2023-10-06T04:40:05.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.987+0000 7f87c1a4f700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f87bc0cccd0 0x7f87bc0c8f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60932/0 (socket says 172.21.15.112:60932) 2023-10-06T04:40:05.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.987+0000 7f87c1a4f700 1 -- 172.21.15.112:0/1854301717 learned_addr learned my addr 172.21.15.112:0/1854301717 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:05.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.987+0000 7f87b3fff700 1 -- 172.21.15.112:0/1854301717 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 871424397 0 0) 0x7f87bc0cc1c0 con 0x7f87bc0cccd0 2023-10-06T04:40:05.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.987+0000 7f87c124e700 1 --2- 172.21.15.112:0/1854301717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87bc0afe70 0x7f87bc0caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:05.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.987+0000 7f87b3fff700 1 -- 172.21.15.112:0/1854301717 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87a8003570 con 0x7f87bc0cccd0 2023-10-06T04:40:05.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.987+0000 7f87b3fff700 1 -- 172.21.15.112:0/1854301717 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1820811141 0 0) 0x7f87a8003570 con 0x7f87bc0cccd0 2023-10-06T04:40:05.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.987+0000 7f87b3fff700 1 -- 172.21.15.112:0/1854301717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87bc0afe70 msgr2=0x7f87bc0caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:05.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.987+0000 7f87b3fff700 1 --2- 172.21.15.112:0/1854301717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87bc0afe70 0x7f87bc0caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:05.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.987+0000 7f87b3fff700 1 -- 172.21.15.112:0/1854301717 >> v1:172.21.15.179:6789/0 conn(0x7f87bc156c30 legacy=0x7f87bc0cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:05.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.987+0000 7f87b3fff700 1 -- 172.21.15.112:0/1854301717 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87bc0cb5b0 con 0x7f87bc0cccd0 2023-10-06T04:40:05.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.987+0000 7f87b3fff700 1 -- 172.21.15.112:0/1854301717 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f87b4001470 con 0x7f87bc0cccd0 2023-10-06T04:40:05.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.987+0000 7f87b3fff700 1 -- 172.21.15.112:0/1854301717 >> v1:172.21.15.112:6789/0 conn(0x7f87bc0cccd0 legacy=0x7f87bc0c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:05.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.987+0000 7f87b3fff700 1 --2- 172.21.15.112:0/1854301717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87a8003a90 0x7f87a8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:05.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.987+0000 7f87b3fff700 1 --2- 172.21.15.112:0/1854301717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87bc0afe70 0x7f87a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:05.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.987+0000 7f87b3fff700 1 --2- 172.21.15.112:0/1854301717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87a8004d50 0x7f87a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:05.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.987+0000 7f87b3fff700 1 -- 172.21.15.112:0/1854301717 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc1570a0 con 0x7f87a8003a90 2023-10-06T04:40:05.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.988+0000 7f87b3fff700 1 -- 172.21.15.112:0/1854301717 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a800bb70 con 0x7f87a8004d50 2023-10-06T04:40:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.988+0000 7f87b3fff700 1 -- 172.21.15.112:0/1854301717 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a800bd30 con 0x7f87bc0afe70 2023-10-06T04:40:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.988+0000 7f87c124e700 1 --2- 172.21.15.112:0/1854301717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87a8003a90 0x7f87a8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.988+0000 7f87c0a4d700 1 --2- 172.21.15.112:0/1854301717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87bc0afe70 0x7f87a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.988+0000 7f87c1a4f700 1 --2- 172.21.15.112:0/1854301717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87a8004d50 0x7f87a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.988+0000 7f87c124e700 1 -- 172.21.15.112:0/1854301717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87bc0afe70 msgr2=0x7f87a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.988+0000 7f87c124e700 1 --2- 172.21.15.112:0/1854301717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87bc0afe70 0x7f87a8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.988+0000 7f87c124e700 1 -- 172.21.15.112:0/1854301717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87a8004d50 msgr2=0x7f87a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.988+0000 7f87c124e700 1 --2- 172.21.15.112:0/1854301717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87a8004d50 0x7f87a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.988+0000 7f87c124e700 1 -- 172.21.15.112:0/1854301717 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a8003570 con 0x7f87a8003a90 2023-10-06T04:40:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.988+0000 7f87c1a4f700 1 --2- 172.21.15.112:0/1854301717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87a8004d50 0x7f87a80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.988+0000 7f87c124e700 1 --2- 172.21.15.112:0/1854301717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87a8003a90 0x7f87a8003ea0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f87b800e210 tx=0x7f87b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2fe312a70cc83f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.988+0000 7f87b3fff700 1 -- 172.21.15.112:0/1854301717 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b800eac0 con 0x7f87a8003a90 2023-10-06T04:40:05.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.988+0000 7f87b3fff700 1 -- 172.21.15.112:0/1854301717 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b800f040 con 0x7f87a8003a90 2023-10-06T04:40:05.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.988+0000 7f87b3fff700 1 -- 172.21.15.112:0/1854301717 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b800ee70 con 0x7f87a8003a90 2023-10-06T04:40:05.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.989+0000 7f87c2250700 1 -- 172.21.15.112:0/1854301717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87a8003a90 msgr2=0x7f87a8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:05.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.989+0000 7f87c2250700 1 --2- 172.21.15.112:0/1854301717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87a8003a90 0x7f87a8003ea0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f87b800e210 tx=0x7f87b800b040 comp rx=0 tx=0).stop 2023-10-06T04:40:05.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.989+0000 7f87c1a4f700 1 -- 172.21.15.112:0/1854301717 reap_dead start 2023-10-06T04:40:05.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.989+0000 7f87c2250700 1 -- 172.21.15.112:0/1854301717 shutdown_connections 2023-10-06T04:40:05.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.989+0000 7f87c2250700 1 -- 172.21.15.112:0/1854301717 >> 172.21.15.112:0/1854301717 conn(0x7f87bc06d8e0 msgr2=0x7f87bc06dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:05.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.989+0000 7f87c2250700 1 -- 172.21.15.112:0/1854301717 shutdown_connections 2023-10-06T04:40:05.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.989+0000 7f87c2250700 1 -- 172.21.15.112:0/1854301717 wait complete. 2023-10-06T04:40:05.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.990+0000 7f87c2250700 1 Processor -- start 2023-10-06T04:40:05.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.990+0000 7f87c2250700 1 -- start start 2023-10-06T04:40:05.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87c2250700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87a8003a90 0x7f87bc0b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:05.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87c2250700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87bc0c4390 0x7f87bc0b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:05.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87c2250700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87bc147540 0x7f87bc0b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:05.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87c2250700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc0c7780 con 0x7f87bc0c4390 2023-10-06T04:40:05.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87c2250700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc0c69c0 con 0x7f87a8003a90 2023-10-06T04:40:05.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87c2250700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc0c6ca0 con 0x7f87bc147540 2023-10-06T04:40:05.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87c0a4d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87bc0c4390 0x7f87bc0b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:05.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87c0a4d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87bc0c4390 0x7f87bc0b0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39444/0 (socket says 172.21.15.112:39444) 2023-10-06T04:40:05.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87c0a4d700 1 -- 172.21.15.112:0/4265994499 learned_addr learned my addr 172.21.15.112:0/4265994499 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:05.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87c124e700 1 --2- 172.21.15.112:0/4265994499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87a8003a90 0x7f87bc0b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:05.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87c1a4f700 1 --2- 172.21.15.112:0/4265994499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87bc147540 0x7f87bc0b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:05.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87c0a4d700 1 -- 172.21.15.112:0/4265994499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87bc147540 msgr2=0x7f87bc0b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:05.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87c0a4d700 1 --2- 172.21.15.112:0/4265994499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87bc147540 0x7f87bc0b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:05.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87c0a4d700 1 -- 172.21.15.112:0/4265994499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87a8003a90 msgr2=0x7f87bc0b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:05.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87c0a4d700 1 --2- 172.21.15.112:0/4265994499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87a8003a90 0x7f87bc0b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:05.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87c0a4d700 1 -- 172.21.15.112:0/4265994499 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87bc0c6f80 con 0x7f87bc0c4390 2023-10-06T04:40:05.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87c0a4d700 1 --2- 172.21.15.112:0/4265994499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87bc0c4390 0x7f87bc0b0de0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f87ac002950 tx=0x7f87ac007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:05.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87b17fa700 1 -- 172.21.15.112:0/4265994499 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ac003390 con 0x7f87bc0c4390 2023-10-06T04:40:05.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87b17fa700 1 -- 172.21.15.112:0/4265994499 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ac006820 con 0x7f87bc0c4390 2023-10-06T04:40:05.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87b17fa700 1 -- 172.21.15.112:0/4265994499 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ac006c00 con 0x7f87bc0c4390 2023-10-06T04:40:05.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87c2250700 1 -- 172.21.15.112:0/4265994499 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87bc0c7260 con 0x7f87bc0c4390 2023-10-06T04:40:05.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.991+0000 7f87c2250700 1 -- 172.21.15.112:0/4265994499 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87bc0b2ed0 con 0x7f87bc0c4390 2023-10-06T04:40:05.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.992+0000 7f87c2250700 1 -- 172.21.15.112:0/4265994499 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87bc0b3150 con 0x7f87bc0c4390 2023-10-06T04:40:05.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.993+0000 7f87b17fa700 1 -- 172.21.15.112:0/4265994499 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87ac007230 con 0x7f87bc0c4390 2023-10-06T04:40:05.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.993+0000 7f87b17fa700 1 --2- 172.21.15.112:0/4265994499 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f87a0066f30 0x7f87a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:05.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.993+0000 7f87b17fa700 1 -- 172.21.15.112:0/4265994499 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f87ac0842f0 con 0x7f87bc0c4390 2023-10-06T04:40:05.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.993+0000 7f87c124e700 1 --2- 172.21.15.112:0/4265994499 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f87a0066f30 0x7f87a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:05.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.994+0000 7f87c124e700 1 --2- 172.21.15.112:0/4265994499 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f87a0066f30 0x7f87a00693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f87b800afd0 tx=0x7f87b801a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:05.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:05.998+0000 7f87b17fa700 1 -- 172.21.15.112:0/4265994499 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87ac051520 con 0x7f87bc0c4390 2023-10-06T04:40:06.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:06.222+0000 7f87c2250700 1 -- 172.21.15.112:0/4265994499 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f87bc157f30 con 0x7f87bc0c4390 2023-10-06T04:40:06.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:06.869+0000 7f87b17fa700 1 -- 172.21.15.112:0/4265994499 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f87bc157f30 con 0x7f87bc0c4390 2023-10-06T04:40:06.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:06.873+0000 7f87c2250700 1 -- 172.21.15.112:0/4265994499 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f87a0066f30 msgr2=0x7f87a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:06.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:06.873+0000 7f87c2250700 1 --2- 172.21.15.112:0/4265994499 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f87a0066f30 0x7f87a00693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f87b800afd0 tx=0x7f87b801a000 comp rx=0 tx=0).stop 2023-10-06T04:40:06.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:06.873+0000 7f87c2250700 1 -- 172.21.15.112:0/4265994499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87bc0c4390 msgr2=0x7f87bc0b0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:06.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:06.873+0000 7f87c2250700 1 --2- 172.21.15.112:0/4265994499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87bc0c4390 0x7f87bc0b0de0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f87ac002950 tx=0x7f87ac007d30 comp rx=0 tx=0).stop 2023-10-06T04:40:06.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:06.876+0000 7f87c2250700 1 -- 172.21.15.112:0/4265994499 shutdown_connections 2023-10-06T04:40:06.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:06.876+0000 7f87c2250700 1 --2- 172.21.15.112:0/4265994499 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f87a0066f30 0x7f87a00693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:06.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:06.876+0000 7f87c2250700 1 --2- 172.21.15.112:0/4265994499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87bc147540 0x7f87bc0b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:06.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:06.876+0000 7f87c2250700 1 --2- 172.21.15.112:0/4265994499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87a8003a90 0x7f87bc0b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:06.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:06.876+0000 7f87c2250700 1 --2- 172.21.15.112:0/4265994499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87bc0c4390 0x7f87bc0b0de0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:06.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:06.876+0000 7f87c2250700 1 -- 172.21.15.112:0/4265994499 >> 172.21.15.112:0/4265994499 conn(0x7f87bc06d8e0 msgr2=0x7f87bc157270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:06.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:06.876+0000 7f87c2250700 1 -- 172.21.15.112:0/4265994499 shutdown_connections 2023-10-06T04:40:06.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:06.876+0000 7f87c2250700 1 -- 172.21.15.112:0/4265994499 wait complete. 2023-10-06T04:40:06.879 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 5 and data pool 6 2023-10-06T04:40:06.892 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:07.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.006+0000 7fb76c126700 1 Processor -- start 2023-10-06T04:40:07.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.006+0000 7fb76c126700 1 -- start start 2023-10-06T04:40:07.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.007+0000 7fb76c126700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb764067eb0 0x7fb7640682c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.007+0000 7fb76c126700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb76406ed60 con 0x7fb76406f650 2023-10-06T04:40:07.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.007+0000 7fb76c126700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb76406e1c0 con 0x7fb764159900 2023-10-06T04:40:07.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.007+0000 7fb76c126700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb76415db20 con 0x7fb764067eb0 2023-10-06T04:40:07.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.007+0000 7fb7696c1700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb76406f650 0x7fb76406e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60934/0 (socket says 172.21.15.112:60934) 2023-10-06T04:40:07.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.007+0000 7fb7696c1700 1 -- 172.21.15.112:0/2514883665 learned_addr learned my addr 172.21.15.112:0/2514883665 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:07.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.007+0000 7fb76a6c3700 1 --2- 172.21.15.112:0/2514883665 >> v2:172.21.15.179:3300/0 conn(0x7fb764067eb0 0x7fb7640682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.008+0000 7fb768ec0700 1 -- 172.21.15.112:0/2514883665 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607198783 0 0) 0x7fb754001110 con 0x7fb76406f650 2023-10-06T04:40:07.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.008+0000 7fb768ec0700 1 -- 172.21.15.112:0/2514883665 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb750003570 con 0x7fb76406f650 2023-10-06T04:40:07.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.008+0000 7fb768ec0700 1 -- 172.21.15.112:0/2514883665 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488200961 0 0) 0x7fb76406e1c0 con 0x7fb764159900 2023-10-06T04:40:07.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.008+0000 7fb768ec0700 1 -- 172.21.15.112:0/2514883665 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb754001110 con 0x7fb764159900 2023-10-06T04:40:07.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.008+0000 7fb76a6c3700 1 -- 172.21.15.112:0/2514883665 >> v1:172.21.15.179:6789/0 conn(0x7fb764159900 legacy=0x7fb76415d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.008+0000 7fb76a6c3700 1 -- 172.21.15.112:0/2514883665 >> v1:172.21.15.112:6789/0 conn(0x7fb76406f650 legacy=0x7fb76406e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.008+0000 7fb76a6c3700 1 -- 172.21.15.112:0/2514883665 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb764068800 con 0x7fb764067eb0 2023-10-06T04:40:07.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.008+0000 7fb76a6c3700 1 --2- 172.21.15.112:0/2514883665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb764067eb0 0x7fb7640682c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb75c0098e0 tx=0x7fb75c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5456c628c87d9ff6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:07.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.008+0000 7fb768ec0700 1 -- 172.21.15.112:0/2514883665 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c011630 con 0x7fb764067eb0 2023-10-06T04:40:07.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.008+0000 7fb768ec0700 1 -- 172.21.15.112:0/2514883665 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c011790 con 0x7fb764067eb0 2023-10-06T04:40:07.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.008+0000 7fb768ec0700 1 -- 172.21.15.112:0/2514883665 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c011b30 con 0x7fb764067eb0 2023-10-06T04:40:07.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.009+0000 7fb76c126700 1 -- 172.21.15.112:0/2514883665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb764067eb0 msgr2=0x7fb7640682c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.009+0000 7fb76c126700 1 --2- 172.21.15.112:0/2514883665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb764067eb0 0x7fb7640682c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb75c0098e0 tx=0x7fb75c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.009+0000 7fb76c126700 1 -- 172.21.15.112:0/2514883665 shutdown_connections 2023-10-06T04:40:07.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.009+0000 7fb76c126700 1 --2- 172.21.15.112:0/2514883665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb764067eb0 0x7fb7640682c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.009+0000 7fb76c126700 1 -- 172.21.15.112:0/2514883665 >> 172.21.15.112:0/2514883665 conn(0x7fb7640ce5e0 msgr2=0x7fb7640ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:07.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.009+0000 7fb76c126700 1 -- 172.21.15.112:0/2514883665 shutdown_connections 2023-10-06T04:40:07.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.009+0000 7fb76c126700 1 -- 172.21.15.112:0/2514883665 wait complete. 2023-10-06T04:40:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.010+0000 7fb76c126700 1 Processor -- start 2023-10-06T04:40:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.010+0000 7fb76c126700 1 -- start start 2023-10-06T04:40:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.011+0000 7fb76c126700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb764067eb0 0x7fb764156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.011+0000 7fb76c126700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb76406f650 0x7fb7640ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.011+0000 7fb76c126700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb764159900 0x7fb76415ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.011+0000 7fb76c126700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640a98a0 con 0x7fb764159900 2023-10-06T04:40:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.011+0000 7fb76c126700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640aa140 con 0x7fb76406f650 2023-10-06T04:40:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.011+0000 7fb76c126700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb764157260 con 0x7fb764067eb0 2023-10-06T04:40:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.011+0000 7fb76a6c3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb764159900 0x7fb76415ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.011+0000 7fb76a6c3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb764159900 0x7fb76415ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39456/0 (socket says 172.21.15.112:39456) 2023-10-06T04:40:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.011+0000 7fb76a6c3700 1 -- 172.21.15.112:0/3144217492 learned_addr learned my addr 172.21.15.112:0/3144217492 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:07.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.011+0000 7fb7696c1700 1 --2- 172.21.15.112:0/3144217492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb76406f650 0x7fb7640ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.011+0000 7fb769ec2700 1 --2- 172.21.15.112:0/3144217492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb764067eb0 0x7fb764156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.011+0000 7fb76a6c3700 1 -- 172.21.15.112:0/3144217492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb764067eb0 msgr2=0x7fb764156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.011+0000 7fb76a6c3700 1 --2- 172.21.15.112:0/3144217492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb764067eb0 0x7fb764156d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.011+0000 7fb76a6c3700 1 -- 172.21.15.112:0/3144217492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb76406f650 msgr2=0x7fb7640ac9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.011+0000 7fb76a6c3700 1 --2- 172.21.15.112:0/3144217492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb76406f650 0x7fb7640ac9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.011+0000 7fb76a6c3700 1 -- 172.21.15.112:0/3144217492 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c009420 con 0x7fb764159900 2023-10-06T04:40:07.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.011+0000 7fb76a6c3700 1 --2- 172.21.15.112:0/3144217492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb764159900 0x7fb76415ba90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009ed0 tx=0x7fb75c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:07.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.011+0000 7fb759ffb700 1 -- 172.21.15.112:0/3144217492 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c01f070 con 0x7fb764159900 2023-10-06T04:40:07.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.011+0000 7fb759ffb700 1 -- 172.21.15.112:0/3144217492 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c011900 con 0x7fb764159900 2023-10-06T04:40:07.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.011+0000 7fb76c126700 1 -- 172.21.15.112:0/3144217492 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7640acf30 con 0x7fb764159900 2023-10-06T04:40:07.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.011+0000 7fb759ffb700 1 -- 172.21.15.112:0/3144217492 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c025420 con 0x7fb764159900 2023-10-06T04:40:07.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.012+0000 7fb76c126700 1 -- 172.21.15.112:0/3144217492 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7640a9af0 con 0x7fb764159900 2023-10-06T04:40:07.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.013+0000 7fb76c126700 1 -- 172.21.15.112:0/3144217492 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7640aa2b0 con 0x7fb764159900 2023-10-06T04:40:07.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.013+0000 7fb759ffb700 1 -- 172.21.15.112:0/3144217492 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb75c023070 con 0x7fb764159900 2023-10-06T04:40:07.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.013+0000 7fb759ffb700 1 --2- 172.21.15.112:0/3144217492 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb748066f30 0x7fb7480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.014+0000 7fb759ffb700 1 -- 172.21.15.112:0/3144217492 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb75c085c40 con 0x7fb764159900 2023-10-06T04:40:07.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.014+0000 7fb769ec2700 1 --2- 172.21.15.112:0/3144217492 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb748066f30 0x7fb7480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.014+0000 7fb769ec2700 1 --2- 172.21.15.112:0/3144217492 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb748066f30 0x7fb7480693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb760007fd0 tx=0x7fb760009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:07.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.018+0000 7fb759ffb700 1 -- 172.21.15.112:0/3144217492 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb75c052d50 con 0x7fb764159900 2023-10-06T04:40:07.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.204+0000 7fb76c126700 1 -- 172.21.15.112:0/3144217492 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb76405f230 con 0x7fb764159900 2023-10-06T04:40:07.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.204+0000 7fb759ffb700 1 -- 172.21.15.112:0/3144217492 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16927 (secure 0 0 0) 0x7fb75c02a090 con 0x7fb764159900 2023-10-06T04:40:07.206 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:07.206 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":30,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:40:06.223529+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:40:04.313893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:40:05.190449+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:07.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.206+0000 7fb76c126700 1 -- 172.21.15.112:0/3144217492 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb748066f30 msgr2=0x7fb7480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.206+0000 7fb76c126700 1 --2- 172.21.15.112:0/3144217492 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb748066f30 0x7fb7480693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb760007fd0 tx=0x7fb760009040 comp rx=0 tx=0).stop 2023-10-06T04:40:07.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.206+0000 7fb76c126700 1 -- 172.21.15.112:0/3144217492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb764159900 msgr2=0x7fb76415ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.206+0000 7fb76c126700 1 --2- 172.21.15.112:0/3144217492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb764159900 0x7fb76415ba90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009ed0 tx=0x7fb75c017000 comp rx=0 tx=0).stop 2023-10-06T04:40:07.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.206+0000 7fb76c126700 1 -- 172.21.15.112:0/3144217492 shutdown_connections 2023-10-06T04:40:07.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.206+0000 7fb76c126700 1 --2- 172.21.15.112:0/3144217492 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb748066f30 0x7fb7480693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.206+0000 7fb76c126700 1 --2- 172.21.15.112:0/3144217492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb764159900 0x7fb76415ba90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.206+0000 7fb76c126700 1 --2- 172.21.15.112:0/3144217492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb764067eb0 0x7fb764156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.206+0000 7fb76c126700 1 --2- 172.21.15.112:0/3144217492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb76406f650 0x7fb7640ac9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.207+0000 7fb76c126700 1 -- 172.21.15.112:0/3144217492 >> 172.21.15.112:0/3144217492 conn(0x7fb7640ce5e0 msgr2=0x7fb764157ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:07.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.207+0000 7fb76c126700 1 -- 172.21.15.112:0/3144217492 shutdown_connections 2023-10-06T04:40:07.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.207+0000 7fb76c126700 1 -- 172.21.15.112:0/3144217492 wait complete. 2023-10-06T04:40:07.220 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:07.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.332+0000 7f979db2d700 1 Processor -- start 2023-10-06T04:40:07.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.332+0000 7f979db2d700 1 -- start start 2023-10-06T04:40:07.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.333+0000 7f979db2d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97980a9ae0 0x7f979815d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.333+0000 7f979db2d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f979806bd70 0x7f97981592a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.333+0000 7f979db2d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979806c7d0 con 0x7f97980a9eb0 2023-10-06T04:40:07.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.333+0000 7f979db2d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979806cab0 con 0x7f979806bd70 2023-10-06T04:40:07.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.333+0000 7f979db2d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979815d920 con 0x7f97980a9ae0 2023-10-06T04:40:07.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.334+0000 7f9796ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f979806bd70 0x7f97981592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.334+0000 7f97977fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97980a9ae0 0x7f979815d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.334+0000 7f9796ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f979806bd70 0x7f97981592a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.112:46078/0 (socket says 172.21.15.112:46078) 2023-10-06T04:40:07.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.334+0000 7f9796ffd700 1 -- 172.21.15.112:0/3936143037 learned_addr learned my addr 172.21.15.112:0/3936143037 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:07.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.334+0000 7f9796ffd700 1 -- 172.21.15.112:0/3936143037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97980a9ae0 msgr2=0x7f979815d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:07.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.334+0000 7f9796ffd700 1 --2- 172.21.15.112:0/3936143037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97980a9ae0 0x7f979815d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.334+0000 7f9796ffd700 1 -- 172.21.15.112:0/3936143037 >> v1:172.21.15.179:6789/0 conn(0x7f97980a9eb0 legacy=0x7f97981597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.334+0000 7f9796ffd700 1 -- 172.21.15.112:0/3936143037 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979815dbc0 con 0x7f979806bd70 2023-10-06T04:40:07.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.334+0000 7f97967fc700 1 -- 172.21.15.112:0/3936143037 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011951025 0 0) 0x7f979806c7d0 con 0x7f97980a9eb0 2023-10-06T04:40:07.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.334+0000 7f9796ffd700 1 --2- 172.21.15.112:0/3936143037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f979806bd70 0x7f97981592a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f978c0099e0 tx=0x7f978c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16a3806c35fc87b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:07.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.334+0000 7f97967fc700 1 -- 172.21.15.112:0/3936143037 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c00b820 con 0x7f979806bd70 2023-10-06T04:40:07.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.334+0000 7f97967fc700 1 -- 172.21.15.112:0/3936143037 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978c00b980 con 0x7f979806bd70 2023-10-06T04:40:07.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.334+0000 7f97967fc700 1 -- 172.21.15.112:0/3936143037 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c00bd20 con 0x7f979806bd70 2023-10-06T04:40:07.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.335+0000 7f979db2d700 1 -- 172.21.15.112:0/3936143037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f979806bd70 msgr2=0x7f97981592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.335+0000 7f979db2d700 1 --2- 172.21.15.112:0/3936143037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f979806bd70 0x7f97981592a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f978c0099e0 tx=0x7f978c009250 comp rx=0 tx=0).stop 2023-10-06T04:40:07.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.335+0000 7f979db2d700 1 -- 172.21.15.112:0/3936143037 shutdown_connections 2023-10-06T04:40:07.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.335+0000 7f979db2d700 1 --2- 172.21.15.112:0/3936143037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97980a9ae0 0x7f979815d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.335+0000 7f979db2d700 1 --2- 172.21.15.112:0/3936143037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f979806bd70 0x7f97981592a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.335+0000 7f979db2d700 1 -- 172.21.15.112:0/3936143037 >> 172.21.15.112:0/3936143037 conn(0x7f97980cd6f0 msgr2=0x7f97980ae8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:07.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.335+0000 7f979db2d700 1 -- 172.21.15.112:0/3936143037 shutdown_connections 2023-10-06T04:40:07.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.335+0000 7f979db2d700 1 -- 172.21.15.112:0/3936143037 wait complete. 2023-10-06T04:40:07.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.336+0000 7f979db2d700 1 Processor -- start 2023-10-06T04:40:07.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.336+0000 7f979db2d700 1 -- start start 2023-10-06T04:40:07.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.337+0000 7f979db2d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f979806bd70 0x7f979814f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.337+0000 7f979db2d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97980a9ae0 0x7f9798143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.337+0000 7f979db2d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97980a9eb0 0x7f97981545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.337+0000 7f979db2d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979815c1d0 con 0x7f97980a9ae0 2023-10-06T04:40:07.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.337+0000 7f979db2d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9798154b20 con 0x7f97980a9eb0 2023-10-06T04:40:07.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.337+0000 7f979db2d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979814ff50 con 0x7f979806bd70 2023-10-06T04:40:07.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.337+0000 7f9796ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97980a9ae0 0x7f9798143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.337+0000 7f9796ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97980a9ae0 0x7f9798143850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39466/0 (socket says 172.21.15.112:39466) 2023-10-06T04:40:07.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.337+0000 7f9796ffd700 1 -- 172.21.15.112:0/2886307712 learned_addr learned my addr 172.21.15.112:0/2886307712 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:07.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.337+0000 7f9797fff700 1 --2- 172.21.15.112:0/2886307712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97980a9eb0 0x7f97981545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.337+0000 7f97977fe700 1 --2- 172.21.15.112:0/2886307712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f979806bd70 0x7f979814f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.337+0000 7f9796ffd700 1 -- 172.21.15.112:0/2886307712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f979806bd70 msgr2=0x7f979814f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.337+0000 7f9796ffd700 1 --2- 172.21.15.112:0/2886307712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f979806bd70 0x7f979814f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.337+0000 7f9796ffd700 1 -- 172.21.15.112:0/2886307712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97980a9eb0 msgr2=0x7f97981545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.337+0000 7f9796ffd700 1 --2- 172.21.15.112:0/2886307712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97980a9eb0 0x7f97981545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.337+0000 7f9796ffd700 1 -- 172.21.15.112:0/2886307712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c0094f0 con 0x7f97980a9ae0 2023-10-06T04:40:07.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.337+0000 7f9797fff700 1 --2- 172.21.15.112:0/2886307712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97980a9eb0 0x7f97981545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:07.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.338+0000 7f9796ffd700 1 --2- 172.21.15.112:0/2886307712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97980a9ae0 0x7f9798143850 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f978c00b3c0 tx=0x7f978c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:07.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.338+0000 7f977f7fe700 1 -- 172.21.15.112:0/2886307712 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c011d60 con 0x7f97980a9ae0 2023-10-06T04:40:07.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.338+0000 7f977f7fe700 1 -- 172.21.15.112:0/2886307712 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978c024440 con 0x7f97980a9ae0 2023-10-06T04:40:07.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.338+0000 7f979db2d700 1 -- 172.21.15.112:0/2886307712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979815b130 con 0x7f97980a9ae0 2023-10-06T04:40:07.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.338+0000 7f977f7fe700 1 -- 172.21.15.112:0/2886307712 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c0247e0 con 0x7f97980a9ae0 2023-10-06T04:40:07.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.338+0000 7f979db2d700 1 -- 172.21.15.112:0/2886307712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979815b6f0 con 0x7f97980a9ae0 2023-10-06T04:40:07.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.339+0000 7f979db2d700 1 -- 172.21.15.112:0/2886307712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979805f230 con 0x7f97980a9ae0 2023-10-06T04:40:07.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.339+0000 7f977f7fe700 1 -- 172.21.15.112:0/2886307712 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f978c02d440 con 0x7f97980a9ae0 2023-10-06T04:40:07.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.339+0000 7f977f7fe700 1 --2- 172.21.15.112:0/2886307712 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9784066f30 0x7f97840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.340+0000 7f977f7fe700 1 -- 172.21.15.112:0/2886307712 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f978c085eb0 con 0x7f97980a9ae0 2023-10-06T04:40:07.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.340+0000 7f97977fe700 1 --2- 172.21.15.112:0/2886307712 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9784066f30 0x7f97840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.340+0000 7f97977fe700 1 --2- 172.21.15.112:0/2886307712 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9784066f30 0x7f97840693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9788009db0 tx=0x7f97880091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:07.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.344+0000 7f977f7fe700 1 -- 172.21.15.112:0/2886307712 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f978c053040 con 0x7f97980a9ae0 2023-10-06T04:40:07.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.526+0000 7f979db2d700 1 -- 172.21.15.112:0/2886307712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f979806e030 con 0x7f97980a9ae0 2023-10-06T04:40:07.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.527+0000 7f977f7fe700 1 -- 172.21.15.112:0/2886307712 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16927 (secure 0 0 0) 0x7f978c056660 con 0x7f97980a9ae0 2023-10-06T04:40:07.528 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:07.528 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":30,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:40:06.223529+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:40:04.313893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:40:05.190449+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:07.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.529+0000 7f979db2d700 1 -- 172.21.15.112:0/2886307712 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9784066f30 msgr2=0x7f97840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.529+0000 7f979db2d700 1 --2- 172.21.15.112:0/2886307712 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9784066f30 0x7f97840693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9788009db0 tx=0x7f97880091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.529+0000 7f979db2d700 1 -- 172.21.15.112:0/2886307712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97980a9ae0 msgr2=0x7f9798143850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.529+0000 7f979db2d700 1 --2- 172.21.15.112:0/2886307712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97980a9ae0 0x7f9798143850 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f978c00b3c0 tx=0x7f978c017000 comp rx=0 tx=0).stop 2023-10-06T04:40:07.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.529+0000 7f979db2d700 1 -- 172.21.15.112:0/2886307712 shutdown_connections 2023-10-06T04:40:07.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.529+0000 7f979db2d700 1 --2- 172.21.15.112:0/2886307712 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f9784066f30 0x7f97840693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.529+0000 7f979db2d700 1 --2- 172.21.15.112:0/2886307712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97980a9eb0 0x7f97981545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.529+0000 7f979db2d700 1 --2- 172.21.15.112:0/2886307712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f979806bd70 0x7f979814f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.529+0000 7f979db2d700 1 --2- 172.21.15.112:0/2886307712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97980a9ae0 0x7f9798143850 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.529+0000 7f979db2d700 1 -- 172.21.15.112:0/2886307712 >> 172.21.15.112:0/2886307712 conn(0x7f97980cd6f0 msgr2=0x7f97980ae120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:07.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.529+0000 7f979db2d700 1 -- 172.21.15.112:0/2886307712 shutdown_connections 2023-10-06T04:40:07.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.529+0000 7f979db2d700 1 -- 172.21.15.112:0/2886307712 wait complete. 2023-10-06T04:40:07.543 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T04:40:07.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.658+0000 7fc8cac4f700 1 Processor -- start 2023-10-06T04:40:07.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.658+0000 7fc8cac4f700 1 -- start start 2023-10-06T04:40:07.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.659+0000 7fc8cac4f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc8c4157220 0x7fc8c40d0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.659+0000 7fc8cac4f700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc8c40d0a70 0x7fc8c40c7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.659+0000 7fc8cac4f700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c40cab40 con 0x7fc8c40c7bd0 2023-10-06T04:40:07.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.659+0000 7fc8cac4f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c40cceb0 con 0x7fc8c4157220 2023-10-06T04:40:07.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.659+0000 7fc8cac4f700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c40cd100 con 0x7fc8c40d0a70 2023-10-06T04:40:07.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.659+0000 7fc8c9c4d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc8c4157220 0x7fc8c40d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.659+0000 7fc8c9c4d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc8c4157220 0x7fc8c40d0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39470/0 (socket says 172.21.15.112:39470) 2023-10-06T04:40:07.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.659+0000 7fc8c9c4d700 1 -- 172.21.15.112:0/2293268367 learned_addr learned my addr 172.21.15.112:0/2293268367 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:07.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.659+0000 7fc8c9c4d700 1 -- 172.21.15.112:0/2293268367 >> v2:172.21.15.179:3300/0 conn(0x7fc8c40d0a70 msgr2=0x7fc8c40c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:07.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.659+0000 7fc8c9c4d700 1 --2- 172.21.15.112:0/2293268367 >> v2:172.21.15.179:3300/0 conn(0x7fc8c40d0a70 0x7fc8c40c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.659+0000 7fc8c9c4d700 1 -- 172.21.15.112:0/2293268367 >> v1:172.21.15.179:6789/0 conn(0x7fc8c40c7bd0 legacy=0x7fc8c415d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:07.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.659+0000 7fc8c9c4d700 1 -- 172.21.15.112:0/2293268367 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c40d0ee0 con 0x7fc8c4157220 2023-10-06T04:40:07.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.659+0000 7fc8c9c4d700 1 --2- 172.21.15.112:0/2293268367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8c4157220 0x7fc8c40d0530 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40b0020 tx=0x7fc8bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da50499130de28fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:07.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.659+0000 7fc8c8c4b700 1 -- 172.21.15.112:0/2293268367 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc00e070 con 0x7fc8c4157220 2023-10-06T04:40:07.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.660+0000 7fc8c8c4b700 1 -- 172.21.15.112:0/2293268367 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8bc00ba10 con 0x7fc8c4157220 2023-10-06T04:40:07.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.660+0000 7fc8c8c4b700 1 -- 172.21.15.112:0/2293268367 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc0092e0 con 0x7fc8c4157220 2023-10-06T04:40:07.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.660+0000 7fc8cac4f700 1 -- 172.21.15.112:0/2293268367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8c4157220 msgr2=0x7fc8c40d0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.660+0000 7fc8cac4f700 1 --2- 172.21.15.112:0/2293268367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8c4157220 0x7fc8c40d0530 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40b0020 tx=0x7fc8bc009840 comp rx=0 tx=0).stop 2023-10-06T04:40:07.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.660+0000 7fc8cac4f700 1 -- 172.21.15.112:0/2293268367 shutdown_connections 2023-10-06T04:40:07.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.660+0000 7fc8cac4f700 1 --2- 172.21.15.112:0/2293268367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8c4157220 0x7fc8c40d0530 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.660+0000 7fc8cac4f700 1 --2- 172.21.15.112:0/2293268367 >> v2:172.21.15.179:3300/0 conn(0x7fc8c40d0a70 0x7fc8c40c7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.660+0000 7fc8cac4f700 1 -- 172.21.15.112:0/2293268367 >> 172.21.15.112:0/2293268367 conn(0x7fc8c406c7d0 msgr2=0x7fc8c406cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:07.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.660+0000 7fc8cac4f700 1 -- 172.21.15.112:0/2293268367 shutdown_connections 2023-10-06T04:40:07.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.660+0000 7fc8cac4f700 1 -- 172.21.15.112:0/2293268367 wait complete. 2023-10-06T04:40:07.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.661+0000 7fc8cac4f700 1 Processor -- start 2023-10-06T04:40:07.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.661+0000 7fc8cac4f700 1 -- start start 2023-10-06T04:40:07.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.662+0000 7fc8cac4f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8c40c7bd0 0x7fc8c416a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.662+0000 7fc8cac4f700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8c40d0a70 0x7fc8c40b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.662+0000 7fc8cac4f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8c4157220 0x7fc8c40b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.662+0000 7fc8cac4f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c416a410 con 0x7fc8c4157220 2023-10-06T04:40:07.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.662+0000 7fc8cac4f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c40af7b0 con 0x7fc8c40c7bd0 2023-10-06T04:40:07.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.662+0000 7fc8cac4f700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c40b1140 con 0x7fc8c40d0a70 2023-10-06T04:40:07.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.662+0000 7fc8ca44e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8c4157220 0x7fc8c40b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.662+0000 7fc8ca44e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8c4157220 0x7fc8c40b05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39474/0 (socket says 172.21.15.112:39474) 2023-10-06T04:40:07.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.662+0000 7fc8ca44e700 1 -- 172.21.15.112:0/128627271 learned_addr learned my addr 172.21.15.112:0/128627271 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:07.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.662+0000 7fc8c9c4d700 1 --2- 172.21.15.112:0/128627271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8c40c7bd0 0x7fc8c416a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.662+0000 7fc8c944c700 1 --2- 172.21.15.112:0/128627271 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8c40d0a70 0x7fc8c40b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.662+0000 7fc8ca44e700 1 -- 172.21.15.112:0/128627271 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8c40d0a70 msgr2=0x7fc8c40b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.662+0000 7fc8ca44e700 1 --2- 172.21.15.112:0/128627271 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8c40d0a70 0x7fc8c40b1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.662+0000 7fc8ca44e700 1 -- 172.21.15.112:0/128627271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8c40c7bd0 msgr2=0x7fc8c416a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:07.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.662+0000 7fc8ca44e700 1 --2- 172.21.15.112:0/128627271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8c40c7bd0 0x7fc8c416a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:07.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.662+0000 7fc8ca44e700 1 -- 172.21.15.112:0/128627271 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc009ae0 con 0x7fc8c4157220 2023-10-06T04:40:07.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.662+0000 7fc8c9c4d700 1 --2- 172.21.15.112:0/128627271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8c40c7bd0 0x7fc8c416a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:07.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.663+0000 7fc8ca44e700 1 --2- 172.21.15.112:0/128627271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8c4157220 0x7fc8c40b05d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400b4e0 tx=0x7fc8b4009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:07.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.663+0000 7fc8c1ffb700 1 -- 172.21.15.112:0/128627271 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b400f5e0 con 0x7fc8c4157220 2023-10-06T04:40:07.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.663+0000 7fc8c1ffb700 1 -- 172.21.15.112:0/128627271 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b400f760 con 0x7fc8c4157220 2023-10-06T04:40:07.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.663+0000 7fc8cac4f700 1 -- 172.21.15.112:0/128627271 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c40b1420 con 0x7fc8c4157220 2023-10-06T04:40:07.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.663+0000 7fc8c1ffb700 1 -- 172.21.15.112:0/128627271 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b400fb20 con 0x7fc8c4157220 2023-10-06T04:40:07.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.663+0000 7fc8cac4f700 1 -- 172.21.15.112:0/128627271 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c416a0a0 con 0x7fc8c4157220 2023-10-06T04:40:07.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.664+0000 7fc8cac4f700 1 -- 172.21.15.112:0/128627271 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c405f230 con 0x7fc8c4157220 2023-10-06T04:40:07.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.664+0000 7fc8c1ffb700 1 -- 172.21.15.112:0/128627271 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc8b401a400 con 0x7fc8c4157220 2023-10-06T04:40:07.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.664+0000 7fc8c1ffb700 1 --2- 172.21.15.112:0/128627271 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc8b0066f30 0x7fc8b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:07.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.665+0000 7fc8c1ffb700 1 -- 172.21.15.112:0/128627271 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc8b4084200 con 0x7fc8c4157220 2023-10-06T04:40:07.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.665+0000 7fc8c9c4d700 1 --2- 172.21.15.112:0/128627271 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc8b0066f30 0x7fc8b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:07.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.665+0000 7fc8c9c4d700 1 --2- 172.21.15.112:0/128627271 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc8b0066f30 0x7fc8b00693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc009880 tx=0x7fc8bc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:07.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.669+0000 7fc8c1ffb700 1 -- 172.21.15.112:0/128627271 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8b4051390 con 0x7fc8c4157220 2023-10-06T04:40:07.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:07.896+0000 7fc8cac4f700 1 -- 172.21.15.112:0/128627271 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc8c416a550 con 0x7fc8c4157220 2023-10-06T04:40:08.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:08.874+0000 7fc8c1ffb700 1 -- 172.21.15.112:0/128627271 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc8b400fed0 con 0x7fc8c4157220 2023-10-06T04:40:08.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:08.877+0000 7fc8cac4f700 1 -- 172.21.15.112:0/128627271 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc8b0066f30 msgr2=0x7fc8b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:08.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:08.877+0000 7fc8cac4f700 1 --2- 172.21.15.112:0/128627271 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc8b0066f30 0x7fc8b00693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc009880 tx=0x7fc8bc017000 comp rx=0 tx=0).stop 2023-10-06T04:40:08.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:08.877+0000 7fc8cac4f700 1 -- 172.21.15.112:0/128627271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8c4157220 msgr2=0x7fc8c40b05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:08.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:08.877+0000 7fc8cac4f700 1 --2- 172.21.15.112:0/128627271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8c4157220 0x7fc8c40b05d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400b4e0 tx=0x7fc8b4009060 comp rx=0 tx=0).stop 2023-10-06T04:40:08.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:08.877+0000 7fc8cac4f700 1 -- 172.21.15.112:0/128627271 shutdown_connections 2023-10-06T04:40:08.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:08.877+0000 7fc8cac4f700 1 --2- 172.21.15.112:0/128627271 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc8b0066f30 0x7fc8b00693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:08.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:08.877+0000 7fc8cac4f700 1 --2- 172.21.15.112:0/128627271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8c4157220 0x7fc8c40b05d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:08.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:08.877+0000 7fc8cac4f700 1 --2- 172.21.15.112:0/128627271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8c40c7bd0 0x7fc8c416a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:08.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:08.877+0000 7fc8cac4f700 1 --2- 172.21.15.112:0/128627271 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8c40d0a70 0x7fc8c40b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:08.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:08.877+0000 7fc8cac4f700 1 -- 172.21.15.112:0/128627271 >> 172.21.15.112:0/128627271 conn(0x7fc8c406c7d0 msgr2=0x7fc8c4156180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:08.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:08.877+0000 7fc8cac4f700 1 -- 172.21.15.112:0/128627271 shutdown_connections 2023-10-06T04:40:08.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:08.877+0000 7fc8cac4f700 1 -- 172.21.15.112:0/128627271 wait complete. 2023-10-06T04:40:08.892 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T04:40:09.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.011+0000 7fe713ff3700 1 Processor -- start 2023-10-06T04:40:09.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.011+0000 7fe713ff3700 1 -- start start 2023-10-06T04:40:09.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.012+0000 7fe713ff3700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe70c0cbf00 0x7fe70c15b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:09.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.012+0000 7fe713ff3700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe70c06d3b0 0x7fe70c15bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:09.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.012+0000 7fe713ff3700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70c15af50 con 0x7fe70c159a20 2023-10-06T04:40:09.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.012+0000 7fe713ff3700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70c0cca70 con 0x7fe70c06d3b0 2023-10-06T04:40:09.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.012+0000 7fe713ff3700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c08a080 con 0x7fe70c0cbf00 2023-10-06T04:40:09.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.012+0000 7fe712590700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe70c06d3b0 0x7fe70c15bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:09.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.012+0000 7fe71158e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe70c0cbf00 0x7fe70c15b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:09.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.013+0000 7fe711d8f700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fe70c159a20 0x7fe70c0cb7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.112:58804/0 (socket says 172.21.15.112:58804) 2023-10-06T04:40:09.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.013+0000 7fe711d8f700 1 -- 172.21.15.112:0/204787991 learned_addr learned my addr 172.21.15.112:0/204787991 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:09.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.013+0000 7fe712590700 1 -- 172.21.15.112:0/204787991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe70c0cbf00 msgr2=0x7fe70c15b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:09.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.013+0000 7fe712590700 1 --2- 172.21.15.112:0/204787991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe70c0cbf00 0x7fe70c15b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:09.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.013+0000 7fe712590700 1 -- 172.21.15.112:0/204787991 >> v1:172.21.15.179:6789/0 conn(0x7fe70c159a20 legacy=0x7fe70c0cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:09.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.013+0000 7fe712590700 1 -- 172.21.15.112:0/204787991 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c0cae50 con 0x7fe70c06d3b0 2023-10-06T04:40:09.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.013+0000 7fe71158e700 1 --2- 172.21.15.112:0/204787991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe70c0cbf00 0x7fe70c15b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:09.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.013+0000 7fe712590700 1 --2- 172.21.15.112:0/204787991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe70c06d3b0 0x7fe70c15bc50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe704009910 tx=0x7fe7040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2eeb7b14100d8335 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:09.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.013+0000 7fe710d8d700 1 -- 172.21.15.112:0/204787991 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70400b640 con 0x7fe70c06d3b0 2023-10-06T04:40:09.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.013+0000 7fe710d8d700 1 -- 172.21.15.112:0/204787991 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70400b7a0 con 0x7fe70c06d3b0 2023-10-06T04:40:09.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.013+0000 7fe710d8d700 1 -- 172.21.15.112:0/204787991 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70400bb60 con 0x7fe70c06d3b0 2023-10-06T04:40:09.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.014+0000 7fe713ff3700 1 -- 172.21.15.112:0/204787991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe70c06d3b0 msgr2=0x7fe70c15bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:09.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.014+0000 7fe713ff3700 1 --2- 172.21.15.112:0/204787991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe70c06d3b0 0x7fe70c15bc50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe704009910 tx=0x7fe7040091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:09.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.014+0000 7fe713ff3700 1 -- 172.21.15.112:0/204787991 shutdown_connections 2023-10-06T04:40:09.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.014+0000 7fe713ff3700 1 --2- 172.21.15.112:0/204787991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe70c06d3b0 0x7fe70c15bc50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:09.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.014+0000 7fe713ff3700 1 --2- 172.21.15.112:0/204787991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe70c0cbf00 0x7fe70c15b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:09.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.014+0000 7fe713ff3700 1 -- 172.21.15.112:0/204787991 >> 172.21.15.112:0/204787991 conn(0x7fe70c06cfb0 msgr2=0x7fe70c0d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:09.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.014+0000 7fe713ff3700 1 -- 172.21.15.112:0/204787991 shutdown_connections 2023-10-06T04:40:09.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.014+0000 7fe713ff3700 1 -- 172.21.15.112:0/204787991 wait complete. 2023-10-06T04:40:09.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.015+0000 7fe713ff3700 1 Processor -- start 2023-10-06T04:40:09.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.015+0000 7fe713ff3700 1 -- start start 2023-10-06T04:40:09.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.016+0000 7fe713ff3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe70c06d3b0 0x7fe70c149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:09.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.016+0000 7fe713ff3700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe70c0cbf00 0x7fe70c0b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:09.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.016+0000 7fe713ff3700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe70c159a20 0x7fe70c0b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:09.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.016+0000 7fe713ff3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0b44c0 con 0x7fe70c06d3b0 2023-10-06T04:40:09.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.016+0000 7fe713ff3700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0b38b0 con 0x7fe70c0cbf00 2023-10-06T04:40:09.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.016+0000 7fe713ff3700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0b3b90 con 0x7fe70c159a20 2023-10-06T04:40:09.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.016+0000 7fe711d8f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe70c06d3b0 0x7fe70c149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:09.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.016+0000 7fe711d8f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe70c06d3b0 0x7fe70c149190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60402/0 (socket says 172.21.15.112:60402) 2023-10-06T04:40:09.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.016+0000 7fe711d8f700 1 -- 172.21.15.112:0/2406858152 learned_addr learned my addr 172.21.15.112:0/2406858152 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:09.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.016+0000 7fe71158e700 1 --2- 172.21.15.112:0/2406858152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe70c0cbf00 0x7fe70c0b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:09.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.016+0000 7fe712590700 1 --2- 172.21.15.112:0/2406858152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe70c159a20 0x7fe70c0b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:09.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.016+0000 7fe711d8f700 1 -- 172.21.15.112:0/2406858152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe70c159a20 msgr2=0x7fe70c0b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:09.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.016+0000 7fe711d8f700 1 --2- 172.21.15.112:0/2406858152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe70c159a20 0x7fe70c0b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:09.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.016+0000 7fe711d8f700 1 -- 172.21.15.112:0/2406858152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe70c0cbf00 msgr2=0x7fe70c0b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:09.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.016+0000 7fe711d8f700 1 --2- 172.21.15.112:0/2406858152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe70c0cbf00 0x7fe70c0b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:09.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.016+0000 7fe711d8f700 1 -- 172.21.15.112:0/2406858152 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc009420 con 0x7fe70c06d3b0 2023-10-06T04:40:09.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.016+0000 7fe711d8f700 1 --2- 172.21.15.112:0/2406858152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe70c06d3b0 0x7fe70c149190 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe70800cc70 tx=0x7fe7080019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:09.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.016+0000 7fe701ffb700 1 -- 172.21.15.112:0/2406858152 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70800a830 con 0x7fe70c06d3b0 2023-10-06T04:40:09.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.016+0000 7fe701ffb700 1 -- 172.21.15.112:0/2406858152 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70800a9b0 con 0x7fe70c06d3b0 2023-10-06T04:40:09.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.017+0000 7fe701ffb700 1 -- 172.21.15.112:0/2406858152 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70800ad70 con 0x7fe70c06d3b0 2023-10-06T04:40:09.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.017+0000 7fe713ff3700 1 -- 172.21.15.112:0/2406858152 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe704009420 con 0x7fe70c06d3b0 2023-10-06T04:40:09.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.017+0000 7fe713ff3700 1 -- 172.21.15.112:0/2406858152 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70c0b4150 con 0x7fe70c06d3b0 2023-10-06T04:40:09.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.018+0000 7fe713ff3700 1 -- 172.21.15.112:0/2406858152 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70c05f230 con 0x7fe70c06d3b0 2023-10-06T04:40:09.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.018+0000 7fe701ffb700 1 -- 172.21.15.112:0/2406858152 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe708007300 con 0x7fe70c06d3b0 2023-10-06T04:40:09.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.018+0000 7fe701ffb700 1 --2- 172.21.15.112:0/2406858152 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe6f0066f30 0x7fe6f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:09.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.018+0000 7fe701ffb700 1 -- 172.21.15.112:0/2406858152 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe708084920 con 0x7fe70c06d3b0 2023-10-06T04:40:09.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.018+0000 7fe71158e700 1 --2- 172.21.15.112:0/2406858152 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe6f0066f30 0x7fe6f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:09.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.019+0000 7fe71158e700 1 --2- 172.21.15.112:0/2406858152 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe6f0066f30 0x7fe6f00693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe70c15e320 tx=0x7fe6fc0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:09.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.022+0000 7fe701ffb700 1 -- 172.21.15.112:0/2406858152 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe708051ab0 con 0x7fe70c06d3b0 2023-10-06T04:40:09.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.246+0000 7fe713ff3700 1 -- 172.21.15.112:0/2406858152 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe70c0cb0f0 con 0x7fe70c06d3b0 2023-10-06T04:40:09.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.875+0000 7fe701ffb700 1 -- 172.21.15.112:0/2406858152 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe7080550d0 con 0x7fe70c06d3b0 2023-10-06T04:40:09.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.878+0000 7fe713ff3700 1 -- 172.21.15.112:0/2406858152 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe6f0066f30 msgr2=0x7fe6f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:09.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.878+0000 7fe713ff3700 1 --2- 172.21.15.112:0/2406858152 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe6f0066f30 0x7fe6f00693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe70c15e320 tx=0x7fe6fc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:09.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.878+0000 7fe713ff3700 1 -- 172.21.15.112:0/2406858152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe70c06d3b0 msgr2=0x7fe70c149190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:09.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.878+0000 7fe713ff3700 1 --2- 172.21.15.112:0/2406858152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe70c06d3b0 0x7fe70c149190 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe70800cc70 tx=0x7fe7080019f0 comp rx=0 tx=0).stop 2023-10-06T04:40:09.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.878+0000 7fe713ff3700 1 -- 172.21.15.112:0/2406858152 shutdown_connections 2023-10-06T04:40:09.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.878+0000 7fe713ff3700 1 --2- 172.21.15.112:0/2406858152 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe6f0066f30 0x7fe6f00693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:09.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.878+0000 7fe713ff3700 1 --2- 172.21.15.112:0/2406858152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe70c159a20 0x7fe70c0b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:09.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.878+0000 7fe713ff3700 1 --2- 172.21.15.112:0/2406858152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe70c06d3b0 0x7fe70c149190 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:09.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.878+0000 7fe713ff3700 1 --2- 172.21.15.112:0/2406858152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe70c0cbf00 0x7fe70c0b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:09.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.878+0000 7fe713ff3700 1 -- 172.21.15.112:0/2406858152 >> 172.21.15.112:0/2406858152 conn(0x7fe70c06cfb0 msgr2=0x7fe70c155290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:09.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.878+0000 7fe713ff3700 1 -- 172.21.15.112:0/2406858152 shutdown_connections 2023-10-06T04:40:09.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:09.878+0000 7fe713ff3700 1 -- 172.21.15.112:0/2406858152 wait complete. 2023-10-06T04:40:09.891 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:10.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.004+0000 7fd3c7a96700 1 Processor -- start 2023-10-06T04:40:10.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.004+0000 7fd3c7a96700 1 -- start start 2023-10-06T04:40:10.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.005+0000 7fd3c7a96700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3c00b3040 0x7fd3c00cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.005+0000 7fd3c7a96700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c00cd740 con 0x7fd3c00b0e70 2023-10-06T04:40:10.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.005+0000 7fd3c7a96700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c00ccb30 con 0x7fd3c0159d50 2023-10-06T04:40:10.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.005+0000 7fd3c7a96700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00b3490 con 0x7fd3c00b3040 2023-10-06T04:40:10.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.005+0000 7fd3c6033700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd3c00b0e70 0x7fd3c006db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48344/0 (socket says 172.21.15.112:48344) 2023-10-06T04:40:10.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.005+0000 7fd3c6033700 1 -- 172.21.15.112:0/4223454760 learned_addr learned my addr 172.21.15.112:0/4223454760 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:10.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.005+0000 7fd3c4830700 1 -- 172.21.15.112:0/4223454760 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648400277 0 0) 0x7fd3c00cd740 con 0x7fd3c00b0e70 2023-10-06T04:40:10.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c4830700 1 -- 172.21.15.112:0/4223454760 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3ac003570 con 0x7fd3c00b0e70 2023-10-06T04:40:10.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c5031700 1 --2- 172.21.15.112:0/4223454760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3c00b3040 0x7fd3c00cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c4830700 1 -- 172.21.15.112:0/4223454760 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 486060111 0 0) 0x7fd3ac003570 con 0x7fd3c00b0e70 2023-10-06T04:40:10.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c4830700 1 -- 172.21.15.112:0/4223454760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3c00b3040 msgr2=0x7fd3c00cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:10.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c4830700 1 --2- 172.21.15.112:0/4223454760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3c00b3040 0x7fd3c00cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c4830700 1 -- 172.21.15.112:0/4223454760 >> v1:172.21.15.179:6789/0 conn(0x7fd3c0159d50 legacy=0x7fd3c015a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c4830700 1 -- 172.21.15.112:0/4223454760 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c00cce10 con 0x7fd3c00b0e70 2023-10-06T04:40:10.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c4830700 1 -- 172.21.15.112:0/4223454760 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7fd3b80017f0 con 0x7fd3c00b0e70 2023-10-06T04:40:10.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c4830700 1 -- 172.21.15.112:0/4223454760 >> v1:172.21.15.112:6789/0 conn(0x7fd3c00b0e70 legacy=0x7fd3c006db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c4830700 1 --2- 172.21.15.112:0/4223454760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3c00b3040 0x7fd3ac003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c4830700 1 --2- 172.21.15.112:0/4223454760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3ac004010 0x7fd3ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c4830700 1 --2- 172.21.15.112:0/4223454760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3ac004d50 0x7fd3ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c4830700 1 -- 172.21.15.112:0/4223454760 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00b3490 con 0x7fd3ac004010 2023-10-06T04:40:10.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c4830700 1 -- 172.21.15.112:0/4223454760 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac00bbf0 con 0x7fd3ac004d50 2023-10-06T04:40:10.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c4830700 1 -- 172.21.15.112:0/4223454760 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac00bdb0 con 0x7fd3c00b3040 2023-10-06T04:40:10.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c5031700 1 --2- 172.21.15.112:0/4223454760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3ac004010 0x7fd3ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c5832700 1 --2- 172.21.15.112:0/4223454760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3c00b3040 0x7fd3ac003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c6033700 1 --2- 172.21.15.112:0/4223454760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3ac004d50 0x7fd3ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c5031700 1 -- 172.21.15.112:0/4223454760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3c00b3040 msgr2=0x7fd3ac003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:10.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c5031700 1 --2- 172.21.15.112:0/4223454760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3c00b3040 0x7fd3ac003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c5031700 1 -- 172.21.15.112:0/4223454760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3ac004d50 msgr2=0x7fd3ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:10.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c5031700 1 --2- 172.21.15.112:0/4223454760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3ac004d50 0x7fd3ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c5031700 1 -- 172.21.15.112:0/4223454760 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac003570 con 0x7fd3ac004010 2023-10-06T04:40:10.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c5031700 1 --2- 172.21.15.112:0/4223454760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3ac004010 0x7fd3ac004810 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0006f00 tx=0x7fd3b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0cbeeb6b6525ce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:10.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.006+0000 7fd3c4830700 1 -- 172.21.15.112:0/4223454760 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b000e710 con 0x7fd3ac004010 2023-10-06T04:40:10.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.007+0000 7fd3c4830700 1 -- 172.21.15.112:0/4223454760 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b000e870 con 0x7fd3ac004010 2023-10-06T04:40:10.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.007+0000 7fd3c4830700 1 -- 172.21.15.112:0/4223454760 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b000ec30 con 0x7fd3ac004010 2023-10-06T04:40:10.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.007+0000 7fd3c7a96700 1 -- 172.21.15.112:0/4223454760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3ac004010 msgr2=0x7fd3ac004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.007+0000 7fd3c7a96700 1 --2- 172.21.15.112:0/4223454760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3ac004010 0x7fd3ac004810 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0006f00 tx=0x7fd3b00091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.007+0000 7fd3c6033700 1 -- 172.21.15.112:0/4223454760 reap_dead start 2023-10-06T04:40:10.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.007+0000 7fd3c7a96700 1 -- 172.21.15.112:0/4223454760 shutdown_connections 2023-10-06T04:40:10.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.007+0000 7fd3c7a96700 1 -- 172.21.15.112:0/4223454760 >> 172.21.15.112:0/4223454760 conn(0x7fd3c0099b60 msgr2=0x7fd3c006cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:10.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.007+0000 7fd3c7a96700 1 -- 172.21.15.112:0/4223454760 shutdown_connections 2023-10-06T04:40:10.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.007+0000 7fd3c7a96700 1 -- 172.21.15.112:0/4223454760 wait complete. 2023-10-06T04:40:10.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.008+0000 7fd3c7a96700 1 Processor -- start 2023-10-06T04:40:10.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.008+0000 7fd3c7a96700 1 -- start start 2023-10-06T04:40:10.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.009+0000 7fd3c7a96700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3ac004010 0x7fd3c00af470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.009+0000 7fd3c7a96700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3c0153900 0x7fd3c0153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.009+0000 7fd3c7a96700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3c016a830 0x7fd3c016acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.009+0000 7fd3c7a96700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c016b840 con 0x7fd3c016a830 2023-10-06T04:40:10.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.009+0000 7fd3c7a96700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c01542b0 con 0x7fd3c0153900 2023-10-06T04:40:10.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.009+0000 7fd3c7a96700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c009cd30 con 0x7fd3ac004010 2023-10-06T04:40:10.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.009+0000 7fd3c6033700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3c016a830 0x7fd3c016acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.009+0000 7fd3c6033700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3c016a830 0x7fd3c016acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60422/0 (socket says 172.21.15.112:60422) 2023-10-06T04:40:10.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.009+0000 7fd3c6033700 1 -- 172.21.15.112:0/3090509792 learned_addr learned my addr 172.21.15.112:0/3090509792 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:10.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.009+0000 7fd3c5832700 1 --2- 172.21.15.112:0/3090509792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3ac004010 0x7fd3c00af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.009+0000 7fd3c5031700 1 --2- 172.21.15.112:0/3090509792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3c0153900 0x7fd3c0153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.009+0000 7fd3c6033700 1 -- 172.21.15.112:0/3090509792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3ac004010 msgr2=0x7fd3c00af470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.009+0000 7fd3c6033700 1 --2- 172.21.15.112:0/3090509792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3ac004010 0x7fd3c00af470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.009+0000 7fd3c6033700 1 -- 172.21.15.112:0/3090509792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3c0153900 msgr2=0x7fd3c0153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.009+0000 7fd3c6033700 1 --2- 172.21.15.112:0/3090509792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3c0153900 0x7fd3c0153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.009+0000 7fd3c6033700 1 -- 172.21.15.112:0/3090509792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c009c440 con 0x7fd3c016a830 2023-10-06T04:40:10.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.009+0000 7fd3c6033700 1 --2- 172.21.15.112:0/3090509792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3c016a830 0x7fd3c016acd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0065060 tx=0x7fd3b80021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:10.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.010+0000 7fd3b5ffb700 1 -- 172.21.15.112:0/3090509792 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b800ac90 con 0x7fd3c016a830 2023-10-06T04:40:10.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.010+0000 7fd3b5ffb700 1 -- 172.21.15.112:0/3090509792 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b800adf0 con 0x7fd3c016a830 2023-10-06T04:40:10.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.010+0000 7fd3b5ffb700 1 -- 172.21.15.112:0/3090509792 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b8013640 con 0x7fd3c016a830 2023-10-06T04:40:10.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.010+0000 7fd3c7a96700 1 -- 172.21.15.112:0/3090509792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c016b560 con 0x7fd3c016a830 2023-10-06T04:40:10.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.010+0000 7fd3c7a96700 1 -- 172.21.15.112:0/3090509792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c009c9c0 con 0x7fd3c016a830 2023-10-06T04:40:10.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.011+0000 7fd3c7a96700 1 -- 172.21.15.112:0/3090509792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c009cea0 con 0x7fd3c016a830 2023-10-06T04:40:10.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.011+0000 7fd3b5ffb700 1 -- 172.21.15.112:0/3090509792 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd3b8013a70 con 0x7fd3c016a830 2023-10-06T04:40:10.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.011+0000 7fd3b5ffb700 1 --2- 172.21.15.112:0/3090509792 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd3a4066f30 0x7fd3a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.011+0000 7fd3b5ffb700 1 -- 172.21.15.112:0/3090509792 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd3b8084f00 con 0x7fd3c016a830 2023-10-06T04:40:10.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.012+0000 7fd3c5832700 1 --2- 172.21.15.112:0/3090509792 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd3a4066f30 0x7fd3a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.012+0000 7fd3c5832700 1 --2- 172.21.15.112:0/3090509792 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd3a4066f30 0x7fd3a40693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc003b80 tx=0x7fd3bc007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:10.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.016+0000 7fd3b5ffb700 1 -- 172.21.15.112:0/3090509792 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3b8052010 con 0x7fd3c016a830 2023-10-06T04:40:10.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.240+0000 7fd3c7a96700 1 -- 172.21.15.112:0/3090509792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3c005f230 con 0x7fd3c016a830 2023-10-06T04:40:10.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.240+0000 7fd3b5ffb700 1 -- 172.21.15.112:0/3090509792 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4606 (secure 0 0 0) 0x7fd3b8055630 con 0x7fd3c016a830 2023-10-06T04:40:10.242 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:10.242 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1053109253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1053109253},{"type":"v1","addr":"172.21.15.179:6835","nonce":1053109253}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4974,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3563478163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3563478163},{"type":"v1","addr":"172.21.15.112:6836","nonce":3563478163}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4977,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/925043938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":925043938},{"type":"v1","addr":"172.21.15.112:6837","nonce":925043938}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:06.223840+0000","modified":"2023-10-06T04:40:09.873795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1886371745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1886371745},{"type":"v1","addr":"172.21.15.179:6834","nonce":1886371745}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:40:10.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.242+0000 7fd3c7a96700 1 -- 172.21.15.112:0/3090509792 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd3a4066f30 msgr2=0x7fd3a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.242+0000 7fd3c7a96700 1 --2- 172.21.15.112:0/3090509792 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd3a4066f30 0x7fd3a40693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc003b80 tx=0x7fd3bc007d30 comp rx=0 tx=0).stop 2023-10-06T04:40:10.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.242+0000 7fd3c7a96700 1 -- 172.21.15.112:0/3090509792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3c016a830 msgr2=0x7fd3c016acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.242+0000 7fd3c7a96700 1 --2- 172.21.15.112:0/3090509792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3c016a830 0x7fd3c016acd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0065060 tx=0x7fd3b80021d0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.242+0000 7fd3c7a96700 1 -- 172.21.15.112:0/3090509792 shutdown_connections 2023-10-06T04:40:10.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.242+0000 7fd3c7a96700 1 --2- 172.21.15.112:0/3090509792 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd3a4066f30 0x7fd3a40693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.242+0000 7fd3c7a96700 1 --2- 172.21.15.112:0/3090509792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3c016a830 0x7fd3c016acd0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.242+0000 7fd3c7a96700 1 --2- 172.21.15.112:0/3090509792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3ac004010 0x7fd3c00af470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.242+0000 7fd3c7a96700 1 --2- 172.21.15.112:0/3090509792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3c0153900 0x7fd3c0153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.242+0000 7fd3c7a96700 1 -- 172.21.15.112:0/3090509792 >> 172.21.15.112:0/3090509792 conn(0x7fd3c0099b60 msgr2=0x7fd3c00b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:10.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.242+0000 7fd3c7a96700 1 -- 172.21.15.112:0/3090509792 shutdown_connections 2023-10-06T04:40:10.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.242+0000 7fd3c7a96700 1 -- 172.21.15.112:0/3090509792 wait complete. 2023-10-06T04:40:10.245 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2023-10-06T04:40:10.255 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:10.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.368+0000 7faecc108700 1 Processor -- start 2023-10-06T04:40:10.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.368+0000 7faecc108700 1 -- start start 2023-10-06T04:40:10.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.369+0000 7faecc108700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faec4159d50 0x7faec40b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.369+0000 7faecc108700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7faec40b0e70 0x7faec40b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.369+0000 7faecc108700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec40cd740 con 0x7faec415a120 2023-10-06T04:40:10.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.369+0000 7faecc108700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec40b17d0 con 0x7faec4159d50 2023-10-06T04:40:10.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.369+0000 7faecc108700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec40ccb30 con 0x7faec40b0e70 2023-10-06T04:40:10.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.369+0000 7faec9ea4700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faec4159d50 0x7faec40b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.369+0000 7faec9ea4700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faec4159d50 0x7faec40b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60434/0 (socket says 172.21.15.112:60434) 2023-10-06T04:40:10.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.369+0000 7faec9ea4700 1 -- 172.21.15.112:0/3600746679 learned_addr learned my addr 172.21.15.112:0/3600746679 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:10.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.370+0000 7faeca6a5700 1 --2- 172.21.15.112:0/3600746679 >> v2:172.21.15.179:3300/0 conn(0x7faec40b0e70 0x7faec40b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.370+0000 7faec9ea4700 1 -- 172.21.15.112:0/3600746679 >> v2:172.21.15.179:3300/0 conn(0x7faec40b0e70 msgr2=0x7faec40b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:10.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.370+0000 7faec9ea4700 1 --2- 172.21.15.112:0/3600746679 >> v2:172.21.15.179:3300/0 conn(0x7faec40b0e70 0x7faec40b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.370+0000 7faec9ea4700 1 -- 172.21.15.112:0/3600746679 >> v1:172.21.15.179:6789/0 conn(0x7faec415a120 legacy=0x7faec40cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.370+0000 7faec9ea4700 1 -- 172.21.15.112:0/3600746679 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec40cce10 con 0x7faec4159d50 2023-10-06T04:40:10.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.370+0000 7faec9ea4700 1 --2- 172.21.15.112:0/3600746679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec4159d50 0x7faec40b3040 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7faec40b0850 tx=0x7faec0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e48d40f8593a8e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:10.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.370+0000 7faec8ea2700 1 -- 172.21.15.112:0/3600746679 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec000e070 con 0x7faec4159d50 2023-10-06T04:40:10.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.370+0000 7faec8ea2700 1 -- 172.21.15.112:0/3600746679 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec000ba20 con 0x7faec4159d50 2023-10-06T04:40:10.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.370+0000 7faec8ea2700 1 -- 172.21.15.112:0/3600746679 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec00092e0 con 0x7faec4159d50 2023-10-06T04:40:10.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.370+0000 7faecc108700 1 -- 172.21.15.112:0/3600746679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec4159d50 msgr2=0x7faec40b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.370+0000 7faecc108700 1 --2- 172.21.15.112:0/3600746679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec4159d50 0x7faec40b3040 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7faec40b0850 tx=0x7faec0009840 comp rx=0 tx=0).stop 2023-10-06T04:40:10.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.371+0000 7faecc108700 1 -- 172.21.15.112:0/3600746679 shutdown_connections 2023-10-06T04:40:10.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.371+0000 7faecc108700 1 --2- 172.21.15.112:0/3600746679 >> v2:172.21.15.179:3300/0 conn(0x7faec40b0e70 0x7faec40b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.371+0000 7faecc108700 1 --2- 172.21.15.112:0/3600746679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec4159d50 0x7faec40b3040 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.371+0000 7faecc108700 1 -- 172.21.15.112:0/3600746679 >> 172.21.15.112:0/3600746679 conn(0x7faec4099b60 msgr2=0x7faec406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:10.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.371+0000 7faecc108700 1 -- 172.21.15.112:0/3600746679 shutdown_connections 2023-10-06T04:40:10.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.371+0000 7faecc108700 1 -- 172.21.15.112:0/3600746679 wait complete. 2023-10-06T04:40:10.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.372+0000 7faecc108700 1 Processor -- start 2023-10-06T04:40:10.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.372+0000 7faecc108700 1 -- start start 2023-10-06T04:40:10.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.372+0000 7faecc108700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faec40b0e70 0x7faec414e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.372+0000 7faecc108700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faec4159d50 0x7faec409fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.372+0000 7faecc108700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec415a120 0x7faec40a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.372+0000 7faecc108700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec414e6b0 con 0x7faec415a120 2023-10-06T04:40:10.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.372+0000 7faecc108700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec406f690 con 0x7faec4159d50 2023-10-06T04:40:10.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.372+0000 7faecc108700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec406ea80 con 0x7faec40b0e70 2023-10-06T04:40:10.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.373+0000 7faeca6a5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec415a120 0x7faec40a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.373+0000 7faeca6a5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec415a120 0x7faec40a0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60446/0 (socket says 172.21.15.112:60446) 2023-10-06T04:40:10.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.373+0000 7faeca6a5700 1 -- 172.21.15.112:0/4235777638 learned_addr learned my addr 172.21.15.112:0/4235777638 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:10.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.373+0000 7faec96a3700 1 --2- 172.21.15.112:0/4235777638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faec4159d50 0x7faec409fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.373+0000 7faec9ea4700 1 --2- 172.21.15.112:0/4235777638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faec40b0e70 0x7faec414e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.373+0000 7faeca6a5700 1 -- 172.21.15.112:0/4235777638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faec40b0e70 msgr2=0x7faec414e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.373+0000 7faeca6a5700 1 --2- 172.21.15.112:0/4235777638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faec40b0e70 0x7faec414e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.373+0000 7faeca6a5700 1 -- 172.21.15.112:0/4235777638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faec4159d50 msgr2=0x7faec409fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.373+0000 7faeca6a5700 1 --2- 172.21.15.112:0/4235777638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faec4159d50 0x7faec409fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.373+0000 7faeca6a5700 1 -- 172.21.15.112:0/4235777638 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec0009ae0 con 0x7faec415a120 2023-10-06T04:40:10.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.373+0000 7faec96a3700 1 --2- 172.21.15.112:0/4235777638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faec4159d50 0x7faec409fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:10.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.373+0000 7faeca6a5700 1 --2- 172.21.15.112:0/4235777638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec415a120 0x7faec40a0420 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7faebc00ea50 tx=0x7faebc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:10.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.373+0000 7faeb9ffb700 1 -- 172.21.15.112:0/4235777638 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc00c920 con 0x7faec415a120 2023-10-06T04:40:10.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.373+0000 7faeb9ffb700 1 -- 172.21.15.112:0/4235777638 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc00caa0 con 0x7faec415a120 2023-10-06T04:40:10.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.373+0000 7faecc108700 1 -- 172.21.15.112:0/4235777638 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec406ed60 con 0x7faec415a120 2023-10-06T04:40:10.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.373+0000 7faeb9ffb700 1 -- 172.21.15.112:0/4235777638 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc00ce60 con 0x7faec415a120 2023-10-06T04:40:10.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.373+0000 7faecc108700 1 -- 172.21.15.112:0/4235777638 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec406f320 con 0x7faec415a120 2023-10-06T04:40:10.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.374+0000 7faecc108700 1 -- 172.21.15.112:0/4235777638 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec406f820 con 0x7faec415a120 2023-10-06T04:40:10.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.375+0000 7faeb9ffb700 1 -- 172.21.15.112:0/4235777638 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faebc013680 con 0x7faec415a120 2023-10-06T04:40:10.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.375+0000 7faeb9ffb700 1 --2- 172.21.15.112:0/4235777638 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7faea8066f30 0x7faea80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.375+0000 7faec9ea4700 1 --2- 172.21.15.112:0/4235777638 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7faea8066f30 0x7faea80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.375+0000 7faeb9ffb700 1 -- 172.21.15.112:0/4235777638 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faebc084ab0 con 0x7faec415a120 2023-10-06T04:40:10.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.376+0000 7faec9ea4700 1 --2- 172.21.15.112:0/4235777638 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7faea8066f30 0x7faea80693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faec0009880 tx=0x7faec0018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:10.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.379+0000 7faeb9ffb700 1 -- 172.21.15.112:0/4235777638 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faebc051bc0 con 0x7faec415a120 2023-10-06T04:40:10.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.561+0000 7faecc108700 1 -- 172.21.15.112:0/4235777638 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faec405f230 con 0x7faec415a120 2023-10-06T04:40:10.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.561+0000 7faeb9ffb700 1 -- 172.21.15.112:0/4235777638 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16914 (secure 0 0 0) 0x7faebc0551e0 con 0x7faec415a120 2023-10-06T04:40:10.563 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:10.563 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":31,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:40:07.853039+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:40:04.313893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:40:05.190449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:10.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.563+0000 7faecc108700 1 -- 172.21.15.112:0/4235777638 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7faea8066f30 msgr2=0x7faea80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.563+0000 7faecc108700 1 --2- 172.21.15.112:0/4235777638 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7faea8066f30 0x7faea80693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faec0009880 tx=0x7faec0018000 comp rx=0 tx=0).stop 2023-10-06T04:40:10.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.563+0000 7faecc108700 1 -- 172.21.15.112:0/4235777638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec415a120 msgr2=0x7faec40a0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.563+0000 7faecc108700 1 --2- 172.21.15.112:0/4235777638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec415a120 0x7faec40a0420 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7faebc00ea50 tx=0x7faebc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.563+0000 7faecc108700 1 -- 172.21.15.112:0/4235777638 shutdown_connections 2023-10-06T04:40:10.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.563+0000 7faecc108700 1 --2- 172.21.15.112:0/4235777638 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7faea8066f30 0x7faea80693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.563+0000 7faecc108700 1 --2- 172.21.15.112:0/4235777638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec415a120 0x7faec40a0420 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.563+0000 7faecc108700 1 --2- 172.21.15.112:0/4235777638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faec40b0e70 0x7faec414e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.563+0000 7faecc108700 1 --2- 172.21.15.112:0/4235777638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faec4159d50 0x7faec409fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.563+0000 7faecc108700 1 -- 172.21.15.112:0/4235777638 >> 172.21.15.112:0/4235777638 conn(0x7faec4099b60 msgr2=0x7faec4160160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:10.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.564+0000 7faecc108700 1 -- 172.21.15.112:0/4235777638 shutdown_connections 2023-10-06T04:40:10.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.564+0000 7faecc108700 1 -- 172.21.15.112:0/4235777638 wait complete. 2023-10-06T04:40:10.577 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T04:40:10.577 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:40:10.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.691+0000 7fa92aff4700 1 Processor -- start 2023-10-06T04:40:10.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.692+0000 7fa92aff4700 1 -- start start 2023-10-06T04:40:10.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.692+0000 7fa92aff4700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa92406dce0 0x7fa92406bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.692+0000 7fa92aff4700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa92406b7b0 con 0x7fa92406e0b0 2023-10-06T04:40:10.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.692+0000 7fa92aff4700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9240ca1a0 con 0x7fa9240cb5e0 2023-10-06T04:40:10.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.692+0000 7fa92aff4700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92406ae80 con 0x7fa92406dce0 2023-10-06T04:40:10.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.692+0000 7fa928d90700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa92406dce0 0x7fa92406bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.692+0000 7fa91bfff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa92406e0b0 0x7fa9240c96e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48354/0 (socket says 172.21.15.112:48354) 2023-10-06T04:40:10.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.692+0000 7fa91bfff700 1 -- 172.21.15.112:0/3360753983 learned_addr learned my addr 172.21.15.112:0/3360753983 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:10.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.693+0000 7fa928d90700 1 -- 172.21.15.112:0/3360753983 >> v1:172.21.15.179:6789/0 conn(0x7fa9240cb5e0 legacy=0x7fa9240cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.693+0000 7fa928d90700 1 -- 172.21.15.112:0/3360753983 >> v1:172.21.15.112:6789/0 conn(0x7fa92406e0b0 legacy=0x7fa9240c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.693+0000 7fa928d90700 1 -- 172.21.15.112:0/3360753983 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92406b160 con 0x7fa92406dce0 2023-10-06T04:40:10.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.693+0000 7fa928d90700 1 --2- 172.21.15.112:0/3360753983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa92406dce0 0x7fa92406bc40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa920009e60 tx=0x7fa920009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0bc14d6953fc21 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:10.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.693+0000 7fa91b7fe700 1 -- 172.21.15.112:0/3360753983 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92000e070 con 0x7fa92406dce0 2023-10-06T04:40:10.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.693+0000 7fa91b7fe700 1 -- 172.21.15.112:0/3360753983 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92000bc30 con 0x7fa92406dce0 2023-10-06T04:40:10.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.693+0000 7fa91b7fe700 1 -- 172.21.15.112:0/3360753983 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920012430 con 0x7fa92406dce0 2023-10-06T04:40:10.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.694+0000 7fa92aff4700 1 -- 172.21.15.112:0/3360753983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa92406dce0 msgr2=0x7fa92406bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.694+0000 7fa92aff4700 1 --2- 172.21.15.112:0/3360753983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa92406dce0 0x7fa92406bc40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa920009e60 tx=0x7fa920009780 comp rx=0 tx=0).stop 2023-10-06T04:40:10.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.694+0000 7fa92aff4700 1 -- 172.21.15.112:0/3360753983 shutdown_connections 2023-10-06T04:40:10.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.694+0000 7fa92aff4700 1 --2- 172.21.15.112:0/3360753983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa92406dce0 0x7fa92406bc40 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.694+0000 7fa92aff4700 1 -- 172.21.15.112:0/3360753983 >> 172.21.15.112:0/3360753983 conn(0x7fa92406d8e0 msgr2=0x7fa9240b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:10.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.694+0000 7fa92aff4700 1 -- 172.21.15.112:0/3360753983 shutdown_connections 2023-10-06T04:40:10.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.694+0000 7fa92aff4700 1 -- 172.21.15.112:0/3360753983 wait complete. 2023-10-06T04:40:10.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.695+0000 7fa92aff4700 1 Processor -- start 2023-10-06T04:40:10.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.695+0000 7fa92aff4700 1 -- start start 2023-10-06T04:40:10.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa92aff4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa92406dce0 0x7fa92415bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa92aff4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa92406e0b0 0x7fa92415c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa92aff4700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9240cb5e0 0x7fa9241530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa92aff4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9240b0940 con 0x7fa92406e0b0 2023-10-06T04:40:10.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa92aff4700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9240b11a0 con 0x7fa92406dce0 2023-10-06T04:40:10.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa92aff4700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92415cd10 con 0x7fa9240cb5e0 2023-10-06T04:40:10.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa91bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa92406e0b0 0x7fa92415c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa91bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa92406e0b0 0x7fa92415c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60466/0 (socket says 172.21.15.112:60466) 2023-10-06T04:40:10.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa91bfff700 1 -- 172.21.15.112:0/3980831173 learned_addr learned my addr 172.21.15.112:0/3980831173 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:10.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa928d90700 1 --2- 172.21.15.112:0/3980831173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa92406dce0 0x7fa92415bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa929591700 1 --2- 172.21.15.112:0/3980831173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9240cb5e0 0x7fa9241530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa91bfff700 1 -- 172.21.15.112:0/3980831173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9240cb5e0 msgr2=0x7fa9241530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa91bfff700 1 --2- 172.21.15.112:0/3980831173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9240cb5e0 0x7fa9241530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa91bfff700 1 -- 172.21.15.112:0/3980831173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa92406dce0 msgr2=0x7fa92415bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa91bfff700 1 --2- 172.21.15.112:0/3980831173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa92406dce0 0x7fa92415bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa91bfff700 1 -- 172.21.15.112:0/3980831173 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa920009a20 con 0x7fa92406e0b0 2023-10-06T04:40:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa91bfff700 1 --2- 172.21.15.112:0/3980831173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa92406e0b0 0x7fa92415c4f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa91400c7c0 tx=0x7fa914007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa918ff9700 1 -- 172.21.15.112:0/3980831173 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914005b30 con 0x7fa92406e0b0 2023-10-06T04:40:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa918ff9700 1 -- 172.21.15.112:0/3980831173 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa914005c90 con 0x7fa92406e0b0 2023-10-06T04:40:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa918ff9700 1 -- 172.21.15.112:0/3980831173 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914007320 con 0x7fa92406e0b0 2023-10-06T04:40:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa92aff4700 1 -- 172.21.15.112:0/3980831173 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9240b0b50 con 0x7fa92406e0b0 2023-10-06T04:40:10.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.696+0000 7fa92aff4700 1 -- 172.21.15.112:0/3980831173 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92415ca30 con 0x7fa92406e0b0 2023-10-06T04:40:10.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.697+0000 7fa92aff4700 1 -- 172.21.15.112:0/3980831173 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92405f230 con 0x7fa92406e0b0 2023-10-06T04:40:10.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.698+0000 7fa918ff9700 1 -- 172.21.15.112:0/3980831173 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa914007690 con 0x7fa92406e0b0 2023-10-06T04:40:10.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.698+0000 7fa918ff9700 1 --2- 172.21.15.112:0/3980831173 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa910066f30 0x7fa9100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:10.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.698+0000 7fa918ff9700 1 -- 172.21.15.112:0/3980831173 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa914083a90 con 0x7fa92406e0b0 2023-10-06T04:40:10.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.698+0000 7fa928d90700 1 --2- 172.21.15.112:0/3980831173 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa910066f30 0x7fa9100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:10.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.698+0000 7fa928d90700 1 --2- 172.21.15.112:0/3980831173 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa910066f30 0x7fa9100693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa920009e60 tx=0x7fa920019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:10.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.702+0000 7fa918ff9700 1 -- 172.21.15.112:0/3980831173 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa914050ba0 con 0x7fa92406e0b0 2023-10-06T04:40:10.833 INFO:tasks.ceph.mds.d.smithi179.stderr:2023-10-06T04:40:10.831+0000 7f0c65f6e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:40:10.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.884+0000 7fa92aff4700 1 -- 172.21.15.112:0/3980831173 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9240b12e0 con 0x7fa910066f30 2023-10-06T04:40:10.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.892+0000 7fa918ff9700 1 -- 172.21.15.112:0/3980831173 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286954 (secure 0 0 0) 0x7fa9240b12e0 con 0x7fa910066f30 2023-10-06T04:40:10.897 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:10.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.895+0000 7fa92aff4700 1 -- 172.21.15.112:0/3980831173 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa910066f30 msgr2=0x7fa9100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.895+0000 7fa92aff4700 1 --2- 172.21.15.112:0/3980831173 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa910066f30 0x7fa9100693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa920009e60 tx=0x7fa920019000 comp rx=0 tx=0).stop 2023-10-06T04:40:10.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.895+0000 7fa92aff4700 1 -- 172.21.15.112:0/3980831173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa92406e0b0 msgr2=0x7fa92415c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:10.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.895+0000 7fa92aff4700 1 --2- 172.21.15.112:0/3980831173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa92406e0b0 0x7fa92415c4f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa91400c7c0 tx=0x7fa914007f30 comp rx=0 tx=0).stop 2023-10-06T04:40:10.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.896+0000 7fa92aff4700 1 -- 172.21.15.112:0/3980831173 shutdown_connections 2023-10-06T04:40:10.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.896+0000 7fa92aff4700 1 --2- 172.21.15.112:0/3980831173 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa910066f30 0x7fa9100693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.896+0000 7fa92aff4700 1 --2- 172.21.15.112:0/3980831173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9240cb5e0 0x7fa9241530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.896+0000 7fa92aff4700 1 --2- 172.21.15.112:0/3980831173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa92406dce0 0x7fa92415bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.896+0000 7fa92aff4700 1 --2- 172.21.15.112:0/3980831173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa92406e0b0 0x7fa92415c4f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:10.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.896+0000 7fa92aff4700 1 -- 172.21.15.112:0/3980831173 >> 172.21.15.112:0/3980831173 conn(0x7fa92406d8e0 msgr2=0x7fa92415d240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:10.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.896+0000 7fa92aff4700 1 -- 172.21.15.112:0/3980831173 shutdown_connections 2023-10-06T04:40:10.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:10.896+0000 7fa92aff4700 1 -- 172.21.15.112:0/3980831173 wait complete. 2023-10-06T04:40:10.902 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-10-06T04:40:10.909 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-10-06T04:40:10.287861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":143,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382172,"kb_used_data":3868,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592548,"statfs":{"total":773094113280,"available":770654769152,"internally_reserved":0,"allocated":3960832,"data_stored":2273229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.449842"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.878419+0000","last_change":"2023-10-06T04:40:06.870934+0000","last_active":"2023-10-06T04:40:06.878419+0000","last_peered":"2023-10-06T04:40:06.878419+0000","last_clean":"2023-10-06T04:40:06.878419+0000","last_became_active":"2023-10-06T04:40:06.870720+0000","last_became_peered":"2023-10-06T04:40:06.870720+0000","last_unstale":"2023-10-06T04:40:06.878419+0000","last_undegraded":"2023-10-06T04:40:06.878419+0000","last_fullsized":"2023-10-06T04:40:06.878419+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:53:00.609185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.868012+0000","last_change":"2023-10-06T04:40:06.864940+0000","last_active":"2023-10-06T04:40:06.868012+0000","last_peered":"2023-10-06T04:40:06.868012+0000","last_clean":"2023-10-06T04:40:06.868012+0000","last_became_active":"2023-10-06T04:40:06.864693+0000","last_became_peered":"2023-10-06T04:40:06.864693+0000","last_unstale":"2023-10-06T04:40:06.868012+0000","last_undegraded":"2023-10-06T04:40:06.868012+0000","last_fullsized":"2023-10-06T04:40:06.868012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:19.692839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.881520+0000","last_change":"2023-10-06T04:40:06.876377+0000","last_active":"2023-10-06T04:40:06.881520+0000","last_peered":"2023-10-06T04:40:06.881520+0000","last_clean":"2023-10-06T04:40:06.881520+0000","last_became_active":"2023-10-06T04:40:06.876122+0000","last_became_peered":"2023-10-06T04:40:06.876122+0000","last_unstale":"2023-10-06T04:40:06.881520+0000","last_undegraded":"2023-10-06T04:40:06.881520+0000","last_fullsized":"2023-10-06T04:40:06.881520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:20.369172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.866399+0000","last_change":"2023-10-06T04:40:06.866399+0000","last_active":"2023-10-06T04:40:06.866399+0000","last_peered":"2023-10-06T04:40:06.866399+0000","last_clean":"2023-10-06T04:40:06.866399+0000","last_became_active":"2023-10-06T04:40:06.866140+0000","last_became_peered":"2023-10-06T04:40:06.866140+0000","last_unstale":"2023-10-06T04:40:06.866399+0000","last_undegraded":"2023-10-06T04:40:06.866399+0000","last_fullsized":"2023-10-06T04:40:06.866399+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:15.358520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.865767+0000","last_change":"2023-10-06T04:40:06.865767+0000","last_active":"2023-10-06T04:40:06.865767+0000","last_peered":"2023-10-06T04:40:06.865767+0000","last_clean":"2023-10-06T04:40:06.865767+0000","last_became_active":"2023-10-06T04:40:06.865564+0000","last_became_peered":"2023-10-06T04:40:06.865564+0000","last_unstale":"2023-10-06T04:40:06.865767+0000","last_undegraded":"2023-10-06T04:40:06.865767+0000","last_fullsized":"2023-10-06T04:40:06.865767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:01.244727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.866814+0000","last_change":"2023-10-06T04:40:06.866814+0000","last_active":"2023-10-06T04:40:06.866814+0000","last_peered":"2023-10-06T04:40:06.866814+0000","last_clean":"2023-10-06T04:40:06.866814+0000","last_became_active":"2023-10-06T04:40:06.866532+0000","last_became_peered":"2023-10-06T04:40:06.866532+0000","last_unstale":"2023-10-06T04:40:06.866814+0000","last_undegraded":"2023-10-06T04:40:06.866814+0000","last_fullsized":"2023-10-06T04:40:06.866814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:44.220138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.870987+0000","last_change":"2023-10-06T04:40:06.863042+0000","last_active":"2023-10-06T04:40:06.870987+0000","last_peered":"2023-10-06T04:40:06.870987+0000","last_clean":"2023-10-06T04:40:06.870987+0000","last_became_active":"2023-10-06T04:40:06.862737+0000","last_became_peered":"2023-10-06T04:40:06.862737+0000","last_unstale":"2023-10-06T04:40:06.870987+0000","last_undegraded":"2023-10-06T04:40:06.870987+0000","last_fullsized":"2023-10-06T04:40:06.870987+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:19.692839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.866170+0000","last_change":"2023-10-06T04:40:06.862642+0000","last_active":"2023-10-06T04:40:06.866170+0000","last_peered":"2023-10-06T04:40:06.866170+0000","last_clean":"2023-10-06T04:40:06.866170+0000","last_became_active":"2023-10-06T04:40:06.862387+0000","last_became_peered":"2023-10-06T04:40:06.862387+0000","last_unstale":"2023-10-06T04:40:06.866170+0000","last_undegraded":"2023-10-06T04:40:06.866170+0000","last_fullsized":"2023-10-06T04:40:06.866170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:49.088490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.881418+0000","last_change":"2023-10-06T04:40:06.874943+0000","last_active":"2023-10-06T04:40:06.881418+0000","last_peered":"2023-10-06T04:40:06.881418+0000","last_clean":"2023-10-06T04:40:06.881418+0000","last_became_active":"2023-10-06T04:40:06.874698+0000","last_became_peered":"2023-10-06T04:40:06.874698+0000","last_unstale":"2023-10-06T04:40:06.881418+0000","last_undegraded":"2023-10-06T04:40:06.881418+0000","last_fullsized":"2023-10-06T04:40:06.881418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:02.646310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.875237+0000","last_change":"2023-10-06T04:40:06.872068+0000","last_active":"2023-10-06T04:40:06.875237+0000","last_peered":"2023-10-06T04:40:06.875237+0000","last_clean":"2023-10-06T04:40:06.875237+0000","last_became_active":"2023-10-06T04:40:06.871793+0000","last_became_peered":"2023-10-06T04:40:06.871793+0000","last_unstale":"2023-10-06T04:40:06.875237+0000","last_undegraded":"2023-10-06T04:40:06.875237+0000","last_fullsized":"2023-10-06T04:40:06.875237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:13:56.406005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.876612+0000","last_change":"2023-10-06T04:40:06.874071+0000","last_active":"2023-10-06T04:40:06.876612+0000","last_peered":"2023-10-06T04:40:06.876612+0000","last_clean":"2023-10-06T04:40:06.876612+0000","last_became_active":"2023-10-06T04:40:06.873780+0000","last_became_peered":"2023-10-06T04:40:06.873780+0000","last_unstale":"2023-10-06T04:40:06.876612+0000","last_undegraded":"2023-10-06T04:40:06.876612+0000","last_fullsized":"2023-10-06T04:40:06.876612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:22.683312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.869684+0000","last_change":"2023-10-06T04:40:06.865585+0000","last_active":"2023-10-06T04:40:06.869684+0000","last_peered":"2023-10-06T04:40:06.869684+0000","last_clean":"2023-10-06T04:40:06.869684+0000","last_became_active":"2023-10-06T04:40:06.865325+0000","last_became_peered":"2023-10-06T04:40:06.865325+0000","last_unstale":"2023-10-06T04:40:06.869684+0000","last_undegraded":"2023-10-06T04:40:06.869684+0000","last_fullsized":"2023-10-06T04:40:06.869684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:44.220138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.878609+0000","last_change":"2023-10-06T04:40:06.875870+0000","last_active":"2023-10-06T04:40:06.878609+0000","last_peered":"2023-10-06T04:40:06.878609+0000","last_clean":"2023-10-06T04:40:06.878609+0000","last_became_active":"2023-10-06T04:40:06.875585+0000","last_became_peered":"2023-10-06T04:40:06.875585+0000","last_unstale":"2023-10-06T04:40:06.878609+0000","last_undegraded":"2023-10-06T04:40:06.878609+0000","last_fullsized":"2023-10-06T04:40:06.878609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:53:00.609185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.874746+0000","last_change":"2023-10-06T04:40:06.865219+0000","last_active":"2023-10-06T04:40:06.874746+0000","last_peered":"2023-10-06T04:40:06.874746+0000","last_clean":"2023-10-06T04:40:06.874746+0000","last_became_active":"2023-10-06T04:40:06.864961+0000","last_became_peered":"2023-10-06T04:40:06.864961+0000","last_unstale":"2023-10-06T04:40:06.874746+0000","last_undegraded":"2023-10-06T04:40:06.874746+0000","last_fullsized":"2023-10-06T04:40:06.874746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:56.016725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.874658+0000","last_change":"2023-10-06T04:40:06.866274+0000","last_active":"2023-10-06T04:40:06.874658+0000","last_peered":"2023-10-06T04:40:06.874658+0000","last_clean":"2023-10-06T04:40:06.874658+0000","last_became_active":"2023-10-06T04:40:06.865967+0000","last_became_peered":"2023-10-06T04:40:06.865967+0000","last_unstale":"2023-10-06T04:40:06.874658+0000","last_undegraded":"2023-10-06T04:40:06.874658+0000","last_fullsized":"2023-10-06T04:40:06.874658+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:42.727412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.885810+0000","last_change":"2023-10-06T04:40:06.880456+0000","last_active":"2023-10-06T04:40:06.885810+0000","last_peered":"2023-10-06T04:40:06.885810+0000","last_clean":"2023-10-06T04:40:06.885810+0000","last_became_active":"2023-10-06T04:40:06.879721+0000","last_became_peered":"2023-10-06T04:40:06.879721+0000","last_unstale":"2023-10-06T04:40:06.885810+0000","last_undegraded":"2023-10-06T04:40:06.885810+0000","last_fullsized":"2023-10-06T04:40:06.885810+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:02.646310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.881901+0000","last_change":"2023-10-06T04:40:06.875681+0000","last_active":"2023-10-06T04:40:06.881901+0000","last_peered":"2023-10-06T04:40:06.881901+0000","last_clean":"2023-10-06T04:40:06.881901+0000","last_became_active":"2023-10-06T04:40:06.875424+0000","last_became_peered":"2023-10-06T04:40:06.875424+0000","last_unstale":"2023-10-06T04:40:06.881901+0000","last_undegraded":"2023-10-06T04:40:06.881901+0000","last_fullsized":"2023-10-06T04:40:06.881901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:52.078615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.880208+0000","last_change":"2023-10-06T04:40:06.869287+0000","last_active":"2023-10-06T04:40:06.880208+0000","last_peered":"2023-10-06T04:40:06.880208+0000","last_clean":"2023-10-06T04:40:06.880208+0000","last_became_active":"2023-10-06T04:40:06.868662+0000","last_became_peered":"2023-10-06T04:40:06.868662+0000","last_unstale":"2023-10-06T04:40:06.880208+0000","last_undegraded":"2023-10-06T04:40:06.880208+0000","last_fullsized":"2023-10-06T04:40:06.880208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:35.274464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.867715+0000","last_change":"2023-10-06T04:40:06.867715+0000","last_active":"2023-10-06T04:40:06.867715+0000","last_peered":"2023-10-06T04:40:06.867715+0000","last_clean":"2023-10-06T04:40:06.867715+0000","last_became_active":"2023-10-06T04:40:06.867473+0000","last_became_peered":"2023-10-06T04:40:06.867473+0000","last_unstale":"2023-10-06T04:40:06.867715+0000","last_undegraded":"2023-10-06T04:40:06.867715+0000","last_fullsized":"2023-10-06T04:40:06.867715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:02.377403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.878666+0000","last_change":"2023-10-06T04:40:06.868658+0000","last_active":"2023-10-06T04:40:06.878666+0000","last_peered":"2023-10-06T04:40:06.878666+0000","last_clean":"2023-10-06T04:40:06.878666+0000","last_became_active":"2023-10-06T04:40:06.868346+0000","last_became_peered":"2023-10-06T04:40:06.868346+0000","last_unstale":"2023-10-06T04:40:06.878666+0000","last_undegraded":"2023-10-06T04:40:06.878666+0000","last_fullsized":"2023-10-06T04:40:06.878666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:19.187693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.875209+0000","last_change":"2023-10-06T04:40:06.871479+0000","last_active":"2023-10-06T04:40:06.875209+0000","last_peered":"2023-10-06T04:40:06.875209+0000","last_clean":"2023-10-06T04:40:06.875209+0000","last_became_active":"2023-10-06T04:40:06.871188+0000","last_became_peered":"2023-10-06T04:40:06.871188+0000","last_unstale":"2023-10-06T04:40:06.875209+0000","last_undegraded":"2023-10-06T04:40:06.875209+0000","last_fullsized":"2023-10-06T04:40:06.875209+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:46.681452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.874769+0000","last_change":"2023-10-06T04:40:06.866463+0000","last_active":"2023-10-06T04:40:06.874769+0000","last_peered":"2023-10-06T04:40:06.874769+0000","last_clean":"2023-10-06T04:40:06.874769+0000","last_became_active":"2023-10-06T04:40:06.866212+0000","last_became_peered":"2023-10-06T04:40:06.866212+0000","last_unstale":"2023-10-06T04:40:06.874769+0000","last_undegraded":"2023-10-06T04:40:06.874769+0000","last_fullsized":"2023-10-06T04:40:06.874769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:06.708300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.888080+0000","last_change":"2023-10-06T04:40:06.885137+0000","last_active":"2023-10-06T04:40:06.888080+0000","last_peered":"2023-10-06T04:40:06.888080+0000","last_clean":"2023-10-06T04:40:06.888080+0000","last_became_active":"2023-10-06T04:40:06.884875+0000","last_became_peered":"2023-10-06T04:40:06.884875+0000","last_unstale":"2023-10-06T04:40:06.888080+0000","last_undegraded":"2023-10-06T04:40:06.888080+0000","last_fullsized":"2023-10-06T04:40:06.888080+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:19.277198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.876067+0000","last_change":"2023-10-06T04:40:06.876067+0000","last_active":"2023-10-06T04:40:06.876067+0000","last_peered":"2023-10-06T04:40:06.876067+0000","last_clean":"2023-10-06T04:40:06.876067+0000","last_became_active":"2023-10-06T04:40:06.875811+0000","last_became_peered":"2023-10-06T04:40:06.875811+0000","last_unstale":"2023-10-06T04:40:06.876067+0000","last_undegraded":"2023-10-06T04:40:06.876067+0000","last_fullsized":"2023-10-06T04:40:06.876067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:23.456976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.881069+0000","last_change":"2023-10-06T04:40:06.869594+0000","last_active":"2023-10-06T04:40:06.881069+0000","last_peered":"2023-10-06T04:40:06.881069+0000","last_clean":"2023-10-06T04:40:06.881069+0000","last_became_active":"2023-10-06T04:40:06.869339+0000","last_became_peered":"2023-10-06T04:40:06.869339+0000","last_unstale":"2023-10-06T04:40:06.881069+0000","last_undegraded":"2023-10-06T04:40:06.881069+0000","last_fullsized":"2023-10-06T04:40:06.881069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:25.170985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.868269+0000","last_change":"2023-10-06T04:40:06.868269+0000","last_active":"2023-10-06T04:40:06.868269+0000","last_peered":"2023-10-06T04:40:06.868269+0000","last_clean":"2023-10-06T04:40:06.868269+0000","last_became_active":"2023-10-06T04:40:06.868029+0000","last_became_peered":"2023-10-06T04:40:06.868029+0000","last_unstale":"2023-10-06T04:40:06.868269+0000","last_undegraded":"2023-10-06T04:40:06.868269+0000","last_fullsized":"2023-10-06T04:40:06.868269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:45.633745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.869042+0000","last_change":"2023-10-06T04:40:06.864742+0000","last_active":"2023-10-06T04:40:06.869042+0000","last_peered":"2023-10-06T04:40:06.869042+0000","last_clean":"2023-10-06T04:40:06.869042+0000","last_became_active":"2023-10-06T04:40:06.864513+0000","last_became_peered":"2023-10-06T04:40:06.864513+0000","last_unstale":"2023-10-06T04:40:06.869042+0000","last_undegraded":"2023-10-06T04:40:06.869042+0000","last_fullsized":"2023-10-06T04:40:06.869042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:15.358520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.874651+0000","last_change":"2023-10-06T04:40:06.866303+0000","last_active":"2023-10-06T04:40:06.874651+0000","last_peered":"2023-10-06T04:40:06.874651+0000","last_clean":"2023-10-06T04:40:06.874651+0000","last_became_active":"2023-10-06T04:40:06.863321+0000","last_became_peered":"2023-10-06T04:40:06.863321+0000","last_unstale":"2023-10-06T04:40:06.874651+0000","last_undegraded":"2023-10-06T04:40:06.874651+0000","last_fullsized":"2023-10-06T04:40:06.874651+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:49.250693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.880317+0000","last_change":"2023-10-06T04:40:06.870886+0000","last_active":"2023-10-06T04:40:06.880317+0000","last_peered":"2023-10-06T04:40:06.880317+0000","last_clean":"2023-10-06T04:40:06.880317+0000","last_became_active":"2023-10-06T04:40:06.868975+0000","last_became_peered":"2023-10-06T04:40:06.868975+0000","last_unstale":"2023-10-06T04:40:06.880317+0000","last_undegraded":"2023-10-06T04:40:06.880317+0000","last_fullsized":"2023-10-06T04:40:06.880317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:02.377403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.878599+0000","last_change":"2023-10-06T04:40:06.868321+0000","last_active":"2023-10-06T04:40:06.878599+0000","last_peered":"2023-10-06T04:40:06.878599+0000","last_clean":"2023-10-06T04:40:06.878599+0000","last_became_active":"2023-10-06T04:40:06.868022+0000","last_became_peered":"2023-10-06T04:40:06.868022+0000","last_unstale":"2023-10-06T04:40:06.878599+0000","last_undegraded":"2023-10-06T04:40:06.878599+0000","last_fullsized":"2023-10-06T04:40:06.878599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:02.998120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.885796+0000","last_change":"2023-10-06T04:40:06.880188+0000","last_active":"2023-10-06T04:40:06.885796+0000","last_peered":"2023-10-06T04:40:06.885796+0000","last_clean":"2023-10-06T04:40:06.885796+0000","last_became_active":"2023-10-06T04:40:06.879920+0000","last_became_peered":"2023-10-06T04:40:06.879920+0000","last_unstale":"2023-10-06T04:40:06.885796+0000","last_undegraded":"2023-10-06T04:40:06.885796+0000","last_fullsized":"2023-10-06T04:40:06.885796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:36.702203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.864831+0000","last_change":"2023-10-06T04:40:06.864831+0000","last_active":"2023-10-06T04:40:06.864831+0000","last_peered":"2023-10-06T04:40:06.864831+0000","last_clean":"2023-10-06T04:40:06.864831+0000","last_became_active":"2023-10-06T04:40:06.864576+0000","last_became_peered":"2023-10-06T04:40:06.864576+0000","last_unstale":"2023-10-06T04:40:06.864831+0000","last_undegraded":"2023-10-06T04:40:06.864831+0000","last_fullsized":"2023-10-06T04:40:06.864831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:42.172829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.882132+0000","last_change":"2023-10-06T04:40:06.875968+0000","last_active":"2023-10-06T04:40:06.882132+0000","last_peered":"2023-10-06T04:40:06.882132+0000","last_clean":"2023-10-06T04:40:06.882132+0000","last_became_active":"2023-10-06T04:40:06.875430+0000","last_became_peered":"2023-10-06T04:40:06.875430+0000","last_unstale":"2023-10-06T04:40:06.882132+0000","last_undegraded":"2023-10-06T04:40:06.882132+0000","last_fullsized":"2023-10-06T04:40:06.882132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:44.220138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"30'4","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.886267+0000","last_change":"2023-10-06T04:40:05.861695+0000","last_active":"2023-10-06T04:40:06.886267+0000","last_peered":"2023-10-06T04:40:06.886267+0000","last_clean":"2023-10-06T04:40:06.886267+0000","last_became_active":"2023-10-06T04:40:05.861455+0000","last_became_peered":"2023-10-06T04:40:05.861455+0000","last_unstale":"2023-10-06T04:40:06.886267+0000","last_undegraded":"2023-10-06T04:40:06.886267+0000","last_fullsized":"2023-10-06T04:40:06.886267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:48.868504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.876654+0000","last_change":"2023-10-06T04:40:06.876654+0000","last_active":"2023-10-06T04:40:06.876654+0000","last_peered":"2023-10-06T04:40:06.876654+0000","last_clean":"2023-10-06T04:40:06.876654+0000","last_became_active":"2023-10-06T04:40:06.876329+0000","last_became_peered":"2023-10-06T04:40:06.876329+0000","last_unstale":"2023-10-06T04:40:06.876654+0000","last_undegraded":"2023-10-06T04:40:06.876654+0000","last_fullsized":"2023-10-06T04:40:06.876654+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:55.510291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.882180+0000","last_change":"2023-10-06T04:40:05.865948+0000","last_active":"2023-10-06T04:40:06.882180+0000","last_peered":"2023-10-06T04:40:06.882180+0000","last_clean":"2023-10-06T04:40:06.882180+0000","last_became_active":"2023-10-06T04:40:05.865652+0000","last_became_peered":"2023-10-06T04:40:05.865652+0000","last_unstale":"2023-10-06T04:40:06.882180+0000","last_undegraded":"2023-10-06T04:40:06.882180+0000","last_fullsized":"2023-10-06T04:40:06.882180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:01.994316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.872646+0000","last_change":"2023-10-06T04:40:06.865028+0000","last_active":"2023-10-06T04:40:06.872646+0000","last_peered":"2023-10-06T04:40:06.872646+0000","last_clean":"2023-10-06T04:40:06.872646+0000","last_became_active":"2023-10-06T04:40:06.864706+0000","last_became_peered":"2023-10-06T04:40:06.864706+0000","last_unstale":"2023-10-06T04:40:06.872646+0000","last_undegraded":"2023-10-06T04:40:06.872646+0000","last_fullsized":"2023-10-06T04:40:06.872646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:15.350503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.885860+0000","last_change":"2023-10-06T04:40:05.861055+0000","last_active":"2023-10-06T04:40:06.885860+0000","last_peered":"2023-10-06T04:40:06.885860+0000","last_clean":"2023-10-06T04:40:06.885860+0000","last_became_active":"2023-10-06T04:40:05.860793+0000","last_became_peered":"2023-10-06T04:40:05.860793+0000","last_unstale":"2023-10-06T04:40:06.885860+0000","last_undegraded":"2023-10-06T04:40:06.885860+0000","last_fullsized":"2023-10-06T04:40:06.885860+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:00.240923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.870481+0000","last_change":"2023-10-06T04:40:06.863450+0000","last_active":"2023-10-06T04:40:06.870481+0000","last_peered":"2023-10-06T04:40:06.870481+0000","last_clean":"2023-10-06T04:40:06.870481+0000","last_became_active":"2023-10-06T04:40:06.863185+0000","last_became_peered":"2023-10-06T04:40:06.863185+0000","last_unstale":"2023-10-06T04:40:06.870481+0000","last_undegraded":"2023-10-06T04:40:06.870481+0000","last_fullsized":"2023-10-06T04:40:06.870481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:13:56.406005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.886536+0000","last_change":"2023-10-06T04:40:05.859684+0000","last_active":"2023-10-06T04:40:06.886536+0000","last_peered":"2023-10-06T04:40:06.886536+0000","last_clean":"2023-10-06T04:40:06.886536+0000","last_became_active":"2023-10-06T04:40:05.859434+0000","last_became_peered":"2023-10-06T04:40:05.859434+0000","last_unstale":"2023-10-06T04:40:06.886536+0000","last_undegraded":"2023-10-06T04:40:06.886536+0000","last_fullsized":"2023-10-06T04:40:06.886536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:48.246890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.875308+0000","last_change":"2023-10-06T04:40:06.867484+0000","last_active":"2023-10-06T04:40:06.875308+0000","last_peered":"2023-10-06T04:40:06.875308+0000","last_clean":"2023-10-06T04:40:06.875308+0000","last_became_active":"2023-10-06T04:40:06.867218+0000","last_became_peered":"2023-10-06T04:40:06.867218+0000","last_unstale":"2023-10-06T04:40:06.875308+0000","last_undegraded":"2023-10-06T04:40:06.875308+0000","last_fullsized":"2023-10-06T04:40:06.875308+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:19.277198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.883520+0000","last_change":"2023-10-06T04:40:05.858212+0000","last_active":"2023-10-06T04:40:06.883520+0000","last_peered":"2023-10-06T04:40:06.883520+0000","last_clean":"2023-10-06T04:40:06.883520+0000","last_became_active":"2023-10-06T04:40:05.857939+0000","last_became_peered":"2023-10-06T04:40:05.857939+0000","last_unstale":"2023-10-06T04:40:06.883520+0000","last_undegraded":"2023-10-06T04:40:06.883520+0000","last_fullsized":"2023-10-06T04:40:06.883520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:01.994316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.876146+0000","last_change":"2023-10-06T04:40:06.872916+0000","last_active":"2023-10-06T04:40:06.876146+0000","last_peered":"2023-10-06T04:40:06.876146+0000","last_clean":"2023-10-06T04:40:06.876146+0000","last_became_active":"2023-10-06T04:40:06.872649+0000","last_became_peered":"2023-10-06T04:40:06.872649+0000","last_unstale":"2023-10-06T04:40:06.876146+0000","last_undegraded":"2023-10-06T04:40:06.876146+0000","last_fullsized":"2023-10-06T04:40:06.876146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:52.078615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.882954+0000","last_change":"2023-10-06T04:40:05.866276+0000","last_active":"2023-10-06T04:40:06.882954+0000","last_peered":"2023-10-06T04:40:06.882954+0000","last_clean":"2023-10-06T04:40:06.882954+0000","last_became_active":"2023-10-06T04:40:05.865981+0000","last_became_peered":"2023-10-06T04:40:05.865981+0000","last_unstale":"2023-10-06T04:40:06.882954+0000","last_undegraded":"2023-10-06T04:40:06.882954+0000","last_fullsized":"2023-10-06T04:40:06.882954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:01.373599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.869663+0000","last_change":"2023-10-06T04:40:06.864710+0000","last_active":"2023-10-06T04:40:06.869663+0000","last_peered":"2023-10-06T04:40:06.869663+0000","last_clean":"2023-10-06T04:40:06.869663+0000","last_became_active":"2023-10-06T04:40:06.864391+0000","last_became_peered":"2023-10-06T04:40:06.864391+0000","last_unstale":"2023-10-06T04:40:06.869663+0000","last_undegraded":"2023-10-06T04:40:06.869663+0000","last_fullsized":"2023-10-06T04:40:06.869663+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:16.229613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:40:05.856560+0000","last_change":"2023-10-06T04:40:05.855152+0000","last_active":"2023-10-06T04:40:05.856560+0000","last_peered":"2023-10-06T04:40:05.856560+0000","last_clean":"2023-10-06T04:40:05.856560+0000","last_became_active":"2023-10-06T04:40:05.854927+0000","last_became_peered":"2023-10-06T04:40:05.854927+0000","last_unstale":"2023-10-06T04:40:05.856560+0000","last_undegraded":"2023-10-06T04:40:05.856560+0000","last_fullsized":"2023-10-06T04:40:05.856560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:22.453172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.880463+0000","last_change":"2023-10-06T04:40:06.873247+0000","last_active":"2023-10-06T04:40:06.880463+0000","last_peered":"2023-10-06T04:40:06.880463+0000","last_clean":"2023-10-06T04:40:06.880463+0000","last_became_active":"2023-10-06T04:40:06.872939+0000","last_became_peered":"2023-10-06T04:40:06.872939+0000","last_unstale":"2023-10-06T04:40:06.880463+0000","last_undegraded":"2023-10-06T04:40:06.880463+0000","last_fullsized":"2023-10-06T04:40:06.880463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:56.016725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.858867+0000","last_change":"2023-10-06T04:40:05.858713+0000","last_active":"2023-10-06T04:40:06.858867+0000","last_peered":"2023-10-06T04:40:06.858867+0000","last_clean":"2023-10-06T04:40:06.858867+0000","last_became_active":"2023-10-06T04:40:05.858420+0000","last_became_peered":"2023-10-06T04:40:05.858420+0000","last_unstale":"2023-10-06T04:40:06.858867+0000","last_undegraded":"2023-10-06T04:40:06.858867+0000","last_fullsized":"2023-10-06T04:40:06.858867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:41.169025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.866234+0000","last_change":"2023-10-06T04:40:06.866234+0000","last_active":"2023-10-06T04:40:06.866234+0000","last_peered":"2023-10-06T04:40:06.866234+0000","last_clean":"2023-10-06T04:40:06.866234+0000","last_became_active":"2023-10-06T04:40:06.865816+0000","last_became_peered":"2023-10-06T04:40:06.865816+0000","last_unstale":"2023-10-06T04:40:06.866234+0000","last_undegraded":"2023-10-06T04:40:06.866234+0000","last_fullsized":"2023-10-06T04:40:06.866234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:25.170985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.859909+0000","last_change":"2023-10-06T04:40:05.856512+0000","last_active":"2023-10-06T04:40:06.859909+0000","last_peered":"2023-10-06T04:40:06.859909+0000","last_clean":"2023-10-06T04:40:06.859909+0000","last_became_active":"2023-10-06T04:40:05.856249+0000","last_became_peered":"2023-10-06T04:40:05.856249+0000","last_unstale":"2023-10-06T04:40:06.859909+0000","last_undegraded":"2023-10-06T04:40:06.859909+0000","last_fullsized":"2023-10-06T04:40:06.859909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:36.253677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.886187+0000","last_change":"2023-10-06T04:40:06.881431+0000","last_active":"2023-10-06T04:40:06.886187+0000","last_peered":"2023-10-06T04:40:06.886187+0000","last_clean":"2023-10-06T04:40:06.886187+0000","last_became_active":"2023-10-06T04:40:06.881158+0000","last_became_peered":"2023-10-06T04:40:06.881158+0000","last_unstale":"2023-10-06T04:40:06.886187+0000","last_undegraded":"2023-10-06T04:40:06.886187+0000","last_fullsized":"2023-10-06T04:40:06.886187+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:42.727412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.856774+0000","last_change":"2023-10-06T04:40:05.856563+0000","last_active":"2023-10-06T04:40:06.856774+0000","last_peered":"2023-10-06T04:40:06.856774+0000","last_clean":"2023-10-06T04:40:06.856774+0000","last_became_active":"2023-10-06T04:40:05.856077+0000","last_became_peered":"2023-10-06T04:40:05.856077+0000","last_unstale":"2023-10-06T04:40:06.856774+0000","last_undegraded":"2023-10-06T04:40:06.856774+0000","last_fullsized":"2023-10-06T04:40:06.856774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:14.354716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.877707+0000","last_change":"2023-10-06T04:40:06.869406+0000","last_active":"2023-10-06T04:40:06.877707+0000","last_peered":"2023-10-06T04:40:06.877707+0000","last_clean":"2023-10-06T04:40:06.877707+0000","last_became_active":"2023-10-06T04:40:06.869165+0000","last_became_peered":"2023-10-06T04:40:06.869165+0000","last_unstale":"2023-10-06T04:40:06.877707+0000","last_undegraded":"2023-10-06T04:40:06.877707+0000","last_fullsized":"2023-10-06T04:40:06.877707+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:52.078615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"30'3","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.886446+0000","last_change":"2023-10-06T04:40:05.857734+0000","last_active":"2023-10-06T04:40:06.886446+0000","last_peered":"2023-10-06T04:40:06.886446+0000","last_clean":"2023-10-06T04:40:06.886446+0000","last_became_active":"2023-10-06T04:40:05.857451+0000","last_became_peered":"2023-10-06T04:40:05.857451+0000","last_unstale":"2023-10-06T04:40:06.886446+0000","last_undegraded":"2023-10-06T04:40:06.886446+0000","last_fullsized":"2023-10-06T04:40:06.886446+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:00.240923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.872656+0000","last_change":"2023-10-06T04:40:06.869180+0000","last_active":"2023-10-06T04:40:06.872656+0000","last_peered":"2023-10-06T04:40:06.872656+0000","last_clean":"2023-10-06T04:40:06.872656+0000","last_became_active":"2023-10-06T04:40:06.868913+0000","last_became_peered":"2023-10-06T04:40:06.868913+0000","last_unstale":"2023-10-06T04:40:06.872656+0000","last_undegraded":"2023-10-06T04:40:06.872656+0000","last_fullsized":"2023-10-06T04:40:06.872656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:42.727412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"30'6","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.890977+0000","last_change":"2023-10-06T04:40:05.861003+0000","last_active":"2023-10-06T04:40:06.890977+0000","last_peered":"2023-10-06T04:40:06.890977+0000","last_clean":"2023-10-06T04:40:06.890977+0000","last_became_active":"2023-10-06T04:40:05.860757+0000","last_became_peered":"2023-10-06T04:40:05.860757+0000","last_unstale":"2023-10-06T04:40:06.890977+0000","last_undegraded":"2023-10-06T04:40:06.890977+0000","last_fullsized":"2023-10-06T04:40:06.890977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:44.629941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.881530+0000","last_change":"2023-10-06T04:40:06.876429+0000","last_active":"2023-10-06T04:40:06.881530+0000","last_peered":"2023-10-06T04:40:06.881530+0000","last_clean":"2023-10-06T04:40:06.881530+0000","last_became_active":"2023-10-06T04:40:06.876171+0000","last_became_peered":"2023-10-06T04:40:06.876171+0000","last_unstale":"2023-10-06T04:40:06.881530+0000","last_undegraded":"2023-10-06T04:40:06.881530+0000","last_fullsized":"2023-10-06T04:40:06.881530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:49.250693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.883457+0000","last_change":"2023-10-06T04:40:05.855090+0000","last_active":"2023-10-06T04:40:06.883457+0000","last_peered":"2023-10-06T04:40:06.883457+0000","last_clean":"2023-10-06T04:40:06.883457+0000","last_became_active":"2023-10-06T04:40:05.854841+0000","last_became_peered":"2023-10-06T04:40:05.854841+0000","last_unstale":"2023-10-06T04:40:06.883457+0000","last_undegraded":"2023-10-06T04:40:06.883457+0000","last_fullsized":"2023-10-06T04:40:06.883457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:09.538560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.878194+0000","last_change":"2023-10-06T04:40:06.868206+0000","last_active":"2023-10-06T04:40:06.878194+0000","last_peered":"2023-10-06T04:40:06.878194+0000","last_clean":"2023-10-06T04:40:06.878194+0000","last_became_active":"2023-10-06T04:40:06.867661+0000","last_became_peered":"2023-10-06T04:40:06.867661+0000","last_unstale":"2023-10-06T04:40:06.878194+0000","last_undegraded":"2023-10-06T04:40:06.878194+0000","last_fullsized":"2023-10-06T04:40:06.878194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:20.369172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:40:05.856520+0000","last_change":"2023-10-06T04:40:05.855140+0000","last_active":"2023-10-06T04:40:05.856520+0000","last_peered":"2023-10-06T04:40:05.856520+0000","last_clean":"2023-10-06T04:40:05.856520+0000","last_became_active":"2023-10-06T04:40:05.854885+0000","last_became_peered":"2023-10-06T04:40:05.854885+0000","last_unstale":"2023-10-06T04:40:05.856520+0000","last_undegraded":"2023-10-06T04:40:05.856520+0000","last_fullsized":"2023-10-06T04:40:05.856520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:01.373599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.885769+0000","last_change":"2023-10-06T04:40:06.880369+0000","last_active":"2023-10-06T04:40:06.885769+0000","last_peered":"2023-10-06T04:40:06.885769+0000","last_clean":"2023-10-06T04:40:06.885769+0000","last_became_active":"2023-10-06T04:40:06.879779+0000","last_became_peered":"2023-10-06T04:40:06.879779+0000","last_unstale":"2023-10-06T04:40:06.885769+0000","last_undegraded":"2023-10-06T04:40:06.885769+0000","last_fullsized":"2023-10-06T04:40:06.885769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:20.369172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.859032+0000","last_change":"2023-10-06T04:40:05.861999+0000","last_active":"2023-10-06T04:40:06.859032+0000","last_peered":"2023-10-06T04:40:06.859032+0000","last_clean":"2023-10-06T04:40:06.859032+0000","last_became_active":"2023-10-06T04:40:05.861411+0000","last_became_peered":"2023-10-06T04:40:05.861411+0000","last_unstale":"2023-10-06T04:40:06.859032+0000","last_undegraded":"2023-10-06T04:40:06.859032+0000","last_fullsized":"2023-10-06T04:40:06.859032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:55.482179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.878034+0000","last_change":"2023-10-06T04:40:06.867563+0000","last_active":"2023-10-06T04:40:06.878034+0000","last_peered":"2023-10-06T04:40:06.878034+0000","last_clean":"2023-10-06T04:40:06.878034+0000","last_became_active":"2023-10-06T04:40:06.867335+0000","last_became_peered":"2023-10-06T04:40:06.867335+0000","last_unstale":"2023-10-06T04:40:06.878034+0000","last_undegraded":"2023-10-06T04:40:06.878034+0000","last_fullsized":"2023-10-06T04:40:06.878034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:22.683312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'8","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.888476+0000","last_change":"2023-10-06T04:40:05.866198+0000","last_active":"2023-10-06T04:40:06.888476+0000","last_peered":"2023-10-06T04:40:06.888476+0000","last_clean":"2023-10-06T04:40:06.888476+0000","last_became_active":"2023-10-06T04:40:05.865907+0000","last_became_peered":"2023-10-06T04:40:05.865907+0000","last_unstale":"2023-10-06T04:40:06.888476+0000","last_undegraded":"2023-10-06T04:40:06.888476+0000","last_fullsized":"2023-10-06T04:40:06.888476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:22.453172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.868686+0000","last_change":"2023-10-06T04:40:06.863286+0000","last_active":"2023-10-06T04:40:06.868686+0000","last_peered":"2023-10-06T04:40:06.868686+0000","last_clean":"2023-10-06T04:40:06.868686+0000","last_became_active":"2023-10-06T04:40:06.863032+0000","last_became_peered":"2023-10-06T04:40:06.863032+0000","last_unstale":"2023-10-06T04:40:06.868686+0000","last_undegraded":"2023-10-06T04:40:06.868686+0000","last_fullsized":"2023-10-06T04:40:06.868686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:42.727412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.885566+0000","last_change":"2023-10-06T04:40:05.863067+0000","last_active":"2023-10-06T04:40:06.885566+0000","last_peered":"2023-10-06T04:40:06.885566+0000","last_clean":"2023-10-06T04:40:06.885566+0000","last_became_active":"2023-10-06T04:40:05.862789+0000","last_became_peered":"2023-10-06T04:40:05.862789+0000","last_unstale":"2023-10-06T04:40:06.885566+0000","last_undegraded":"2023-10-06T04:40:06.885566+0000","last_fullsized":"2023-10-06T04:40:06.885566+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:01.373599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.875208+0000","last_change":"2023-10-06T04:40:06.872195+0000","last_active":"2023-10-06T04:40:06.875208+0000","last_peered":"2023-10-06T04:40:06.875208+0000","last_clean":"2023-10-06T04:40:06.875208+0000","last_became_active":"2023-10-06T04:40:06.870402+0000","last_became_peered":"2023-10-06T04:40:06.870402+0000","last_unstale":"2023-10-06T04:40:06.875208+0000","last_undegraded":"2023-10-06T04:40:06.875208+0000","last_fullsized":"2023-10-06T04:40:06.875208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:36.702203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.883491+0000","last_change":"2023-10-06T04:40:05.864089+0000","last_active":"2023-10-06T04:40:06.883491+0000","last_peered":"2023-10-06T04:40:06.883491+0000","last_clean":"2023-10-06T04:40:06.883491+0000","last_became_active":"2023-10-06T04:40:05.863798+0000","last_became_peered":"2023-10-06T04:40:05.863798+0000","last_unstale":"2023-10-06T04:40:06.883491+0000","last_undegraded":"2023-10-06T04:40:06.883491+0000","last_fullsized":"2023-10-06T04:40:06.883491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:19.365368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.872668+0000","last_change":"2023-10-06T04:40:06.865493+0000","last_active":"2023-10-06T04:40:06.872668+0000","last_peered":"2023-10-06T04:40:06.872668+0000","last_clean":"2023-10-06T04:40:06.872668+0000","last_became_active":"2023-10-06T04:40:06.865301+0000","last_became_peered":"2023-10-06T04:40:06.865301+0000","last_unstale":"2023-10-06T04:40:06.872668+0000","last_undegraded":"2023-10-06T04:40:06.872668+0000","last_fullsized":"2023-10-06T04:40:06.872668+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:22.683312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"30'1","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.858789+0000","last_change":"2023-10-06T04:40:05.863685+0000","last_active":"2023-10-06T04:40:06.858789+0000","last_peered":"2023-10-06T04:40:06.858789+0000","last_clean":"2023-10-06T04:40:06.858789+0000","last_became_active":"2023-10-06T04:40:05.863428+0000","last_became_peered":"2023-10-06T04:40:05.863428+0000","last_unstale":"2023-10-06T04:40:06.858789+0000","last_undegraded":"2023-10-06T04:40:06.858789+0000","last_fullsized":"2023-10-06T04:40:06.858789+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:11.911267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.868579+0000","last_change":"2023-10-06T04:40:06.868579+0000","last_active":"2023-10-06T04:40:06.868579+0000","last_peered":"2023-10-06T04:40:06.868579+0000","last_clean":"2023-10-06T04:40:06.868579+0000","last_became_active":"2023-10-06T04:40:06.868318+0000","last_became_peered":"2023-10-06T04:40:06.868318+0000","last_unstale":"2023-10-06T04:40:06.868579+0000","last_undegraded":"2023-10-06T04:40:06.868579+0000","last_fullsized":"2023-10-06T04:40:06.868579+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:37.684024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:40:05.863441+0000","last_change":"2023-10-06T04:40:05.861025+0000","last_active":"2023-10-06T04:40:05.863441+0000","last_peered":"2023-10-06T04:40:05.863441+0000","last_clean":"2023-10-06T04:40:05.863441+0000","last_became_active":"2023-10-06T04:40:05.860781+0000","last_became_peered":"2023-10-06T04:40:05.860781+0000","last_unstale":"2023-10-06T04:40:05.863441+0000","last_undegraded":"2023-10-06T04:40:05.863441+0000","last_fullsized":"2023-10-06T04:40:05.863441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:36.680221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.885820+0000","last_change":"2023-10-06T04:40:06.880587+0000","last_active":"2023-10-06T04:40:06.885820+0000","last_peered":"2023-10-06T04:40:06.885820+0000","last_clean":"2023-10-06T04:40:06.885820+0000","last_became_active":"2023-10-06T04:40:06.880070+0000","last_became_peered":"2023-10-06T04:40:06.880070+0000","last_unstale":"2023-10-06T04:40:06.885820+0000","last_undegraded":"2023-10-06T04:40:06.885820+0000","last_fullsized":"2023-10-06T04:40:06.885820+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:04.605086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.881644+0000","last_change":"2023-10-06T04:40:05.851594+0000","last_active":"2023-10-06T04:40:06.881644+0000","last_peered":"2023-10-06T04:40:06.881644+0000","last_clean":"2023-10-06T04:40:06.881644+0000","last_became_active":"2023-10-06T04:40:05.851311+0000","last_became_peered":"2023-10-06T04:40:05.851311+0000","last_unstale":"2023-10-06T04:40:06.881644+0000","last_undegraded":"2023-10-06T04:40:06.881644+0000","last_fullsized":"2023-10-06T04:40:06.881644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:40:37.634799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.878031+0000","last_change":"2023-10-06T04:40:06.871473+0000","last_active":"2023-10-06T04:40:06.878031+0000","last_peered":"2023-10-06T04:40:06.878031+0000","last_clean":"2023-10-06T04:40:06.878031+0000","last_became_active":"2023-10-06T04:40:06.871234+0000","last_became_peered":"2023-10-06T04:40:06.871234+0000","last_unstale":"2023-10-06T04:40:06.878031+0000","last_undegraded":"2023-10-06T04:40:06.878031+0000","last_fullsized":"2023-10-06T04:40:06.878031+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:36.702203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:40:05.864079+0000","last_change":"2023-10-06T04:40:05.863497+0000","last_active":"2023-10-06T04:40:05.864079+0000","last_peered":"2023-10-06T04:40:05.864079+0000","last_clean":"2023-10-06T04:40:05.864079+0000","last_became_active":"2023-10-06T04:40:05.863227+0000","last_became_peered":"2023-10-06T04:40:05.863227+0000","last_unstale":"2023-10-06T04:40:05.864079+0000","last_undegraded":"2023-10-06T04:40:05.864079+0000","last_fullsized":"2023-10-06T04:40:05.864079+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:39.890463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.874801+0000","last_change":"2023-10-06T04:40:06.870195+0000","last_active":"2023-10-06T04:40:06.874801+0000","last_peered":"2023-10-06T04:40:06.874801+0000","last_clean":"2023-10-06T04:40:06.874801+0000","last_became_active":"2023-10-06T04:40:06.869941+0000","last_became_peered":"2023-10-06T04:40:06.869941+0000","last_unstale":"2023-10-06T04:40:06.874801+0000","last_undegraded":"2023-10-06T04:40:06.874801+0000","last_fullsized":"2023-10-06T04:40:06.874801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:20.369172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.870260+0000","last_change":"2023-10-06T04:40:05.866340+0000","last_active":"2023-10-06T04:40:06.870260+0000","last_peered":"2023-10-06T04:40:06.870260+0000","last_clean":"2023-10-06T04:40:06.870260+0000","last_became_active":"2023-10-06T04:40:05.866040+0000","last_became_peered":"2023-10-06T04:40:05.866040+0000","last_unstale":"2023-10-06T04:40:06.870260+0000","last_undegraded":"2023-10-06T04:40:06.870260+0000","last_fullsized":"2023-10-06T04:40:06.870260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:00.240923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.878441+0000","last_change":"2023-10-06T04:40:06.872097+0000","last_active":"2023-10-06T04:40:06.878441+0000","last_peered":"2023-10-06T04:40:06.878441+0000","last_clean":"2023-10-06T04:40:06.878441+0000","last_became_active":"2023-10-06T04:40:06.871865+0000","last_became_peered":"2023-10-06T04:40:06.871865+0000","last_unstale":"2023-10-06T04:40:06.878441+0000","last_undegraded":"2023-10-06T04:40:06.878441+0000","last_fullsized":"2023-10-06T04:40:06.878441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:54.530170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:40:05.853863+0000","last_change":"2023-10-06T04:40:05.851556+0000","last_active":"2023-10-06T04:40:05.853863+0000","last_peered":"2023-10-06T04:40:05.853863+0000","last_clean":"2023-10-06T04:40:05.853863+0000","last_became_active":"2023-10-06T04:40:05.851331+0000","last_became_peered":"2023-10-06T04:40:05.851331+0000","last_unstale":"2023-10-06T04:40:05.853863+0000","last_undegraded":"2023-10-06T04:40:05.853863+0000","last_fullsized":"2023-10-06T04:40:05.853863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:20.597468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.869641+0000","last_change":"2023-10-06T04:40:06.864152+0000","last_active":"2023-10-06T04:40:06.869641+0000","last_peered":"2023-10-06T04:40:06.869641+0000","last_clean":"2023-10-06T04:40:06.869641+0000","last_became_active":"2023-10-06T04:40:06.863817+0000","last_became_peered":"2023-10-06T04:40:06.863817+0000","last_unstale":"2023-10-06T04:40:06.869641+0000","last_undegraded":"2023-10-06T04:40:06.869641+0000","last_fullsized":"2023-10-06T04:40:06.869641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:51.070387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.858225+0000","last_change":"2023-10-06T04:40:05.859203+0000","last_active":"2023-10-06T04:40:06.858225+0000","last_peered":"2023-10-06T04:40:06.858225+0000","last_clean":"2023-10-06T04:40:06.858225+0000","last_became_active":"2023-10-06T04:40:05.859008+0000","last_became_peered":"2023-10-06T04:40:05.859008+0000","last_unstale":"2023-10-06T04:40:06.858225+0000","last_undegraded":"2023-10-06T04:40:06.858225+0000","last_fullsized":"2023-10-06T04:40:06.858225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:18.273394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.857925+0000","last_change":"2023-10-06T04:39:16.067723+0000","last_active":"2023-10-06T04:40:06.857925+0000","last_peered":"2023-10-06T04:40:06.857925+0000","last_clean":"2023-10-06T04:40:06.857925+0000","last_became_active":"2023-10-06T04:39:16.067325+0000","last_became_peered":"2023-10-06T04:39:16.067325+0000","last_unstale":"2023-10-06T04:40:06.857925+0000","last_undegraded":"2023-10-06T04:40:06.857925+0000","last_fullsized":"2023-10-06T04:40:06.857925+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.886062+0000","last_change":"2023-10-06T04:40:06.881465+0000","last_active":"2023-10-06T04:40:06.886062+0000","last_peered":"2023-10-06T04:40:06.886062+0000","last_clean":"2023-10-06T04:40:06.886062+0000","last_became_active":"2023-10-06T04:40:06.881190+0000","last_became_peered":"2023-10-06T04:40:06.881190+0000","last_unstale":"2023-10-06T04:40:06.886062+0000","last_undegraded":"2023-10-06T04:40:06.886062+0000","last_fullsized":"2023-10-06T04:40:06.886062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:49.250693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.857665+0000","last_change":"2023-10-06T04:40:05.856368+0000","last_active":"2023-10-06T04:40:06.857665+0000","last_peered":"2023-10-06T04:40:06.857665+0000","last_clean":"2023-10-06T04:40:06.857665+0000","last_became_active":"2023-10-06T04:40:05.855993+0000","last_became_peered":"2023-10-06T04:40:05.855993+0000","last_unstale":"2023-10-06T04:40:06.857665+0000","last_undegraded":"2023-10-06T04:40:06.857665+0000","last_fullsized":"2023-10-06T04:40:06.857665+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:25.127988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.858118+0000","last_change":"2023-10-06T04:39:15.592391+0000","last_active":"2023-10-06T04:40:06.858118+0000","last_peered":"2023-10-06T04:40:06.858118+0000","last_clean":"2023-10-06T04:40:06.858118+0000","last_became_active":"2023-10-06T04:39:15.592094+0000","last_became_peered":"2023-10-06T04:39:15.592094+0000","last_unstale":"2023-10-06T04:40:06.858118+0000","last_undegraded":"2023-10-06T04:40:06.858118+0000","last_fullsized":"2023-10-06T04:40:06.858118+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.280766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.876681+0000","last_change":"2023-10-06T04:40:06.876681+0000","last_active":"2023-10-06T04:40:06.876681+0000","last_peered":"2023-10-06T04:40:06.876681+0000","last_clean":"2023-10-06T04:40:06.876681+0000","last_became_active":"2023-10-06T04:40:06.876451+0000","last_became_peered":"2023-10-06T04:40:06.876451+0000","last_unstale":"2023-10-06T04:40:06.876681+0000","last_undegraded":"2023-10-06T04:40:06.876681+0000","last_fullsized":"2023-10-06T04:40:06.876681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:52.411614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.886420+0000","last_change":"2023-10-06T04:40:05.854312+0000","last_active":"2023-10-06T04:40:06.886420+0000","last_peered":"2023-10-06T04:40:06.886420+0000","last_clean":"2023-10-06T04:40:06.886420+0000","last_became_active":"2023-10-06T04:40:05.853971+0000","last_became_peered":"2023-10-06T04:40:05.853971+0000","last_unstale":"2023-10-06T04:40:06.886420+0000","last_undegraded":"2023-10-06T04:40:06.886420+0000","last_fullsized":"2023-10-06T04:40:06.886420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:24.167181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:40:05.840860+0000","last_change":"2023-10-06T04:39:15.585112+0000","last_active":"2023-10-06T04:40:05.840860+0000","last_peered":"2023-10-06T04:40:05.840860+0000","last_clean":"2023-10-06T04:40:05.840860+0000","last_became_active":"2023-10-06T04:39:15.584853+0000","last_became_peered":"2023-10-06T04:39:15.584853+0000","last_unstale":"2023-10-06T04:40:05.840860+0000","last_undegraded":"2023-10-06T04:40:05.840860+0000","last_fullsized":"2023-10-06T04:40:05.840860+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":170,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.866237+0000","last_change":"2023-10-06T04:39:15.588017+0000","last_active":"2023-10-06T04:40:06.866237+0000","last_peered":"2023-10-06T04:40:06.866237+0000","last_clean":"2023-10-06T04:40:06.866237+0000","last_became_active":"2023-10-06T04:39:15.586771+0000","last_became_peered":"2023-10-06T04:39:15.586771+0000","last_unstale":"2023-10-06T04:40:06.866237+0000","last_undegraded":"2023-10-06T04:40:06.866237+0000","last_fullsized":"2023-10-06T04:40:06.866237+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:35.225282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.886208+0000","last_change":"2023-10-06T04:40:06.881581+0000","last_active":"2023-10-06T04:40:06.886208+0000","last_peered":"2023-10-06T04:40:06.886208+0000","last_clean":"2023-10-06T04:40:06.886208+0000","last_became_active":"2023-10-06T04:40:06.881244+0000","last_became_peered":"2023-10-06T04:40:06.881244+0000","last_unstale":"2023-10-06T04:40:06.886208+0000","last_undegraded":"2023-10-06T04:40:06.886208+0000","last_fullsized":"2023-10-06T04:40:06.886208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:46.681452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:40:05.860055+0000","last_change":"2023-10-06T04:40:05.858777+0000","last_active":"2023-10-06T04:40:05.860055+0000","last_peered":"2023-10-06T04:40:05.860055+0000","last_clean":"2023-10-06T04:40:05.860055+0000","last_became_active":"2023-10-06T04:40:05.858503+0000","last_became_peered":"2023-10-06T04:40:05.858503+0000","last_unstale":"2023-10-06T04:40:05.860055+0000","last_undegraded":"2023-10-06T04:40:05.860055+0000","last_fullsized":"2023-10-06T04:40:05.860055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:18.229019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.866673+0000","last_change":"2023-10-06T04:39:16.252521+0000","last_active":"2023-10-06T04:40:06.866673+0000","last_peered":"2023-10-06T04:40:06.866673+0000","last_clean":"2023-10-06T04:40:06.866673+0000","last_became_active":"2023-10-06T04:39:16.252245+0000","last_became_peered":"2023-10-06T04:39:16.252245+0000","last_unstale":"2023-10-06T04:40:06.866673+0000","last_undegraded":"2023-10-06T04:40:06.866673+0000","last_fullsized":"2023-10-06T04:40:06.866673+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:17.694713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.870526+0000","last_change":"2023-10-06T04:40:06.863249+0000","last_active":"2023-10-06T04:40:06.870526+0000","last_peered":"2023-10-06T04:40:06.870526+0000","last_clean":"2023-10-06T04:40:06.870526+0000","last_became_active":"2023-10-06T04:40:06.862789+0000","last_became_peered":"2023-10-06T04:40:06.862789+0000","last_unstale":"2023-10-06T04:40:06.870526+0000","last_undegraded":"2023-10-06T04:40:06.870526+0000","last_fullsized":"2023-10-06T04:40:06.870526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:19.277198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.867253+0000","last_change":"2023-10-06T04:40:05.866616+0000","last_active":"2023-10-06T04:40:06.867253+0000","last_peered":"2023-10-06T04:40:06.867253+0000","last_clean":"2023-10-06T04:40:06.867253+0000","last_became_active":"2023-10-06T04:40:05.866362+0000","last_became_peered":"2023-10-06T04:40:05.866362+0000","last_unstale":"2023-10-06T04:40:06.867253+0000","last_undegraded":"2023-10-06T04:40:06.867253+0000","last_fullsized":"2023-10-06T04:40:06.867253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:24.167181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.866152+0000","last_change":"2023-10-06T04:39:16.252493+0000","last_active":"2023-10-06T04:40:06.866152+0000","last_peered":"2023-10-06T04:40:06.866152+0000","last_clean":"2023-10-06T04:40:06.866152+0000","last_became_active":"2023-10-06T04:39:16.252190+0000","last_became_peered":"2023-10-06T04:39:16.252190+0000","last_unstale":"2023-10-06T04:40:06.866152+0000","last_undegraded":"2023-10-06T04:40:06.866152+0000","last_fullsized":"2023-10-06T04:40:06.866152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:59.554724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.872477+0000","last_change":"2023-10-06T04:40:06.866871+0000","last_active":"2023-10-06T04:40:06.872477+0000","last_peered":"2023-10-06T04:40:06.872477+0000","last_clean":"2023-10-06T04:40:06.872477+0000","last_became_active":"2023-10-06T04:40:06.866640+0000","last_became_peered":"2023-10-06T04:40:06.866640+0000","last_unstale":"2023-10-06T04:40:06.872477+0000","last_undegraded":"2023-10-06T04:40:06.872477+0000","last_fullsized":"2023-10-06T04:40:06.872477+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:06.708300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.861702+0000","last_change":"2023-10-06T04:40:05.853178+0000","last_active":"2023-10-06T04:40:06.861702+0000","last_peered":"2023-10-06T04:40:06.861702+0000","last_clean":"2023-10-06T04:40:06.861702+0000","last_became_active":"2023-10-06T04:40:05.852933+0000","last_became_peered":"2023-10-06T04:40:05.852933+0000","last_unstale":"2023-10-06T04:40:06.861702+0000","last_undegraded":"2023-10-06T04:40:06.861702+0000","last_fullsized":"2023-10-06T04:40:06.861702+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:24.167181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.856994+0000","last_change":"2023-10-06T04:39:16.252554+0000","last_active":"2023-10-06T04:40:06.856994+0000","last_peered":"2023-10-06T04:40:06.856994+0000","last_clean":"2023-10-06T04:40:06.856994+0000","last_became_active":"2023-10-06T04:39:16.252225+0000","last_became_peered":"2023-10-06T04:39:16.252225+0000","last_unstale":"2023-10-06T04:40:06.856994+0000","last_undegraded":"2023-10-06T04:40:06.856994+0000","last_fullsized":"2023-10-06T04:40:06.856994+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.280766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.865156+0000","last_change":"2023-10-06T04:40:06.865156+0000","last_active":"2023-10-06T04:40:06.865156+0000","last_peered":"2023-10-06T04:40:06.865156+0000","last_clean":"2023-10-06T04:40:06.865156+0000","last_became_active":"2023-10-06T04:40:06.864854+0000","last_became_peered":"2023-10-06T04:40:06.864854+0000","last_unstale":"2023-10-06T04:40:06.865156+0000","last_undegraded":"2023-10-06T04:40:06.865156+0000","last_fullsized":"2023-10-06T04:40:06.865156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:10.542364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.860357+0000","last_change":"2023-10-06T04:40:05.855471+0000","last_active":"2023-10-06T04:40:06.860357+0000","last_peered":"2023-10-06T04:40:06.860357+0000","last_clean":"2023-10-06T04:40:06.860357+0000","last_became_active":"2023-10-06T04:40:05.855193+0000","last_became_peered":"2023-10-06T04:40:05.855193+0000","last_unstale":"2023-10-06T04:40:06.860357+0000","last_undegraded":"2023-10-06T04:40:06.860357+0000","last_fullsized":"2023-10-06T04:40:06.860357+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:47.824018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.860233+0000","last_change":"2023-10-06T04:39:16.253021+0000","last_active":"2023-10-06T04:40:06.860233+0000","last_peered":"2023-10-06T04:40:06.860233+0000","last_clean":"2023-10-06T04:40:06.860233+0000","last_became_active":"2023-10-06T04:39:16.252478+0000","last_became_peered":"2023-10-06T04:39:16.252478+0000","last_unstale":"2023-10-06T04:40:06.860233+0000","last_undegraded":"2023-10-06T04:40:06.860233+0000","last_fullsized":"2023-10-06T04:40:06.860233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:07.439434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.875477+0000","last_change":"2023-10-06T04:40:06.869227+0000","last_active":"2023-10-06T04:40:06.875477+0000","last_peered":"2023-10-06T04:40:06.875477+0000","last_clean":"2023-10-06T04:40:06.875477+0000","last_became_active":"2023-10-06T04:40:06.868947+0000","last_became_peered":"2023-10-06T04:40:06.868947+0000","last_unstale":"2023-10-06T04:40:06.875477+0000","last_undegraded":"2023-10-06T04:40:06.875477+0000","last_fullsized":"2023-10-06T04:40:06.875477+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:04.605086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.863897+0000","last_change":"2023-10-06T04:40:05.853780+0000","last_active":"2023-10-06T04:40:06.863897+0000","last_peered":"2023-10-06T04:40:06.863897+0000","last_clean":"2023-10-06T04:40:06.863897+0000","last_became_active":"2023-10-06T04:40:05.853275+0000","last_became_peered":"2023-10-06T04:40:05.853275+0000","last_unstale":"2023-10-06T04:40:06.863897+0000","last_undegraded":"2023-10-06T04:40:06.863897+0000","last_fullsized":"2023-10-06T04:40:06.863897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:14.354716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.859465+0000","last_change":"2023-10-06T04:39:15.587681+0000","last_active":"2023-10-06T04:40:06.859465+0000","last_peered":"2023-10-06T04:40:06.859465+0000","last_clean":"2023-10-06T04:40:06.859465+0000","last_became_active":"2023-10-06T04:39:15.587313+0000","last_became_peered":"2023-10-06T04:39:15.587313+0000","last_unstale":"2023-10-06T04:40:06.859465+0000","last_undegraded":"2023-10-06T04:40:06.859465+0000","last_fullsized":"2023-10-06T04:40:06.859465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":946176,"data_stored":726468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297620,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074220,"statfs":{"total":96636764160,"available":96332001280,"internally_reserved":0,"allocated":339968,"data_stored":135048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298200,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073640,"statfs":{"total":96636764160,"available":96331407360,"internally_reserved":0,"allocated":933888,"data_stored":724952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297620,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074220,"statfs":{"total":96636764160,"available":96332001280,"internally_reserved":0,"allocated":339968,"data_stored":134528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297620,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074220,"statfs":{"total":96636764160,"available":96332001280,"internally_reserved":0,"allocated":339968,"data_stored":134564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297632,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074208,"statfs":{"total":96636764160,"available":96331988992,"internally_reserved":0,"allocated":352256,"data_stored":136064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074204,"statfs":{"total":96636764160,"available":96331984896,"internally_reserved":0,"allocated":356352,"data_stored":141711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297632,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074208,"statfs":{"total":96636764160,"available":96331988992,"internally_reserved":0,"allocated":352256,"data_stored":139894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:40:10.916 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:40:11.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.062+0000 7f305891a700 1 Processor -- start 2023-10-06T04:40:11.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.062+0000 7f305891a700 1 -- start start 2023-10-06T04:40:11.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.063+0000 7f305891a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f30540b11a0 0x7f30540d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.063+0000 7f305891a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f305406d3b0 0x7f30540b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.063+0000 7f305891a700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30540afed0 con 0x7f30540b3810 2023-10-06T04:40:11.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.063+0000 7f305891a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30540b1ab0 con 0x7f30540b11a0 2023-10-06T04:40:11.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.063+0000 7f305891a700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30540b6170 con 0x7f305406d3b0 2023-10-06T04:40:11.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.063+0000 7f30537fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f30540b11a0 0x7f30540d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.063+0000 7f30537fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f30540b11a0 0x7f30540d0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60476/0 (socket says 172.21.15.112:60476) 2023-10-06T04:40:11.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.063+0000 7f30537fe700 1 -- 172.21.15.112:0/3883218164 learned_addr learned my addr 172.21.15.112:0/3883218164 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:11.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.063+0000 7f304affd700 1 --2- 172.21.15.112:0/3883218164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f305406d3b0 0x7f30540b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.063+0000 7f30537fe700 1 -- 172.21.15.112:0/3883218164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f305406d3b0 msgr2=0x7f30540b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:11.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.063+0000 7f30537fe700 1 --2- 172.21.15.112:0/3883218164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f305406d3b0 0x7f30540b1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.063+0000 7f30537fe700 1 -- 172.21.15.112:0/3883218164 >> v1:172.21.15.179:6789/0 conn(0x7f30540b3810 legacy=0x7f30540b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:11.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.063+0000 7f30537fe700 1 -- 172.21.15.112:0/3883218164 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30540b6450 con 0x7f30540b11a0 2023-10-06T04:40:11.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.063+0000 7f304affd700 1 --2- 172.21.15.112:0/3883218164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f305406d3b0 0x7f30540b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:11.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.063+0000 7f30537fe700 1 --2- 172.21.15.112:0/3883218164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30540b11a0 0x7f30540d0250 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f30440099b0 tx=0x7f3044009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dfce6ea5547d11 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:11.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.064+0000 7f3052ffd700 1 -- 172.21.15.112:0/3883218164 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304400b820 con 0x7f30540b11a0 2023-10-06T04:40:11.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.064+0000 7f3052ffd700 1 -- 172.21.15.112:0/3883218164 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304400b980 con 0x7f30540b11a0 2023-10-06T04:40:11.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.064+0000 7f3052ffd700 1 -- 172.21.15.112:0/3883218164 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304400bd20 con 0x7f30540b11a0 2023-10-06T04:40:11.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.064+0000 7f305891a700 1 -- 172.21.15.112:0/3883218164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30540b11a0 msgr2=0x7f30540d0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.064+0000 7f305891a700 1 --2- 172.21.15.112:0/3883218164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30540b11a0 0x7f30540d0250 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f30440099b0 tx=0x7f3044009250 comp rx=0 tx=0).stop 2023-10-06T04:40:11.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.064+0000 7f305891a700 1 -- 172.21.15.112:0/3883218164 shutdown_connections 2023-10-06T04:40:11.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.064+0000 7f305891a700 1 --2- 172.21.15.112:0/3883218164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30540b11a0 0x7f30540d0250 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.064+0000 7f305891a700 1 --2- 172.21.15.112:0/3883218164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f305406d3b0 0x7f30540b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.064+0000 7f305891a700 1 -- 172.21.15.112:0/3883218164 >> 172.21.15.112:0/3883218164 conn(0x7f305406cfb0 msgr2=0x7f30540d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:11.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.064+0000 7f305891a700 1 -- 172.21.15.112:0/3883218164 shutdown_connections 2023-10-06T04:40:11.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.064+0000 7f305891a700 1 -- 172.21.15.112:0/3883218164 wait complete. 2023-10-06T04:40:11.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.065+0000 7f305891a700 1 Processor -- start 2023-10-06T04:40:11.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.065+0000 7f305891a700 1 -- start start 2023-10-06T04:40:11.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.066+0000 7f305891a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f305406d3b0 0x7f305415cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.066+0000 7f305891a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30540b11a0 0x7f30540cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.066+0000 7f305891a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30540b3810 0x7f30540cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.066+0000 7f305891a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30540c9db0 con 0x7f30540b3810 2023-10-06T04:40:11.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.066+0000 7f305891a700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30540ca050 con 0x7f30540b11a0 2023-10-06T04:40:11.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.066+0000 7f305891a700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30540c6ef0 con 0x7f305406d3b0 2023-10-06T04:40:11.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.066+0000 7f3053fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30540b3810 0x7f30540cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.066+0000 7f3053fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30540b3810 0x7f30540cdd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60484/0 (socket says 172.21.15.112:60484) 2023-10-06T04:40:11.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.066+0000 7f3053fff700 1 -- 172.21.15.112:0/1350220787 learned_addr learned my addr 172.21.15.112:0/1350220787 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:11.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.066+0000 7f30537fe700 1 --2- 172.21.15.112:0/1350220787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f305406d3b0 0x7f305415cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.066+0000 7f304affd700 1 --2- 172.21.15.112:0/1350220787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30540b11a0 0x7f30540cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.067+0000 7f3053fff700 1 -- 172.21.15.112:0/1350220787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f305406d3b0 msgr2=0x7f305415cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.067+0000 7f3053fff700 1 --2- 172.21.15.112:0/1350220787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f305406d3b0 0x7f305415cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.067+0000 7f3053fff700 1 -- 172.21.15.112:0/1350220787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30540b11a0 msgr2=0x7f30540cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.067+0000 7f3053fff700 1 --2- 172.21.15.112:0/1350220787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30540b11a0 0x7f30540cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.067+0000 7f3053fff700 1 -- 172.21.15.112:0/1350220787 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30440094f0 con 0x7f30540b3810 2023-10-06T04:40:11.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.067+0000 7f3053fff700 1 --2- 172.21.15.112:0/1350220787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30540b3810 0x7f30540cdd20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f304c00c960 tx=0x7f304c0026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:11.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.067+0000 7f304bfff700 1 -- 172.21.15.112:0/1350220787 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c012630 con 0x7f30540b3810 2023-10-06T04:40:11.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.067+0000 7f304bfff700 1 -- 172.21.15.112:0/1350220787 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c012790 con 0x7f30540b3810 2023-10-06T04:40:11.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.067+0000 7f304bfff700 1 -- 172.21.15.112:0/1350220787 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c012b50 con 0x7f30540b3810 2023-10-06T04:40:11.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.067+0000 7f305891a700 1 -- 172.21.15.112:0/1350220787 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30540c6650 con 0x7f30540b3810 2023-10-06T04:40:11.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.067+0000 7f305891a700 1 -- 172.21.15.112:0/1350220787 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30540c6c10 con 0x7f30540b3810 2023-10-06T04:40:11.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.068+0000 7f305891a700 1 -- 172.21.15.112:0/1350220787 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30540ca1e0 con 0x7f30540b3810 2023-10-06T04:40:11.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.068+0000 7f304bfff700 1 -- 172.21.15.112:0/1350220787 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f304c01b400 con 0x7f30540b3810 2023-10-06T04:40:11.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.069+0000 7f304bfff700 1 --2- 172.21.15.112:0/1350220787 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3034066f30 0x7f30340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.069+0000 7f304bfff700 1 -- 172.21.15.112:0/1350220787 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f304c084900 con 0x7f30540b3810 2023-10-06T04:40:11.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.069+0000 7f30537fe700 1 --2- 172.21.15.112:0/1350220787 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3034066f30 0x7f30340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.069+0000 7f30537fe700 1 --2- 172.21.15.112:0/1350220787 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3034066f30 0x7f30340693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f30440099b0 tx=0x7f3044016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:11.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.073+0000 7f304bfff700 1 -- 172.21.15.112:0/1350220787 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f304c0554a0 con 0x7f30540b3810 2023-10-06T04:40:11.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.251+0000 7f305891a700 1 -- 172.21.15.112:0/1350220787 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f305405f230 con 0x7f3034066f30 2023-10-06T04:40:11.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.259+0000 7f304bfff700 1 -- 172.21.15.112:0/1350220787 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286954 (secure 0 0 0) 0x7f305405f230 con 0x7f3034066f30 2023-10-06T04:40:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:11.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.262+0000 7f305891a700 1 -- 172.21.15.112:0/1350220787 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3034066f30 msgr2=0x7f30340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.262+0000 7f305891a700 1 --2- 172.21.15.112:0/1350220787 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3034066f30 0x7f30340693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f30440099b0 tx=0x7f3044016000 comp rx=0 tx=0).stop 2023-10-06T04:40:11.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.262+0000 7f305891a700 1 -- 172.21.15.112:0/1350220787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30540b3810 msgr2=0x7f30540cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.262+0000 7f305891a700 1 --2- 172.21.15.112:0/1350220787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30540b3810 0x7f30540cdd20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f304c00c960 tx=0x7f304c0026e0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.262+0000 7f305891a700 1 -- 172.21.15.112:0/1350220787 shutdown_connections 2023-10-06T04:40:11.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.262+0000 7f305891a700 1 --2- 172.21.15.112:0/1350220787 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f3034066f30 0x7f30340693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.262+0000 7f305891a700 1 --2- 172.21.15.112:0/1350220787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30540b3810 0x7f30540cdd20 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.262+0000 7f305891a700 1 --2- 172.21.15.112:0/1350220787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f305406d3b0 0x7f305415cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.262+0000 7f305891a700 1 --2- 172.21.15.112:0/1350220787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30540b11a0 0x7f30540cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.262+0000 7f305891a700 1 -- 172.21.15.112:0/1350220787 >> 172.21.15.112:0/1350220787 conn(0x7f305406cfb0 msgr2=0x7f305415edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:11.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.262+0000 7f305891a700 1 -- 172.21.15.112:0/1350220787 shutdown_connections 2023-10-06T04:40:11.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.262+0000 7f305891a700 1 -- 172.21.15.112:0/1350220787 wait complete. 2023-10-06T04:40:11.266 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-10-06T04:40:11.275 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-10-06T04:40:10.287861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":143,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382172,"kb_used_data":3868,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592548,"statfs":{"total":773094113280,"available":770654769152,"internally_reserved":0,"allocated":3960832,"data_stored":2273229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.449842"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.878419+0000","last_change":"2023-10-06T04:40:06.870934+0000","last_active":"2023-10-06T04:40:06.878419+0000","last_peered":"2023-10-06T04:40:06.878419+0000","last_clean":"2023-10-06T04:40:06.878419+0000","last_became_active":"2023-10-06T04:40:06.870720+0000","last_became_peered":"2023-10-06T04:40:06.870720+0000","last_unstale":"2023-10-06T04:40:06.878419+0000","last_undegraded":"2023-10-06T04:40:06.878419+0000","last_fullsized":"2023-10-06T04:40:06.878419+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:53:00.609185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.868012+0000","last_change":"2023-10-06T04:40:06.864940+0000","last_active":"2023-10-06T04:40:06.868012+0000","last_peered":"2023-10-06T04:40:06.868012+0000","last_clean":"2023-10-06T04:40:06.868012+0000","last_became_active":"2023-10-06T04:40:06.864693+0000","last_became_peered":"2023-10-06T04:40:06.864693+0000","last_unstale":"2023-10-06T04:40:06.868012+0000","last_undegraded":"2023-10-06T04:40:06.868012+0000","last_fullsized":"2023-10-06T04:40:06.868012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:19.692839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.881520+0000","last_change":"2023-10-06T04:40:06.876377+0000","last_active":"2023-10-06T04:40:06.881520+0000","last_peered":"2023-10-06T04:40:06.881520+0000","last_clean":"2023-10-06T04:40:06.881520+0000","last_became_active":"2023-10-06T04:40:06.876122+0000","last_became_peered":"2023-10-06T04:40:06.876122+0000","last_unstale":"2023-10-06T04:40:06.881520+0000","last_undegraded":"2023-10-06T04:40:06.881520+0000","last_fullsized":"2023-10-06T04:40:06.881520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:20.369172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.866399+0000","last_change":"2023-10-06T04:40:06.866399+0000","last_active":"2023-10-06T04:40:06.866399+0000","last_peered":"2023-10-06T04:40:06.866399+0000","last_clean":"2023-10-06T04:40:06.866399+0000","last_became_active":"2023-10-06T04:40:06.866140+0000","last_became_peered":"2023-10-06T04:40:06.866140+0000","last_unstale":"2023-10-06T04:40:06.866399+0000","last_undegraded":"2023-10-06T04:40:06.866399+0000","last_fullsized":"2023-10-06T04:40:06.866399+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:15.358520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.865767+0000","last_change":"2023-10-06T04:40:06.865767+0000","last_active":"2023-10-06T04:40:06.865767+0000","last_peered":"2023-10-06T04:40:06.865767+0000","last_clean":"2023-10-06T04:40:06.865767+0000","last_became_active":"2023-10-06T04:40:06.865564+0000","last_became_peered":"2023-10-06T04:40:06.865564+0000","last_unstale":"2023-10-06T04:40:06.865767+0000","last_undegraded":"2023-10-06T04:40:06.865767+0000","last_fullsized":"2023-10-06T04:40:06.865767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:01.244727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.866814+0000","last_change":"2023-10-06T04:40:06.866814+0000","last_active":"2023-10-06T04:40:06.866814+0000","last_peered":"2023-10-06T04:40:06.866814+0000","last_clean":"2023-10-06T04:40:06.866814+0000","last_became_active":"2023-10-06T04:40:06.866532+0000","last_became_peered":"2023-10-06T04:40:06.866532+0000","last_unstale":"2023-10-06T04:40:06.866814+0000","last_undegraded":"2023-10-06T04:40:06.866814+0000","last_fullsized":"2023-10-06T04:40:06.866814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:44.220138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.870987+0000","last_change":"2023-10-06T04:40:06.863042+0000","last_active":"2023-10-06T04:40:06.870987+0000","last_peered":"2023-10-06T04:40:06.870987+0000","last_clean":"2023-10-06T04:40:06.870987+0000","last_became_active":"2023-10-06T04:40:06.862737+0000","last_became_peered":"2023-10-06T04:40:06.862737+0000","last_unstale":"2023-10-06T04:40:06.870987+0000","last_undegraded":"2023-10-06T04:40:06.870987+0000","last_fullsized":"2023-10-06T04:40:06.870987+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:19.692839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.866170+0000","last_change":"2023-10-06T04:40:06.862642+0000","last_active":"2023-10-06T04:40:06.866170+0000","last_peered":"2023-10-06T04:40:06.866170+0000","last_clean":"2023-10-06T04:40:06.866170+0000","last_became_active":"2023-10-06T04:40:06.862387+0000","last_became_peered":"2023-10-06T04:40:06.862387+0000","last_unstale":"2023-10-06T04:40:06.866170+0000","last_undegraded":"2023-10-06T04:40:06.866170+0000","last_fullsized":"2023-10-06T04:40:06.866170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:49.088490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.881418+0000","last_change":"2023-10-06T04:40:06.874943+0000","last_active":"2023-10-06T04:40:06.881418+0000","last_peered":"2023-10-06T04:40:06.881418+0000","last_clean":"2023-10-06T04:40:06.881418+0000","last_became_active":"2023-10-06T04:40:06.874698+0000","last_became_peered":"2023-10-06T04:40:06.874698+0000","last_unstale":"2023-10-06T04:40:06.881418+0000","last_undegraded":"2023-10-06T04:40:06.881418+0000","last_fullsized":"2023-10-06T04:40:06.881418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:02.646310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.875237+0000","last_change":"2023-10-06T04:40:06.872068+0000","last_active":"2023-10-06T04:40:06.875237+0000","last_peered":"2023-10-06T04:40:06.875237+0000","last_clean":"2023-10-06T04:40:06.875237+0000","last_became_active":"2023-10-06T04:40:06.871793+0000","last_became_peered":"2023-10-06T04:40:06.871793+0000","last_unstale":"2023-10-06T04:40:06.875237+0000","last_undegraded":"2023-10-06T04:40:06.875237+0000","last_fullsized":"2023-10-06T04:40:06.875237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:13:56.406005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.876612+0000","last_change":"2023-10-06T04:40:06.874071+0000","last_active":"2023-10-06T04:40:06.876612+0000","last_peered":"2023-10-06T04:40:06.876612+0000","last_clean":"2023-10-06T04:40:06.876612+0000","last_became_active":"2023-10-06T04:40:06.873780+0000","last_became_peered":"2023-10-06T04:40:06.873780+0000","last_unstale":"2023-10-06T04:40:06.876612+0000","last_undegraded":"2023-10-06T04:40:06.876612+0000","last_fullsized":"2023-10-06T04:40:06.876612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:22.683312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.869684+0000","last_change":"2023-10-06T04:40:06.865585+0000","last_active":"2023-10-06T04:40:06.869684+0000","last_peered":"2023-10-06T04:40:06.869684+0000","last_clean":"2023-10-06T04:40:06.869684+0000","last_became_active":"2023-10-06T04:40:06.865325+0000","last_became_peered":"2023-10-06T04:40:06.865325+0000","last_unstale":"2023-10-06T04:40:06.869684+0000","last_undegraded":"2023-10-06T04:40:06.869684+0000","last_fullsized":"2023-10-06T04:40:06.869684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:44.220138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.878609+0000","last_change":"2023-10-06T04:40:06.875870+0000","last_active":"2023-10-06T04:40:06.878609+0000","last_peered":"2023-10-06T04:40:06.878609+0000","last_clean":"2023-10-06T04:40:06.878609+0000","last_became_active":"2023-10-06T04:40:06.875585+0000","last_became_peered":"2023-10-06T04:40:06.875585+0000","last_unstale":"2023-10-06T04:40:06.878609+0000","last_undegraded":"2023-10-06T04:40:06.878609+0000","last_fullsized":"2023-10-06T04:40:06.878609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:53:00.609185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.874746+0000","last_change":"2023-10-06T04:40:06.865219+0000","last_active":"2023-10-06T04:40:06.874746+0000","last_peered":"2023-10-06T04:40:06.874746+0000","last_clean":"2023-10-06T04:40:06.874746+0000","last_became_active":"2023-10-06T04:40:06.864961+0000","last_became_peered":"2023-10-06T04:40:06.864961+0000","last_unstale":"2023-10-06T04:40:06.874746+0000","last_undegraded":"2023-10-06T04:40:06.874746+0000","last_fullsized":"2023-10-06T04:40:06.874746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:56.016725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.874658+0000","last_change":"2023-10-06T04:40:06.866274+0000","last_active":"2023-10-06T04:40:06.874658+0000","last_peered":"2023-10-06T04:40:06.874658+0000","last_clean":"2023-10-06T04:40:06.874658+0000","last_became_active":"2023-10-06T04:40:06.865967+0000","last_became_peered":"2023-10-06T04:40:06.865967+0000","last_unstale":"2023-10-06T04:40:06.874658+0000","last_undegraded":"2023-10-06T04:40:06.874658+0000","last_fullsized":"2023-10-06T04:40:06.874658+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:42.727412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.885810+0000","last_change":"2023-10-06T04:40:06.880456+0000","last_active":"2023-10-06T04:40:06.885810+0000","last_peered":"2023-10-06T04:40:06.885810+0000","last_clean":"2023-10-06T04:40:06.885810+0000","last_became_active":"2023-10-06T04:40:06.879721+0000","last_became_peered":"2023-10-06T04:40:06.879721+0000","last_unstale":"2023-10-06T04:40:06.885810+0000","last_undegraded":"2023-10-06T04:40:06.885810+0000","last_fullsized":"2023-10-06T04:40:06.885810+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:02.646310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.881901+0000","last_change":"2023-10-06T04:40:06.875681+0000","last_active":"2023-10-06T04:40:06.881901+0000","last_peered":"2023-10-06T04:40:06.881901+0000","last_clean":"2023-10-06T04:40:06.881901+0000","last_became_active":"2023-10-06T04:40:06.875424+0000","last_became_peered":"2023-10-06T04:40:06.875424+0000","last_unstale":"2023-10-06T04:40:06.881901+0000","last_undegraded":"2023-10-06T04:40:06.881901+0000","last_fullsized":"2023-10-06T04:40:06.881901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:52.078615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.880208+0000","last_change":"2023-10-06T04:40:06.869287+0000","last_active":"2023-10-06T04:40:06.880208+0000","last_peered":"2023-10-06T04:40:06.880208+0000","last_clean":"2023-10-06T04:40:06.880208+0000","last_became_active":"2023-10-06T04:40:06.868662+0000","last_became_peered":"2023-10-06T04:40:06.868662+0000","last_unstale":"2023-10-06T04:40:06.880208+0000","last_undegraded":"2023-10-06T04:40:06.880208+0000","last_fullsized":"2023-10-06T04:40:06.880208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:35.274464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.867715+0000","last_change":"2023-10-06T04:40:06.867715+0000","last_active":"2023-10-06T04:40:06.867715+0000","last_peered":"2023-10-06T04:40:06.867715+0000","last_clean":"2023-10-06T04:40:06.867715+0000","last_became_active":"2023-10-06T04:40:06.867473+0000","last_became_peered":"2023-10-06T04:40:06.867473+0000","last_unstale":"2023-10-06T04:40:06.867715+0000","last_undegraded":"2023-10-06T04:40:06.867715+0000","last_fullsized":"2023-10-06T04:40:06.867715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:02.377403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.878666+0000","last_change":"2023-10-06T04:40:06.868658+0000","last_active":"2023-10-06T04:40:06.878666+0000","last_peered":"2023-10-06T04:40:06.878666+0000","last_clean":"2023-10-06T04:40:06.878666+0000","last_became_active":"2023-10-06T04:40:06.868346+0000","last_became_peered":"2023-10-06T04:40:06.868346+0000","last_unstale":"2023-10-06T04:40:06.878666+0000","last_undegraded":"2023-10-06T04:40:06.878666+0000","last_fullsized":"2023-10-06T04:40:06.878666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:19.187693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.875209+0000","last_change":"2023-10-06T04:40:06.871479+0000","last_active":"2023-10-06T04:40:06.875209+0000","last_peered":"2023-10-06T04:40:06.875209+0000","last_clean":"2023-10-06T04:40:06.875209+0000","last_became_active":"2023-10-06T04:40:06.871188+0000","last_became_peered":"2023-10-06T04:40:06.871188+0000","last_unstale":"2023-10-06T04:40:06.875209+0000","last_undegraded":"2023-10-06T04:40:06.875209+0000","last_fullsized":"2023-10-06T04:40:06.875209+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:46.681452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.874769+0000","last_change":"2023-10-06T04:40:06.866463+0000","last_active":"2023-10-06T04:40:06.874769+0000","last_peered":"2023-10-06T04:40:06.874769+0000","last_clean":"2023-10-06T04:40:06.874769+0000","last_became_active":"2023-10-06T04:40:06.866212+0000","last_became_peered":"2023-10-06T04:40:06.866212+0000","last_unstale":"2023-10-06T04:40:06.874769+0000","last_undegraded":"2023-10-06T04:40:06.874769+0000","last_fullsized":"2023-10-06T04:40:06.874769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:06.708300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.888080+0000","last_change":"2023-10-06T04:40:06.885137+0000","last_active":"2023-10-06T04:40:06.888080+0000","last_peered":"2023-10-06T04:40:06.888080+0000","last_clean":"2023-10-06T04:40:06.888080+0000","last_became_active":"2023-10-06T04:40:06.884875+0000","last_became_peered":"2023-10-06T04:40:06.884875+0000","last_unstale":"2023-10-06T04:40:06.888080+0000","last_undegraded":"2023-10-06T04:40:06.888080+0000","last_fullsized":"2023-10-06T04:40:06.888080+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:19.277198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.876067+0000","last_change":"2023-10-06T04:40:06.876067+0000","last_active":"2023-10-06T04:40:06.876067+0000","last_peered":"2023-10-06T04:40:06.876067+0000","last_clean":"2023-10-06T04:40:06.876067+0000","last_became_active":"2023-10-06T04:40:06.875811+0000","last_became_peered":"2023-10-06T04:40:06.875811+0000","last_unstale":"2023-10-06T04:40:06.876067+0000","last_undegraded":"2023-10-06T04:40:06.876067+0000","last_fullsized":"2023-10-06T04:40:06.876067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:23.456976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.881069+0000","last_change":"2023-10-06T04:40:06.869594+0000","last_active":"2023-10-06T04:40:06.881069+0000","last_peered":"2023-10-06T04:40:06.881069+0000","last_clean":"2023-10-06T04:40:06.881069+0000","last_became_active":"2023-10-06T04:40:06.869339+0000","last_became_peered":"2023-10-06T04:40:06.869339+0000","last_unstale":"2023-10-06T04:40:06.881069+0000","last_undegraded":"2023-10-06T04:40:06.881069+0000","last_fullsized":"2023-10-06T04:40:06.881069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:25.170985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.868269+0000","last_change":"2023-10-06T04:40:06.868269+0000","last_active":"2023-10-06T04:40:06.868269+0000","last_peered":"2023-10-06T04:40:06.868269+0000","last_clean":"2023-10-06T04:40:06.868269+0000","last_became_active":"2023-10-06T04:40:06.868029+0000","last_became_peered":"2023-10-06T04:40:06.868029+0000","last_unstale":"2023-10-06T04:40:06.868269+0000","last_undegraded":"2023-10-06T04:40:06.868269+0000","last_fullsized":"2023-10-06T04:40:06.868269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:45.633745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.869042+0000","last_change":"2023-10-06T04:40:06.864742+0000","last_active":"2023-10-06T04:40:06.869042+0000","last_peered":"2023-10-06T04:40:06.869042+0000","last_clean":"2023-10-06T04:40:06.869042+0000","last_became_active":"2023-10-06T04:40:06.864513+0000","last_became_peered":"2023-10-06T04:40:06.864513+0000","last_unstale":"2023-10-06T04:40:06.869042+0000","last_undegraded":"2023-10-06T04:40:06.869042+0000","last_fullsized":"2023-10-06T04:40:06.869042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:15.358520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.874651+0000","last_change":"2023-10-06T04:40:06.866303+0000","last_active":"2023-10-06T04:40:06.874651+0000","last_peered":"2023-10-06T04:40:06.874651+0000","last_clean":"2023-10-06T04:40:06.874651+0000","last_became_active":"2023-10-06T04:40:06.863321+0000","last_became_peered":"2023-10-06T04:40:06.863321+0000","last_unstale":"2023-10-06T04:40:06.874651+0000","last_undegraded":"2023-10-06T04:40:06.874651+0000","last_fullsized":"2023-10-06T04:40:06.874651+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:49.250693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.880317+0000","last_change":"2023-10-06T04:40:06.870886+0000","last_active":"2023-10-06T04:40:06.880317+0000","last_peered":"2023-10-06T04:40:06.880317+0000","last_clean":"2023-10-06T04:40:06.880317+0000","last_became_active":"2023-10-06T04:40:06.868975+0000","last_became_peered":"2023-10-06T04:40:06.868975+0000","last_unstale":"2023-10-06T04:40:06.880317+0000","last_undegraded":"2023-10-06T04:40:06.880317+0000","last_fullsized":"2023-10-06T04:40:06.880317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:02.377403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.878599+0000","last_change":"2023-10-06T04:40:06.868321+0000","last_active":"2023-10-06T04:40:06.878599+0000","last_peered":"2023-10-06T04:40:06.878599+0000","last_clean":"2023-10-06T04:40:06.878599+0000","last_became_active":"2023-10-06T04:40:06.868022+0000","last_became_peered":"2023-10-06T04:40:06.868022+0000","last_unstale":"2023-10-06T04:40:06.878599+0000","last_undegraded":"2023-10-06T04:40:06.878599+0000","last_fullsized":"2023-10-06T04:40:06.878599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:02.998120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.885796+0000","last_change":"2023-10-06T04:40:06.880188+0000","last_active":"2023-10-06T04:40:06.885796+0000","last_peered":"2023-10-06T04:40:06.885796+0000","last_clean":"2023-10-06T04:40:06.885796+0000","last_became_active":"2023-10-06T04:40:06.879920+0000","last_became_peered":"2023-10-06T04:40:06.879920+0000","last_unstale":"2023-10-06T04:40:06.885796+0000","last_undegraded":"2023-10-06T04:40:06.885796+0000","last_fullsized":"2023-10-06T04:40:06.885796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:36.702203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.864831+0000","last_change":"2023-10-06T04:40:06.864831+0000","last_active":"2023-10-06T04:40:06.864831+0000","last_peered":"2023-10-06T04:40:06.864831+0000","last_clean":"2023-10-06T04:40:06.864831+0000","last_became_active":"2023-10-06T04:40:06.864576+0000","last_became_peered":"2023-10-06T04:40:06.864576+0000","last_unstale":"2023-10-06T04:40:06.864831+0000","last_undegraded":"2023-10-06T04:40:06.864831+0000","last_fullsized":"2023-10-06T04:40:06.864831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:42.172829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.882132+0000","last_change":"2023-10-06T04:40:06.875968+0000","last_active":"2023-10-06T04:40:06.882132+0000","last_peered":"2023-10-06T04:40:06.882132+0000","last_clean":"2023-10-06T04:40:06.882132+0000","last_became_active":"2023-10-06T04:40:06.875430+0000","last_became_peered":"2023-10-06T04:40:06.875430+0000","last_unstale":"2023-10-06T04:40:06.882132+0000","last_undegraded":"2023-10-06T04:40:06.882132+0000","last_fullsized":"2023-10-06T04:40:06.882132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:44.220138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"30'4","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.886267+0000","last_change":"2023-10-06T04:40:05.861695+0000","last_active":"2023-10-06T04:40:06.886267+0000","last_peered":"2023-10-06T04:40:06.886267+0000","last_clean":"2023-10-06T04:40:06.886267+0000","last_became_active":"2023-10-06T04:40:05.861455+0000","last_became_peered":"2023-10-06T04:40:05.861455+0000","last_unstale":"2023-10-06T04:40:06.886267+0000","last_undegraded":"2023-10-06T04:40:06.886267+0000","last_fullsized":"2023-10-06T04:40:06.886267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:48.868504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.876654+0000","last_change":"2023-10-06T04:40:06.876654+0000","last_active":"2023-10-06T04:40:06.876654+0000","last_peered":"2023-10-06T04:40:06.876654+0000","last_clean":"2023-10-06T04:40:06.876654+0000","last_became_active":"2023-10-06T04:40:06.876329+0000","last_became_peered":"2023-10-06T04:40:06.876329+0000","last_unstale":"2023-10-06T04:40:06.876654+0000","last_undegraded":"2023-10-06T04:40:06.876654+0000","last_fullsized":"2023-10-06T04:40:06.876654+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:55.510291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.882180+0000","last_change":"2023-10-06T04:40:05.865948+0000","last_active":"2023-10-06T04:40:06.882180+0000","last_peered":"2023-10-06T04:40:06.882180+0000","last_clean":"2023-10-06T04:40:06.882180+0000","last_became_active":"2023-10-06T04:40:05.865652+0000","last_became_peered":"2023-10-06T04:40:05.865652+0000","last_unstale":"2023-10-06T04:40:06.882180+0000","last_undegraded":"2023-10-06T04:40:06.882180+0000","last_fullsized":"2023-10-06T04:40:06.882180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:01.994316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.872646+0000","last_change":"2023-10-06T04:40:06.865028+0000","last_active":"2023-10-06T04:40:06.872646+0000","last_peered":"2023-10-06T04:40:06.872646+0000","last_clean":"2023-10-06T04:40:06.872646+0000","last_became_active":"2023-10-06T04:40:06.864706+0000","last_became_peered":"2023-10-06T04:40:06.864706+0000","last_unstale":"2023-10-06T04:40:06.872646+0000","last_undegraded":"2023-10-06T04:40:06.872646+0000","last_fullsized":"2023-10-06T04:40:06.872646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:15.350503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.885860+0000","last_change":"2023-10-06T04:40:05.861055+0000","last_active":"2023-10-06T04:40:06.885860+0000","last_peered":"2023-10-06T04:40:06.885860+0000","last_clean":"2023-10-06T04:40:06.885860+0000","last_became_active":"2023-10-06T04:40:05.860793+0000","last_became_peered":"2023-10-06T04:40:05.860793+0000","last_unstale":"2023-10-06T04:40:06.885860+0000","last_undegraded":"2023-10-06T04:40:06.885860+0000","last_fullsized":"2023-10-06T04:40:06.885860+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:00.240923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.870481+0000","last_change":"2023-10-06T04:40:06.863450+0000","last_active":"2023-10-06T04:40:06.870481+0000","last_peered":"2023-10-06T04:40:06.870481+0000","last_clean":"2023-10-06T04:40:06.870481+0000","last_became_active":"2023-10-06T04:40:06.863185+0000","last_became_peered":"2023-10-06T04:40:06.863185+0000","last_unstale":"2023-10-06T04:40:06.870481+0000","last_undegraded":"2023-10-06T04:40:06.870481+0000","last_fullsized":"2023-10-06T04:40:06.870481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:13:56.406005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.886536+0000","last_change":"2023-10-06T04:40:05.859684+0000","last_active":"2023-10-06T04:40:06.886536+0000","last_peered":"2023-10-06T04:40:06.886536+0000","last_clean":"2023-10-06T04:40:06.886536+0000","last_became_active":"2023-10-06T04:40:05.859434+0000","last_became_peered":"2023-10-06T04:40:05.859434+0000","last_unstale":"2023-10-06T04:40:06.886536+0000","last_undegraded":"2023-10-06T04:40:06.886536+0000","last_fullsized":"2023-10-06T04:40:06.886536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:48.246890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.875308+0000","last_change":"2023-10-06T04:40:06.867484+0000","last_active":"2023-10-06T04:40:06.875308+0000","last_peered":"2023-10-06T04:40:06.875308+0000","last_clean":"2023-10-06T04:40:06.875308+0000","last_became_active":"2023-10-06T04:40:06.867218+0000","last_became_peered":"2023-10-06T04:40:06.867218+0000","last_unstale":"2023-10-06T04:40:06.875308+0000","last_undegraded":"2023-10-06T04:40:06.875308+0000","last_fullsized":"2023-10-06T04:40:06.875308+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:19.277198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.883520+0000","last_change":"2023-10-06T04:40:05.858212+0000","last_active":"2023-10-06T04:40:06.883520+0000","last_peered":"2023-10-06T04:40:06.883520+0000","last_clean":"2023-10-06T04:40:06.883520+0000","last_became_active":"2023-10-06T04:40:05.857939+0000","last_became_peered":"2023-10-06T04:40:05.857939+0000","last_unstale":"2023-10-06T04:40:06.883520+0000","last_undegraded":"2023-10-06T04:40:06.883520+0000","last_fullsized":"2023-10-06T04:40:06.883520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:01.994316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.876146+0000","last_change":"2023-10-06T04:40:06.872916+0000","last_active":"2023-10-06T04:40:06.876146+0000","last_peered":"2023-10-06T04:40:06.876146+0000","last_clean":"2023-10-06T04:40:06.876146+0000","last_became_active":"2023-10-06T04:40:06.872649+0000","last_became_peered":"2023-10-06T04:40:06.872649+0000","last_unstale":"2023-10-06T04:40:06.876146+0000","last_undegraded":"2023-10-06T04:40:06.876146+0000","last_fullsized":"2023-10-06T04:40:06.876146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:52.078615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.882954+0000","last_change":"2023-10-06T04:40:05.866276+0000","last_active":"2023-10-06T04:40:06.882954+0000","last_peered":"2023-10-06T04:40:06.882954+0000","last_clean":"2023-10-06T04:40:06.882954+0000","last_became_active":"2023-10-06T04:40:05.865981+0000","last_became_peered":"2023-10-06T04:40:05.865981+0000","last_unstale":"2023-10-06T04:40:06.882954+0000","last_undegraded":"2023-10-06T04:40:06.882954+0000","last_fullsized":"2023-10-06T04:40:06.882954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:01.373599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.869663+0000","last_change":"2023-10-06T04:40:06.864710+0000","last_active":"2023-10-06T04:40:06.869663+0000","last_peered":"2023-10-06T04:40:06.869663+0000","last_clean":"2023-10-06T04:40:06.869663+0000","last_became_active":"2023-10-06T04:40:06.864391+0000","last_became_peered":"2023-10-06T04:40:06.864391+0000","last_unstale":"2023-10-06T04:40:06.869663+0000","last_undegraded":"2023-10-06T04:40:06.869663+0000","last_fullsized":"2023-10-06T04:40:06.869663+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:16.229613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:40:05.856560+0000","last_change":"2023-10-06T04:40:05.855152+0000","last_active":"2023-10-06T04:40:05.856560+0000","last_peered":"2023-10-06T04:40:05.856560+0000","last_clean":"2023-10-06T04:40:05.856560+0000","last_became_active":"2023-10-06T04:40:05.854927+0000","last_became_peered":"2023-10-06T04:40:05.854927+0000","last_unstale":"2023-10-06T04:40:05.856560+0000","last_undegraded":"2023-10-06T04:40:05.856560+0000","last_fullsized":"2023-10-06T04:40:05.856560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:22.453172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.880463+0000","last_change":"2023-10-06T04:40:06.873247+0000","last_active":"2023-10-06T04:40:06.880463+0000","last_peered":"2023-10-06T04:40:06.880463+0000","last_clean":"2023-10-06T04:40:06.880463+0000","last_became_active":"2023-10-06T04:40:06.872939+0000","last_became_peered":"2023-10-06T04:40:06.872939+0000","last_unstale":"2023-10-06T04:40:06.880463+0000","last_undegraded":"2023-10-06T04:40:06.880463+0000","last_fullsized":"2023-10-06T04:40:06.880463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:56.016725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.858867+0000","last_change":"2023-10-06T04:40:05.858713+0000","last_active":"2023-10-06T04:40:06.858867+0000","last_peered":"2023-10-06T04:40:06.858867+0000","last_clean":"2023-10-06T04:40:06.858867+0000","last_became_active":"2023-10-06T04:40:05.858420+0000","last_became_peered":"2023-10-06T04:40:05.858420+0000","last_unstale":"2023-10-06T04:40:06.858867+0000","last_undegraded":"2023-10-06T04:40:06.858867+0000","last_fullsized":"2023-10-06T04:40:06.858867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:41.169025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.866234+0000","last_change":"2023-10-06T04:40:06.866234+0000","last_active":"2023-10-06T04:40:06.866234+0000","last_peered":"2023-10-06T04:40:06.866234+0000","last_clean":"2023-10-06T04:40:06.866234+0000","last_became_active":"2023-10-06T04:40:06.865816+0000","last_became_peered":"2023-10-06T04:40:06.865816+0000","last_unstale":"2023-10-06T04:40:06.866234+0000","last_undegraded":"2023-10-06T04:40:06.866234+0000","last_fullsized":"2023-10-06T04:40:06.866234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:25.170985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.859909+0000","last_change":"2023-10-06T04:40:05.856512+0000","last_active":"2023-10-06T04:40:06.859909+0000","last_peered":"2023-10-06T04:40:06.859909+0000","last_clean":"2023-10-06T04:40:06.859909+0000","last_became_active":"2023-10-06T04:40:05.856249+0000","last_became_peered":"2023-10-06T04:40:05.856249+0000","last_unstale":"2023-10-06T04:40:06.859909+0000","last_undegraded":"2023-10-06T04:40:06.859909+0000","last_fullsized":"2023-10-06T04:40:06.859909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:36.253677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.886187+0000","last_change":"2023-10-06T04:40:06.881431+0000","last_active":"2023-10-06T04:40:06.886187+0000","last_peered":"2023-10-06T04:40:06.886187+0000","last_clean":"2023-10-06T04:40:06.886187+0000","last_became_active":"2023-10-06T04:40:06.881158+0000","last_became_peered":"2023-10-06T04:40:06.881158+0000","last_unstale":"2023-10-06T04:40:06.886187+0000","last_undegraded":"2023-10-06T04:40:06.886187+0000","last_fullsized":"2023-10-06T04:40:06.886187+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:42.727412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.856774+0000","last_change":"2023-10-06T04:40:05.856563+0000","last_active":"2023-10-06T04:40:06.856774+0000","last_peered":"2023-10-06T04:40:06.856774+0000","last_clean":"2023-10-06T04:40:06.856774+0000","last_became_active":"2023-10-06T04:40:05.856077+0000","last_became_peered":"2023-10-06T04:40:05.856077+0000","last_unstale":"2023-10-06T04:40:06.856774+0000","last_undegraded":"2023-10-06T04:40:06.856774+0000","last_fullsized":"2023-10-06T04:40:06.856774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:14.354716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.877707+0000","last_change":"2023-10-06T04:40:06.869406+0000","last_active":"2023-10-06T04:40:06.877707+0000","last_peered":"2023-10-06T04:40:06.877707+0000","last_clean":"2023-10-06T04:40:06.877707+0000","last_became_active":"2023-10-06T04:40:06.869165+0000","last_became_peered":"2023-10-06T04:40:06.869165+0000","last_unstale":"2023-10-06T04:40:06.877707+0000","last_undegraded":"2023-10-06T04:40:06.877707+0000","last_fullsized":"2023-10-06T04:40:06.877707+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:52.078615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"30'3","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.886446+0000","last_change":"2023-10-06T04:40:05.857734+0000","last_active":"2023-10-06T04:40:06.886446+0000","last_peered":"2023-10-06T04:40:06.886446+0000","last_clean":"2023-10-06T04:40:06.886446+0000","last_became_active":"2023-10-06T04:40:05.857451+0000","last_became_peered":"2023-10-06T04:40:05.857451+0000","last_unstale":"2023-10-06T04:40:06.886446+0000","last_undegraded":"2023-10-06T04:40:06.886446+0000","last_fullsized":"2023-10-06T04:40:06.886446+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:00.240923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.872656+0000","last_change":"2023-10-06T04:40:06.869180+0000","last_active":"2023-10-06T04:40:06.872656+0000","last_peered":"2023-10-06T04:40:06.872656+0000","last_clean":"2023-10-06T04:40:06.872656+0000","last_became_active":"2023-10-06T04:40:06.868913+0000","last_became_peered":"2023-10-06T04:40:06.868913+0000","last_unstale":"2023-10-06T04:40:06.872656+0000","last_undegraded":"2023-10-06T04:40:06.872656+0000","last_fullsized":"2023-10-06T04:40:06.872656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:42.727412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"30'6","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.890977+0000","last_change":"2023-10-06T04:40:05.861003+0000","last_active":"2023-10-06T04:40:06.890977+0000","last_peered":"2023-10-06T04:40:06.890977+0000","last_clean":"2023-10-06T04:40:06.890977+0000","last_became_active":"2023-10-06T04:40:05.860757+0000","last_became_peered":"2023-10-06T04:40:05.860757+0000","last_unstale":"2023-10-06T04:40:06.890977+0000","last_undegraded":"2023-10-06T04:40:06.890977+0000","last_fullsized":"2023-10-06T04:40:06.890977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:44.629941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.881530+0000","last_change":"2023-10-06T04:40:06.876429+0000","last_active":"2023-10-06T04:40:06.881530+0000","last_peered":"2023-10-06T04:40:06.881530+0000","last_clean":"2023-10-06T04:40:06.881530+0000","last_became_active":"2023-10-06T04:40:06.876171+0000","last_became_peered":"2023-10-06T04:40:06.876171+0000","last_unstale":"2023-10-06T04:40:06.881530+0000","last_undegraded":"2023-10-06T04:40:06.881530+0000","last_fullsized":"2023-10-06T04:40:06.881530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:49.250693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.883457+0000","last_change":"2023-10-06T04:40:05.855090+0000","last_active":"2023-10-06T04:40:06.883457+0000","last_peered":"2023-10-06T04:40:06.883457+0000","last_clean":"2023-10-06T04:40:06.883457+0000","last_became_active":"2023-10-06T04:40:05.854841+0000","last_became_peered":"2023-10-06T04:40:05.854841+0000","last_unstale":"2023-10-06T04:40:06.883457+0000","last_undegraded":"2023-10-06T04:40:06.883457+0000","last_fullsized":"2023-10-06T04:40:06.883457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:09.538560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.878194+0000","last_change":"2023-10-06T04:40:06.868206+0000","last_active":"2023-10-06T04:40:06.878194+0000","last_peered":"2023-10-06T04:40:06.878194+0000","last_clean":"2023-10-06T04:40:06.878194+0000","last_became_active":"2023-10-06T04:40:06.867661+0000","last_became_peered":"2023-10-06T04:40:06.867661+0000","last_unstale":"2023-10-06T04:40:06.878194+0000","last_undegraded":"2023-10-06T04:40:06.878194+0000","last_fullsized":"2023-10-06T04:40:06.878194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:20.369172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:40:05.856520+0000","last_change":"2023-10-06T04:40:05.855140+0000","last_active":"2023-10-06T04:40:05.856520+0000","last_peered":"2023-10-06T04:40:05.856520+0000","last_clean":"2023-10-06T04:40:05.856520+0000","last_became_active":"2023-10-06T04:40:05.854885+0000","last_became_peered":"2023-10-06T04:40:05.854885+0000","last_unstale":"2023-10-06T04:40:05.856520+0000","last_undegraded":"2023-10-06T04:40:05.856520+0000","last_fullsized":"2023-10-06T04:40:05.856520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:01.373599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.885769+0000","last_change":"2023-10-06T04:40:06.880369+0000","last_active":"2023-10-06T04:40:06.885769+0000","last_peered":"2023-10-06T04:40:06.885769+0000","last_clean":"2023-10-06T04:40:06.885769+0000","last_became_active":"2023-10-06T04:40:06.879779+0000","last_became_peered":"2023-10-06T04:40:06.879779+0000","last_unstale":"2023-10-06T04:40:06.885769+0000","last_undegraded":"2023-10-06T04:40:06.885769+0000","last_fullsized":"2023-10-06T04:40:06.885769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:20.369172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.859032+0000","last_change":"2023-10-06T04:40:05.861999+0000","last_active":"2023-10-06T04:40:06.859032+0000","last_peered":"2023-10-06T04:40:06.859032+0000","last_clean":"2023-10-06T04:40:06.859032+0000","last_became_active":"2023-10-06T04:40:05.861411+0000","last_became_peered":"2023-10-06T04:40:05.861411+0000","last_unstale":"2023-10-06T04:40:06.859032+0000","last_undegraded":"2023-10-06T04:40:06.859032+0000","last_fullsized":"2023-10-06T04:40:06.859032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:55.482179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.878034+0000","last_change":"2023-10-06T04:40:06.867563+0000","last_active":"2023-10-06T04:40:06.878034+0000","last_peered":"2023-10-06T04:40:06.878034+0000","last_clean":"2023-10-06T04:40:06.878034+0000","last_became_active":"2023-10-06T04:40:06.867335+0000","last_became_peered":"2023-10-06T04:40:06.867335+0000","last_unstale":"2023-10-06T04:40:06.878034+0000","last_undegraded":"2023-10-06T04:40:06.878034+0000","last_fullsized":"2023-10-06T04:40:06.878034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:22.683312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'8","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.888476+0000","last_change":"2023-10-06T04:40:05.866198+0000","last_active":"2023-10-06T04:40:06.888476+0000","last_peered":"2023-10-06T04:40:06.888476+0000","last_clean":"2023-10-06T04:40:06.888476+0000","last_became_active":"2023-10-06T04:40:05.865907+0000","last_became_peered":"2023-10-06T04:40:05.865907+0000","last_unstale":"2023-10-06T04:40:06.888476+0000","last_undegraded":"2023-10-06T04:40:06.888476+0000","last_fullsized":"2023-10-06T04:40:06.888476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:22.453172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.868686+0000","last_change":"2023-10-06T04:40:06.863286+0000","last_active":"2023-10-06T04:40:06.868686+0000","last_peered":"2023-10-06T04:40:06.868686+0000","last_clean":"2023-10-06T04:40:06.868686+0000","last_became_active":"2023-10-06T04:40:06.863032+0000","last_became_peered":"2023-10-06T04:40:06.863032+0000","last_unstale":"2023-10-06T04:40:06.868686+0000","last_undegraded":"2023-10-06T04:40:06.868686+0000","last_fullsized":"2023-10-06T04:40:06.868686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:42.727412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.885566+0000","last_change":"2023-10-06T04:40:05.863067+0000","last_active":"2023-10-06T04:40:06.885566+0000","last_peered":"2023-10-06T04:40:06.885566+0000","last_clean":"2023-10-06T04:40:06.885566+0000","last_became_active":"2023-10-06T04:40:05.862789+0000","last_became_peered":"2023-10-06T04:40:05.862789+0000","last_unstale":"2023-10-06T04:40:06.885566+0000","last_undegraded":"2023-10-06T04:40:06.885566+0000","last_fullsized":"2023-10-06T04:40:06.885566+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:01.373599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.875208+0000","last_change":"2023-10-06T04:40:06.872195+0000","last_active":"2023-10-06T04:40:06.875208+0000","last_peered":"2023-10-06T04:40:06.875208+0000","last_clean":"2023-10-06T04:40:06.875208+0000","last_became_active":"2023-10-06T04:40:06.870402+0000","last_became_peered":"2023-10-06T04:40:06.870402+0000","last_unstale":"2023-10-06T04:40:06.875208+0000","last_undegraded":"2023-10-06T04:40:06.875208+0000","last_fullsized":"2023-10-06T04:40:06.875208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:36.702203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.883491+0000","last_change":"2023-10-06T04:40:05.864089+0000","last_active":"2023-10-06T04:40:06.883491+0000","last_peered":"2023-10-06T04:40:06.883491+0000","last_clean":"2023-10-06T04:40:06.883491+0000","last_became_active":"2023-10-06T04:40:05.863798+0000","last_became_peered":"2023-10-06T04:40:05.863798+0000","last_unstale":"2023-10-06T04:40:06.883491+0000","last_undegraded":"2023-10-06T04:40:06.883491+0000","last_fullsized":"2023-10-06T04:40:06.883491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:19.365368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.872668+0000","last_change":"2023-10-06T04:40:06.865493+0000","last_active":"2023-10-06T04:40:06.872668+0000","last_peered":"2023-10-06T04:40:06.872668+0000","last_clean":"2023-10-06T04:40:06.872668+0000","last_became_active":"2023-10-06T04:40:06.865301+0000","last_became_peered":"2023-10-06T04:40:06.865301+0000","last_unstale":"2023-10-06T04:40:06.872668+0000","last_undegraded":"2023-10-06T04:40:06.872668+0000","last_fullsized":"2023-10-06T04:40:06.872668+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:22.683312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"30'1","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.858789+0000","last_change":"2023-10-06T04:40:05.863685+0000","last_active":"2023-10-06T04:40:06.858789+0000","last_peered":"2023-10-06T04:40:06.858789+0000","last_clean":"2023-10-06T04:40:06.858789+0000","last_became_active":"2023-10-06T04:40:05.863428+0000","last_became_peered":"2023-10-06T04:40:05.863428+0000","last_unstale":"2023-10-06T04:40:06.858789+0000","last_undegraded":"2023-10-06T04:40:06.858789+0000","last_fullsized":"2023-10-06T04:40:06.858789+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:11.911267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.868579+0000","last_change":"2023-10-06T04:40:06.868579+0000","last_active":"2023-10-06T04:40:06.868579+0000","last_peered":"2023-10-06T04:40:06.868579+0000","last_clean":"2023-10-06T04:40:06.868579+0000","last_became_active":"2023-10-06T04:40:06.868318+0000","last_became_peered":"2023-10-06T04:40:06.868318+0000","last_unstale":"2023-10-06T04:40:06.868579+0000","last_undegraded":"2023-10-06T04:40:06.868579+0000","last_fullsized":"2023-10-06T04:40:06.868579+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:37.684024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:40:05.863441+0000","last_change":"2023-10-06T04:40:05.861025+0000","last_active":"2023-10-06T04:40:05.863441+0000","last_peered":"2023-10-06T04:40:05.863441+0000","last_clean":"2023-10-06T04:40:05.863441+0000","last_became_active":"2023-10-06T04:40:05.860781+0000","last_became_peered":"2023-10-06T04:40:05.860781+0000","last_unstale":"2023-10-06T04:40:05.863441+0000","last_undegraded":"2023-10-06T04:40:05.863441+0000","last_fullsized":"2023-10-06T04:40:05.863441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:36.680221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.885820+0000","last_change":"2023-10-06T04:40:06.880587+0000","last_active":"2023-10-06T04:40:06.885820+0000","last_peered":"2023-10-06T04:40:06.885820+0000","last_clean":"2023-10-06T04:40:06.885820+0000","last_became_active":"2023-10-06T04:40:06.880070+0000","last_became_peered":"2023-10-06T04:40:06.880070+0000","last_unstale":"2023-10-06T04:40:06.885820+0000","last_undegraded":"2023-10-06T04:40:06.885820+0000","last_fullsized":"2023-10-06T04:40:06.885820+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:04.605086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.881644+0000","last_change":"2023-10-06T04:40:05.851594+0000","last_active":"2023-10-06T04:40:06.881644+0000","last_peered":"2023-10-06T04:40:06.881644+0000","last_clean":"2023-10-06T04:40:06.881644+0000","last_became_active":"2023-10-06T04:40:05.851311+0000","last_became_peered":"2023-10-06T04:40:05.851311+0000","last_unstale":"2023-10-06T04:40:06.881644+0000","last_undegraded":"2023-10-06T04:40:06.881644+0000","last_fullsized":"2023-10-06T04:40:06.881644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:40:37.634799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.878031+0000","last_change":"2023-10-06T04:40:06.871473+0000","last_active":"2023-10-06T04:40:06.878031+0000","last_peered":"2023-10-06T04:40:06.878031+0000","last_clean":"2023-10-06T04:40:06.878031+0000","last_became_active":"2023-10-06T04:40:06.871234+0000","last_became_peered":"2023-10-06T04:40:06.871234+0000","last_unstale":"2023-10-06T04:40:06.878031+0000","last_undegraded":"2023-10-06T04:40:06.878031+0000","last_fullsized":"2023-10-06T04:40:06.878031+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:36.702203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:40:05.864079+0000","last_change":"2023-10-06T04:40:05.863497+0000","last_active":"2023-10-06T04:40:05.864079+0000","last_peered":"2023-10-06T04:40:05.864079+0000","last_clean":"2023-10-06T04:40:05.864079+0000","last_became_active":"2023-10-06T04:40:05.863227+0000","last_became_peered":"2023-10-06T04:40:05.863227+0000","last_unstale":"2023-10-06T04:40:05.864079+0000","last_undegraded":"2023-10-06T04:40:05.864079+0000","last_fullsized":"2023-10-06T04:40:05.864079+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:39.890463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.874801+0000","last_change":"2023-10-06T04:40:06.870195+0000","last_active":"2023-10-06T04:40:06.874801+0000","last_peered":"2023-10-06T04:40:06.874801+0000","last_clean":"2023-10-06T04:40:06.874801+0000","last_became_active":"2023-10-06T04:40:06.869941+0000","last_became_peered":"2023-10-06T04:40:06.869941+0000","last_unstale":"2023-10-06T04:40:06.874801+0000","last_undegraded":"2023-10-06T04:40:06.874801+0000","last_fullsized":"2023-10-06T04:40:06.874801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:20.369172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.870260+0000","last_change":"2023-10-06T04:40:05.866340+0000","last_active":"2023-10-06T04:40:06.870260+0000","last_peered":"2023-10-06T04:40:06.870260+0000","last_clean":"2023-10-06T04:40:06.870260+0000","last_became_active":"2023-10-06T04:40:05.866040+0000","last_became_peered":"2023-10-06T04:40:05.866040+0000","last_unstale":"2023-10-06T04:40:06.870260+0000","last_undegraded":"2023-10-06T04:40:06.870260+0000","last_fullsized":"2023-10-06T04:40:06.870260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:00.240923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.878441+0000","last_change":"2023-10-06T04:40:06.872097+0000","last_active":"2023-10-06T04:40:06.878441+0000","last_peered":"2023-10-06T04:40:06.878441+0000","last_clean":"2023-10-06T04:40:06.878441+0000","last_became_active":"2023-10-06T04:40:06.871865+0000","last_became_peered":"2023-10-06T04:40:06.871865+0000","last_unstale":"2023-10-06T04:40:06.878441+0000","last_undegraded":"2023-10-06T04:40:06.878441+0000","last_fullsized":"2023-10-06T04:40:06.878441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:54.530170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:40:05.853863+0000","last_change":"2023-10-06T04:40:05.851556+0000","last_active":"2023-10-06T04:40:05.853863+0000","last_peered":"2023-10-06T04:40:05.853863+0000","last_clean":"2023-10-06T04:40:05.853863+0000","last_became_active":"2023-10-06T04:40:05.851331+0000","last_became_peered":"2023-10-06T04:40:05.851331+0000","last_unstale":"2023-10-06T04:40:05.853863+0000","last_undegraded":"2023-10-06T04:40:05.853863+0000","last_fullsized":"2023-10-06T04:40:05.853863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:20.597468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.869641+0000","last_change":"2023-10-06T04:40:06.864152+0000","last_active":"2023-10-06T04:40:06.869641+0000","last_peered":"2023-10-06T04:40:06.869641+0000","last_clean":"2023-10-06T04:40:06.869641+0000","last_became_active":"2023-10-06T04:40:06.863817+0000","last_became_peered":"2023-10-06T04:40:06.863817+0000","last_unstale":"2023-10-06T04:40:06.869641+0000","last_undegraded":"2023-10-06T04:40:06.869641+0000","last_fullsized":"2023-10-06T04:40:06.869641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:51.070387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.858225+0000","last_change":"2023-10-06T04:40:05.859203+0000","last_active":"2023-10-06T04:40:06.858225+0000","last_peered":"2023-10-06T04:40:06.858225+0000","last_clean":"2023-10-06T04:40:06.858225+0000","last_became_active":"2023-10-06T04:40:05.859008+0000","last_became_peered":"2023-10-06T04:40:05.859008+0000","last_unstale":"2023-10-06T04:40:06.858225+0000","last_undegraded":"2023-10-06T04:40:06.858225+0000","last_fullsized":"2023-10-06T04:40:06.858225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:18.273394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.857925+0000","last_change":"2023-10-06T04:39:16.067723+0000","last_active":"2023-10-06T04:40:06.857925+0000","last_peered":"2023-10-06T04:40:06.857925+0000","last_clean":"2023-10-06T04:40:06.857925+0000","last_became_active":"2023-10-06T04:39:16.067325+0000","last_became_peered":"2023-10-06T04:39:16.067325+0000","last_unstale":"2023-10-06T04:40:06.857925+0000","last_undegraded":"2023-10-06T04:40:06.857925+0000","last_fullsized":"2023-10-06T04:40:06.857925+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.886062+0000","last_change":"2023-10-06T04:40:06.881465+0000","last_active":"2023-10-06T04:40:06.886062+0000","last_peered":"2023-10-06T04:40:06.886062+0000","last_clean":"2023-10-06T04:40:06.886062+0000","last_became_active":"2023-10-06T04:40:06.881190+0000","last_became_peered":"2023-10-06T04:40:06.881190+0000","last_unstale":"2023-10-06T04:40:06.886062+0000","last_undegraded":"2023-10-06T04:40:06.886062+0000","last_fullsized":"2023-10-06T04:40:06.886062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:49.250693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.857665+0000","last_change":"2023-10-06T04:40:05.856368+0000","last_active":"2023-10-06T04:40:06.857665+0000","last_peered":"2023-10-06T04:40:06.857665+0000","last_clean":"2023-10-06T04:40:06.857665+0000","last_became_active":"2023-10-06T04:40:05.855993+0000","last_became_peered":"2023-10-06T04:40:05.855993+0000","last_unstale":"2023-10-06T04:40:06.857665+0000","last_undegraded":"2023-10-06T04:40:06.857665+0000","last_fullsized":"2023-10-06T04:40:06.857665+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:25.127988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.858118+0000","last_change":"2023-10-06T04:39:15.592391+0000","last_active":"2023-10-06T04:40:06.858118+0000","last_peered":"2023-10-06T04:40:06.858118+0000","last_clean":"2023-10-06T04:40:06.858118+0000","last_became_active":"2023-10-06T04:39:15.592094+0000","last_became_peered":"2023-10-06T04:39:15.592094+0000","last_unstale":"2023-10-06T04:40:06.858118+0000","last_undegraded":"2023-10-06T04:40:06.858118+0000","last_fullsized":"2023-10-06T04:40:06.858118+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.280766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.876681+0000","last_change":"2023-10-06T04:40:06.876681+0000","last_active":"2023-10-06T04:40:06.876681+0000","last_peered":"2023-10-06T04:40:06.876681+0000","last_clean":"2023-10-06T04:40:06.876681+0000","last_became_active":"2023-10-06T04:40:06.876451+0000","last_became_peered":"2023-10-06T04:40:06.876451+0000","last_unstale":"2023-10-06T04:40:06.876681+0000","last_undegraded":"2023-10-06T04:40:06.876681+0000","last_fullsized":"2023-10-06T04:40:06.876681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:52.411614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.886420+0000","last_change":"2023-10-06T04:40:05.854312+0000","last_active":"2023-10-06T04:40:06.886420+0000","last_peered":"2023-10-06T04:40:06.886420+0000","last_clean":"2023-10-06T04:40:06.886420+0000","last_became_active":"2023-10-06T04:40:05.853971+0000","last_became_peered":"2023-10-06T04:40:05.853971+0000","last_unstale":"2023-10-06T04:40:06.886420+0000","last_undegraded":"2023-10-06T04:40:06.886420+0000","last_fullsized":"2023-10-06T04:40:06.886420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:24.167181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:40:05.840860+0000","last_change":"2023-10-06T04:39:15.585112+0000","last_active":"2023-10-06T04:40:05.840860+0000","last_peered":"2023-10-06T04:40:05.840860+0000","last_clean":"2023-10-06T04:40:05.840860+0000","last_became_active":"2023-10-06T04:39:15.584853+0000","last_became_peered":"2023-10-06T04:39:15.584853+0000","last_unstale":"2023-10-06T04:40:05.840860+0000","last_undegraded":"2023-10-06T04:40:05.840860+0000","last_fullsized":"2023-10-06T04:40:05.840860+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":170,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.866237+0000","last_change":"2023-10-06T04:39:15.588017+0000","last_active":"2023-10-06T04:40:06.866237+0000","last_peered":"2023-10-06T04:40:06.866237+0000","last_clean":"2023-10-06T04:40:06.866237+0000","last_became_active":"2023-10-06T04:39:15.586771+0000","last_became_peered":"2023-10-06T04:39:15.586771+0000","last_unstale":"2023-10-06T04:40:06.866237+0000","last_undegraded":"2023-10-06T04:40:06.866237+0000","last_fullsized":"2023-10-06T04:40:06.866237+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:35.225282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.886208+0000","last_change":"2023-10-06T04:40:06.881581+0000","last_active":"2023-10-06T04:40:06.886208+0000","last_peered":"2023-10-06T04:40:06.886208+0000","last_clean":"2023-10-06T04:40:06.886208+0000","last_became_active":"2023-10-06T04:40:06.881244+0000","last_became_peered":"2023-10-06T04:40:06.881244+0000","last_unstale":"2023-10-06T04:40:06.886208+0000","last_undegraded":"2023-10-06T04:40:06.886208+0000","last_fullsized":"2023-10-06T04:40:06.886208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:46.681452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T04:40:05.860055+0000","last_change":"2023-10-06T04:40:05.858777+0000","last_active":"2023-10-06T04:40:05.860055+0000","last_peered":"2023-10-06T04:40:05.860055+0000","last_clean":"2023-10-06T04:40:05.860055+0000","last_became_active":"2023-10-06T04:40:05.858503+0000","last_became_peered":"2023-10-06T04:40:05.858503+0000","last_unstale":"2023-10-06T04:40:05.860055+0000","last_undegraded":"2023-10-06T04:40:05.860055+0000","last_fullsized":"2023-10-06T04:40:05.860055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:18.229019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.866673+0000","last_change":"2023-10-06T04:39:16.252521+0000","last_active":"2023-10-06T04:40:06.866673+0000","last_peered":"2023-10-06T04:40:06.866673+0000","last_clean":"2023-10-06T04:40:06.866673+0000","last_became_active":"2023-10-06T04:39:16.252245+0000","last_became_peered":"2023-10-06T04:39:16.252245+0000","last_unstale":"2023-10-06T04:40:06.866673+0000","last_undegraded":"2023-10-06T04:40:06.866673+0000","last_fullsized":"2023-10-06T04:40:06.866673+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:17.694713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.870526+0000","last_change":"2023-10-06T04:40:06.863249+0000","last_active":"2023-10-06T04:40:06.870526+0000","last_peered":"2023-10-06T04:40:06.870526+0000","last_clean":"2023-10-06T04:40:06.870526+0000","last_became_active":"2023-10-06T04:40:06.862789+0000","last_became_peered":"2023-10-06T04:40:06.862789+0000","last_unstale":"2023-10-06T04:40:06.870526+0000","last_undegraded":"2023-10-06T04:40:06.870526+0000","last_fullsized":"2023-10-06T04:40:06.870526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:19.277198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.867253+0000","last_change":"2023-10-06T04:40:05.866616+0000","last_active":"2023-10-06T04:40:06.867253+0000","last_peered":"2023-10-06T04:40:06.867253+0000","last_clean":"2023-10-06T04:40:06.867253+0000","last_became_active":"2023-10-06T04:40:05.866362+0000","last_became_peered":"2023-10-06T04:40:05.866362+0000","last_unstale":"2023-10-06T04:40:06.867253+0000","last_undegraded":"2023-10-06T04:40:06.867253+0000","last_fullsized":"2023-10-06T04:40:06.867253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:24.167181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.866152+0000","last_change":"2023-10-06T04:39:16.252493+0000","last_active":"2023-10-06T04:40:06.866152+0000","last_peered":"2023-10-06T04:40:06.866152+0000","last_clean":"2023-10-06T04:40:06.866152+0000","last_became_active":"2023-10-06T04:39:16.252190+0000","last_became_peered":"2023-10-06T04:39:16.252190+0000","last_unstale":"2023-10-06T04:40:06.866152+0000","last_undegraded":"2023-10-06T04:40:06.866152+0000","last_fullsized":"2023-10-06T04:40:06.866152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:59.554724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.872477+0000","last_change":"2023-10-06T04:40:06.866871+0000","last_active":"2023-10-06T04:40:06.872477+0000","last_peered":"2023-10-06T04:40:06.872477+0000","last_clean":"2023-10-06T04:40:06.872477+0000","last_became_active":"2023-10-06T04:40:06.866640+0000","last_became_peered":"2023-10-06T04:40:06.866640+0000","last_unstale":"2023-10-06T04:40:06.872477+0000","last_undegraded":"2023-10-06T04:40:06.872477+0000","last_fullsized":"2023-10-06T04:40:06.872477+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:06.708300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.861702+0000","last_change":"2023-10-06T04:40:05.853178+0000","last_active":"2023-10-06T04:40:06.861702+0000","last_peered":"2023-10-06T04:40:06.861702+0000","last_clean":"2023-10-06T04:40:06.861702+0000","last_became_active":"2023-10-06T04:40:05.852933+0000","last_became_peered":"2023-10-06T04:40:05.852933+0000","last_unstale":"2023-10-06T04:40:06.861702+0000","last_undegraded":"2023-10-06T04:40:06.861702+0000","last_fullsized":"2023-10-06T04:40:06.861702+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:24.167181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.856994+0000","last_change":"2023-10-06T04:39:16.252554+0000","last_active":"2023-10-06T04:40:06.856994+0000","last_peered":"2023-10-06T04:40:06.856994+0000","last_clean":"2023-10-06T04:40:06.856994+0000","last_became_active":"2023-10-06T04:39:16.252225+0000","last_became_peered":"2023-10-06T04:39:16.252225+0000","last_unstale":"2023-10-06T04:40:06.856994+0000","last_undegraded":"2023-10-06T04:40:06.856994+0000","last_fullsized":"2023-10-06T04:40:06.856994+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.280766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.865156+0000","last_change":"2023-10-06T04:40:06.865156+0000","last_active":"2023-10-06T04:40:06.865156+0000","last_peered":"2023-10-06T04:40:06.865156+0000","last_clean":"2023-10-06T04:40:06.865156+0000","last_became_active":"2023-10-06T04:40:06.864854+0000","last_became_peered":"2023-10-06T04:40:06.864854+0000","last_unstale":"2023-10-06T04:40:06.865156+0000","last_undegraded":"2023-10-06T04:40:06.865156+0000","last_fullsized":"2023-10-06T04:40:06.865156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:10.542364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.860357+0000","last_change":"2023-10-06T04:40:05.855471+0000","last_active":"2023-10-06T04:40:06.860357+0000","last_peered":"2023-10-06T04:40:06.860357+0000","last_clean":"2023-10-06T04:40:06.860357+0000","last_became_active":"2023-10-06T04:40:05.855193+0000","last_became_peered":"2023-10-06T04:40:05.855193+0000","last_unstale":"2023-10-06T04:40:06.860357+0000","last_undegraded":"2023-10-06T04:40:06.860357+0000","last_fullsized":"2023-10-06T04:40:06.860357+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:47.824018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.860233+0000","last_change":"2023-10-06T04:39:16.253021+0000","last_active":"2023-10-06T04:40:06.860233+0000","last_peered":"2023-10-06T04:40:06.860233+0000","last_clean":"2023-10-06T04:40:06.860233+0000","last_became_active":"2023-10-06T04:39:16.252478+0000","last_became_peered":"2023-10-06T04:39:16.252478+0000","last_unstale":"2023-10-06T04:40:06.860233+0000","last_undegraded":"2023-10-06T04:40:06.860233+0000","last_fullsized":"2023-10-06T04:40:06.860233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:07.439434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.875477+0000","last_change":"2023-10-06T04:40:06.869227+0000","last_active":"2023-10-06T04:40:06.875477+0000","last_peered":"2023-10-06T04:40:06.875477+0000","last_clean":"2023-10-06T04:40:06.875477+0000","last_became_active":"2023-10-06T04:40:06.868947+0000","last_became_peered":"2023-10-06T04:40:06.868947+0000","last_unstale":"2023-10-06T04:40:06.875477+0000","last_undegraded":"2023-10-06T04:40:06.875477+0000","last_fullsized":"2023-10-06T04:40:06.875477+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:05.837186+0000","last_clean_scrub_stamp":"2023-10-06T04:40:05.837186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:04.605086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.863897+0000","last_change":"2023-10-06T04:40:05.853780+0000","last_active":"2023-10-06T04:40:06.863897+0000","last_peered":"2023-10-06T04:40:06.863897+0000","last_clean":"2023-10-06T04:40:06.863897+0000","last_became_active":"2023-10-06T04:40:05.853275+0000","last_became_peered":"2023-10-06T04:40:05.853275+0000","last_unstale":"2023-10-06T04:40:06.863897+0000","last_undegraded":"2023-10-06T04:40:06.863897+0000","last_fullsized":"2023-10-06T04:40:06.863897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:04.833382+0000","last_clean_scrub_stamp":"2023-10-06T04:40:04.833382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:14.354716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:40:06.859465+0000","last_change":"2023-10-06T04:39:15.587681+0000","last_active":"2023-10-06T04:40:06.859465+0000","last_peered":"2023-10-06T04:40:06.859465+0000","last_clean":"2023-10-06T04:40:06.859465+0000","last_became_active":"2023-10-06T04:39:15.587313+0000","last_became_peered":"2023-10-06T04:39:15.587313+0000","last_unstale":"2023-10-06T04:40:06.859465+0000","last_undegraded":"2023-10-06T04:40:06.859465+0000","last_fullsized":"2023-10-06T04:40:06.859465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":946176,"data_stored":726468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297620,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074220,"statfs":{"total":96636764160,"available":96332001280,"internally_reserved":0,"allocated":339968,"data_stored":135048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298200,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073640,"statfs":{"total":96636764160,"available":96331407360,"internally_reserved":0,"allocated":933888,"data_stored":724952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297620,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074220,"statfs":{"total":96636764160,"available":96332001280,"internally_reserved":0,"allocated":339968,"data_stored":134528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297620,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074220,"statfs":{"total":96636764160,"available":96332001280,"internally_reserved":0,"allocated":339968,"data_stored":134564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297632,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074208,"statfs":{"total":96636764160,"available":96331988992,"internally_reserved":0,"allocated":352256,"data_stored":136064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074204,"statfs":{"total":96636764160,"available":96331984896,"internally_reserved":0,"allocated":356352,"data_stored":141711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297632,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074208,"statfs":{"total":96636764160,"available":96331988992,"internally_reserved":0,"allocated":352256,"data_stored":139894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:40:11.280 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T04:40:11.280 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T04:40:11.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.435+0000 7fb2e3fff700 1 Processor -- start 2023-10-06T04:40:11.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.435+0000 7fb2e3fff700 1 -- start start 2023-10-06T04:40:11.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.436+0000 7fb2e3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2e4157030 0x7fb2e40c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.436+0000 7fb2e3fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb2e415d240 0x7fb2e40d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.436+0000 7fb2e3fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb2e415d6b0 0x7fb2e40d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.436+0000 7fb2e3fff700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e40c6340 con 0x7fb2e415d240 2023-10-06T04:40:11.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.436+0000 7fb2e3fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e40c5970 con 0x7fb2e415d6b0 2023-10-06T04:40:11.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.436+0000 7fb2e3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e415dc20 con 0x7fb2e4157030 2023-10-06T04:40:11.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.436+0000 7fb2e27fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb2e415d240 0x7fb2e40d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.436+0000 7fb2e27fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb2e415d240 0x7fb2e40d0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60494/0 (socket says 172.21.15.112:60494) 2023-10-06T04:40:11.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.436+0000 7fb2e27fc700 1 -- 172.21.15.112:0/3094787667 learned_addr learned my addr 172.21.15.112:0/3094787667 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:11.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.436+0000 7fb2e37fe700 1 --2- 172.21.15.112:0/3094787667 >> v2:172.21.15.179:3300/0 conn(0x7fb2e415d6b0 0x7fb2e40d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.436+0000 7fb2e2ffd700 1 --2- 172.21.15.112:0/3094787667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2e4157030 0x7fb2e40c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.436+0000 7fb2e27fc700 1 -- 172.21.15.112:0/3094787667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2e4157030 msgr2=0x7fb2e40c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:11.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.436+0000 7fb2e27fc700 1 --2- 172.21.15.112:0/3094787667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2e4157030 0x7fb2e40c5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.436+0000 7fb2e27fc700 1 -- 172.21.15.112:0/3094787667 >> v2:172.21.15.179:3300/0 conn(0x7fb2e415d6b0 msgr2=0x7fb2e40d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:11.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.436+0000 7fb2e27fc700 1 --2- 172.21.15.112:0/3094787667 >> v2:172.21.15.179:3300/0 conn(0x7fb2e415d6b0 0x7fb2e40d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.436+0000 7fb2e27fc700 1 -- 172.21.15.112:0/3094787667 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e415df00 con 0x7fb2e415d240 2023-10-06T04:40:11.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.436+0000 7fb2e27fc700 1 --2- 172.21.15.112:0/3094787667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e415d240 0x7fb2e40d0380 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40ca8b0 tx=0x7fb2d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6fc0ac9be63f9d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:11.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.436+0000 7fb2e1ffb700 1 -- 172.21.15.112:0/3094787667 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d800b860 con 0x7fb2e415d240 2023-10-06T04:40:11.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.436+0000 7fb2e1ffb700 1 -- 172.21.15.112:0/3094787667 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d800b9c0 con 0x7fb2e415d240 2023-10-06T04:40:11.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.436+0000 7fb2e1ffb700 1 -- 172.21.15.112:0/3094787667 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d800bd60 con 0x7fb2e415d240 2023-10-06T04:40:11.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.437+0000 7fb2e3fff700 1 -- 172.21.15.112:0/3094787667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e415d240 msgr2=0x7fb2e40d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.437+0000 7fb2e3fff700 1 --2- 172.21.15.112:0/3094787667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e415d240 0x7fb2e40d0380 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40ca8b0 tx=0x7fb2d8009250 comp rx=0 tx=0).stop 2023-10-06T04:40:11.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.437+0000 7fb2e3fff700 1 -- 172.21.15.112:0/3094787667 shutdown_connections 2023-10-06T04:40:11.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.437+0000 7fb2e3fff700 1 --2- 172.21.15.112:0/3094787667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2e4157030 0x7fb2e40c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.437+0000 7fb2e3fff700 1 --2- 172.21.15.112:0/3094787667 >> v2:172.21.15.179:3300/0 conn(0x7fb2e415d6b0 0x7fb2e40d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.437+0000 7fb2e3fff700 1 --2- 172.21.15.112:0/3094787667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e415d240 0x7fb2e40d0380 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.437+0000 7fb2e3fff700 1 -- 172.21.15.112:0/3094787667 >> 172.21.15.112:0/3094787667 conn(0x7fb2e406c7d0 msgr2=0x7fb2e406cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:11.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.437+0000 7fb2e3fff700 1 -- 172.21.15.112:0/3094787667 shutdown_connections 2023-10-06T04:40:11.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.437+0000 7fb2e3fff700 1 -- 172.21.15.112:0/3094787667 wait complete. 2023-10-06T04:40:11.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.438+0000 7fb2e3fff700 1 Processor -- start 2023-10-06T04:40:11.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.438+0000 7fb2e3fff700 1 -- start start 2023-10-06T04:40:11.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.439+0000 7fb2e3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e4157030 0x7fb2e4155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.439+0000 7fb2e3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2e415d240 0x7fb2e4153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.439+0000 7fb2e3fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2e415d6b0 0x7fb2e4141030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.439+0000 7fb2e3fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e4141570 con 0x7fb2e4157030 2023-10-06T04:40:11.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.439+0000 7fb2e3fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e4155ab0 con 0x7fb2e415d6b0 2023-10-06T04:40:11.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.439+0000 7fb2e3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e4155180 con 0x7fb2e415d240 2023-10-06T04:40:11.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.439+0000 7fb2e2ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e4157030 0x7fb2e4155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.439+0000 7fb2e2ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e4157030 0x7fb2e4155f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60498/0 (socket says 172.21.15.112:60498) 2023-10-06T04:40:11.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.439+0000 7fb2e2ffd700 1 -- 172.21.15.112:0/4256171371 learned_addr learned my addr 172.21.15.112:0/4256171371 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:11.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.439+0000 7fb2e37fe700 1 --2- 172.21.15.112:0/4256171371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2e415d6b0 0x7fb2e4141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.439+0000 7fb2e27fc700 1 --2- 172.21.15.112:0/4256171371 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2e415d240 0x7fb2e4153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.439+0000 7fb2e2ffd700 1 -- 172.21.15.112:0/4256171371 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2e415d240 msgr2=0x7fb2e4153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.439+0000 7fb2e2ffd700 1 --2- 172.21.15.112:0/4256171371 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2e415d240 0x7fb2e4153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.439+0000 7fb2e2ffd700 1 -- 172.21.15.112:0/4256171371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2e415d6b0 msgr2=0x7fb2e4141030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.439+0000 7fb2e2ffd700 1 --2- 172.21.15.112:0/4256171371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2e415d6b0 0x7fb2e4141030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.439+0000 7fb2e2ffd700 1 -- 172.21.15.112:0/4256171371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d80094f0 con 0x7fb2e4157030 2023-10-06T04:40:11.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.439+0000 7fb2e2ffd700 1 --2- 172.21.15.112:0/4256171371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e4157030 0x7fb2e4155f40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb2d400d890 tx=0x7fb2d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:11.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.440+0000 7fb2caffd700 1 -- 172.21.15.112:0/4256171371 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d40125f0 con 0x7fb2e4157030 2023-10-06T04:40:11.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.440+0000 7fb2caffd700 1 -- 172.21.15.112:0/4256171371 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d4012750 con 0x7fb2e4157030 2023-10-06T04:40:11.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.440+0000 7fb2e3fff700 1 -- 172.21.15.112:0/4256171371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e4155460 con 0x7fb2e4157030 2023-10-06T04:40:11.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.440+0000 7fb2caffd700 1 -- 172.21.15.112:0/4256171371 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4012af0 con 0x7fb2e4157030 2023-10-06T04:40:11.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.440+0000 7fb2e3fff700 1 -- 172.21.15.112:0/4256171371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e4153a80 con 0x7fb2e4157030 2023-10-06T04:40:11.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.441+0000 7fb2e3fff700 1 -- 172.21.15.112:0/4256171371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e4155d90 con 0x7fb2e4157030 2023-10-06T04:40:11.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.441+0000 7fb2caffd700 1 -- 172.21.15.112:0/4256171371 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2d401e460 con 0x7fb2e4157030 2023-10-06T04:40:11.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.441+0000 7fb2caffd700 1 --2- 172.21.15.112:0/4256171371 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb2d0066f30 0x7fb2d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.441+0000 7fb2caffd700 1 -- 172.21.15.112:0/4256171371 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb2d4084bc0 con 0x7fb2e4157030 2023-10-06T04:40:11.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.441+0000 7fb2e27fc700 1 --2- 172.21.15.112:0/4256171371 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb2d0066f30 0x7fb2d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.442+0000 7fb2e27fc700 1 --2- 172.21.15.112:0/4256171371 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb2d0066f30 0x7fb2d00693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40ca8b0 tx=0x7fb2d8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:11.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.446+0000 7fb2caffd700 1 -- 172.21.15.112:0/4256171371 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2d4051cd0 con 0x7fb2e4157030 2023-10-06T04:40:11.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.705+0000 7fb2e3fff700 1 -- 172.21.15.112:0/4256171371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb2e405f230 con 0x7fb2e4157030 2023-10-06T04:40:11.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.708+0000 7fb2caffd700 1 -- 172.21.15.112:0/4256171371 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb2d40552f0 con 0x7fb2e4157030 2023-10-06T04:40:11.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.710+0000 7fb2e3fff700 1 -- 172.21.15.112:0/4256171371 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb2d0066f30 msgr2=0x7fb2d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.710+0000 7fb2e3fff700 1 --2- 172.21.15.112:0/4256171371 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb2d0066f30 0x7fb2d00693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40ca8b0 tx=0x7fb2d8017000 comp rx=0 tx=0).stop 2023-10-06T04:40:11.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.710+0000 7fb2e3fff700 1 -- 172.21.15.112:0/4256171371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e4157030 msgr2=0x7fb2e4155f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.710+0000 7fb2e3fff700 1 --2- 172.21.15.112:0/4256171371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e4157030 0x7fb2e4155f40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb2d400d890 tx=0x7fb2d4008040 comp rx=0 tx=0).stop 2023-10-06T04:40:11.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.710+0000 7fb2e3fff700 1 -- 172.21.15.112:0/4256171371 shutdown_connections 2023-10-06T04:40:11.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.710+0000 7fb2e3fff700 1 --2- 172.21.15.112:0/4256171371 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb2d0066f30 0x7fb2d00693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.710+0000 7fb2e3fff700 1 --2- 172.21.15.112:0/4256171371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2e415d6b0 0x7fb2e4141030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.710+0000 7fb2e3fff700 1 --2- 172.21.15.112:0/4256171371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e4157030 0x7fb2e4155f40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.710+0000 7fb2e3fff700 1 --2- 172.21.15.112:0/4256171371 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2e415d240 0x7fb2e4153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.710+0000 7fb2e3fff700 1 -- 172.21.15.112:0/4256171371 >> 172.21.15.112:0/4256171371 conn(0x7fb2e406c7d0 msgr2=0x7fb2e40d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:11.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.710+0000 7fb2e3fff700 1 -- 172.21.15.112:0/4256171371 shutdown_connections 2023-10-06T04:40:11.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.710+0000 7fb2e3fff700 1 -- 172.21.15.112:0/4256171371 wait complete. 2023-10-06T04:40:11.713 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2023-10-06T04:40:11.723 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:11.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.836+0000 7fd569439700 1 Processor -- start 2023-10-06T04:40:11.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.836+0000 7fd569439700 1 -- start start 2023-10-06T04:40:11.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.837+0000 7fd569439700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd564067eb0 0x7fd5640682c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.837+0000 7fd569439700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56406ed60 con 0x7fd56406f650 2023-10-06T04:40:11.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.837+0000 7fd569439700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56406e1c0 con 0x7fd564159900 2023-10-06T04:40:11.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.837+0000 7fd569439700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd56415db20 con 0x7fd564067eb0 2023-10-06T04:40:11.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.837+0000 7fd5637fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd564067eb0 0x7fd5640682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.837+0000 7fd5627fc700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd56406f650 0x7fd56406e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48362/0 (socket says 172.21.15.112:48362) 2023-10-06T04:40:11.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.837+0000 7fd5627fc700 1 -- 172.21.15.112:0/1108704429 learned_addr learned my addr 172.21.15.112:0/1108704429 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:11.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.838+0000 7fd5637fe700 1 -- 172.21.15.112:0/1108704429 >> v1:172.21.15.179:6789/0 conn(0x7fd564159900 legacy=0x7fd56415d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:11.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.838+0000 7fd5637fe700 1 -- 172.21.15.112:0/1108704429 >> v1:172.21.15.112:6789/0 conn(0x7fd56406f650 legacy=0x7fd56406e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.838+0000 7fd5637fe700 1 -- 172.21.15.112:0/1108704429 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd564068800 con 0x7fd564067eb0 2023-10-06T04:40:11.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.838+0000 7fd5637fe700 1 --2- 172.21.15.112:0/1108704429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd564067eb0 0x7fd5640682c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd5540098e0 tx=0x7fd5540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c853956eada770e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:11.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.838+0000 7fd561ffb700 1 -- 172.21.15.112:0/1108704429 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd554009e80 con 0x7fd564067eb0 2023-10-06T04:40:11.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.838+0000 7fd561ffb700 1 -- 172.21.15.112:0/1108704429 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55400b860 con 0x7fd564067eb0 2023-10-06T04:40:11.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.838+0000 7fd561ffb700 1 -- 172.21.15.112:0/1108704429 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55400bbe0 con 0x7fd564067eb0 2023-10-06T04:40:11.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.838+0000 7fd569439700 1 -- 172.21.15.112:0/1108704429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd564067eb0 msgr2=0x7fd5640682c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.838+0000 7fd569439700 1 --2- 172.21.15.112:0/1108704429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd564067eb0 0x7fd5640682c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd5540098e0 tx=0x7fd5540091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.838+0000 7fd569439700 1 -- 172.21.15.112:0/1108704429 shutdown_connections 2023-10-06T04:40:11.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.838+0000 7fd569439700 1 --2- 172.21.15.112:0/1108704429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd564067eb0 0x7fd5640682c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.838+0000 7fd569439700 1 -- 172.21.15.112:0/1108704429 >> 172.21.15.112:0/1108704429 conn(0x7fd5640ce5e0 msgr2=0x7fd5640ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:11.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.838+0000 7fd569439700 1 -- 172.21.15.112:0/1108704429 shutdown_connections 2023-10-06T04:40:11.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.838+0000 7fd569439700 1 -- 172.21.15.112:0/1108704429 wait complete. 2023-10-06T04:40:11.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.840+0000 7fd569439700 1 Processor -- start 2023-10-06T04:40:11.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.840+0000 7fd569439700 1 -- start start 2023-10-06T04:40:11.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd569439700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd564067eb0 0x7fd5640c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd569439700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd56406f650 0x7fd5640c1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd569439700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd564159900 0x7fd5640c2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd569439700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5640b05b0 con 0x7fd56406f650 2023-10-06T04:40:11.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd569439700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5640b3d40 con 0x7fd564067eb0 2023-10-06T04:40:11.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd569439700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5640b4020 con 0x7fd564159900 2023-10-06T04:40:11.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd5627fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd56406f650 0x7fd5640c1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd5627fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd56406f650 0x7fd5640c1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60528/0 (socket says 172.21.15.112:60528) 2023-10-06T04:40:11.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd5627fc700 1 -- 172.21.15.112:0/174226058 learned_addr learned my addr 172.21.15.112:0/174226058 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:11.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd5637fe700 1 --2- 172.21.15.112:0/174226058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd564159900 0x7fd5640c2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd562ffd700 1 --2- 172.21.15.112:0/174226058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd564067eb0 0x7fd5640c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd5627fc700 1 -- 172.21.15.112:0/174226058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd564159900 msgr2=0x7fd5640c2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd5627fc700 1 --2- 172.21.15.112:0/174226058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd564159900 0x7fd5640c2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd5627fc700 1 -- 172.21.15.112:0/174226058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd564067eb0 msgr2=0x7fd5640c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:11.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd5627fc700 1 --2- 172.21.15.112:0/174226058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd564067eb0 0x7fd5640c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:11.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd5627fc700 1 -- 172.21.15.112:0/174226058 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd554009420 con 0x7fd56406f650 2023-10-06T04:40:11.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd562ffd700 1 --2- 172.21.15.112:0/174226058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd564067eb0 0x7fd5640c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:11.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd5637fe700 1 --2- 172.21.15.112:0/174226058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd564159900 0x7fd5640c2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:11.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd5627fc700 1 --2- 172.21.15.112:0/174226058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd56406f650 0x7fd5640c1c20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00c790 tx=0x7fd54c007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:11.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd55affd700 1 -- 172.21.15.112:0/174226058 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c005b30 con 0x7fd56406f650 2023-10-06T04:40:11.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd55affd700 1 -- 172.21.15.112:0/174226058 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c005cb0 con 0x7fd56406f650 2023-10-06T04:40:11.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd55affd700 1 -- 172.21.15.112:0/174226058 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c004a80 con 0x7fd56406f650 2023-10-06T04:40:11.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd569439700 1 -- 172.21.15.112:0/174226058 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5640b4300 con 0x7fd56406f650 2023-10-06T04:40:11.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.841+0000 7fd569439700 1 -- 172.21.15.112:0/174226058 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5640c4bb0 con 0x7fd56406f650 2023-10-06T04:40:11.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.842+0000 7fd569439700 1 -- 172.21.15.112:0/174226058 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56405f230 con 0x7fd56406f650 2023-10-06T04:40:11.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.843+0000 7fd55affd700 1 -- 172.21.15.112:0/174226058 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd54c005030 con 0x7fd56406f650 2023-10-06T04:40:11.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.843+0000 7fd55affd700 1 --2- 172.21.15.112:0/174226058 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd544066f30 0x7fd5440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:11.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.843+0000 7fd55affd700 1 -- 172.21.15.112:0/174226058 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd54c083e60 con 0x7fd56406f650 2023-10-06T04:40:11.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.843+0000 7fd562ffd700 1 --2- 172.21.15.112:0/174226058 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd544066f30 0x7fd5440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:11.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.843+0000 7fd562ffd700 1 --2- 172.21.15.112:0/174226058 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd544066f30 0x7fd5440693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd55c001370 tx=0x7fd55c009680 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:11.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:11.847+0000 7fd55affd700 1 -- 172.21.15.112:0/174226058 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd54c050f70 con 0x7fd56406f650 2023-10-06T04:40:12.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.069+0000 7fd569439700 1 -- 172.21.15.112:0/174226058 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd56406ed60 con 0x7fd56406f650 2023-10-06T04:40:12.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.070+0000 7fd55affd700 1 -- 172.21.15.112:0/174226058 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4606 (secure 0 0 0) 0x7fd56406ed60 con 0x7fd56406f650 2023-10-06T04:40:12.072 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:12.072 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1053109253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1053109253},{"type":"v1","addr":"172.21.15.179:6835","nonce":1053109253}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4974,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3563478163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3563478163},{"type":"v1","addr":"172.21.15.112:6836","nonce":3563478163}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4977,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/925043938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":925043938},{"type":"v1","addr":"172.21.15.112:6837","nonce":925043938}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:06.223840+0000","modified":"2023-10-06T04:40:09.873795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1886371745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1886371745},{"type":"v1","addr":"172.21.15.179:6834","nonce":1886371745}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:40:12.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.072+0000 7fd569439700 1 -- 172.21.15.112:0/174226058 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd544066f30 msgr2=0x7fd5440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.072+0000 7fd569439700 1 --2- 172.21.15.112:0/174226058 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd544066f30 0x7fd5440693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd55c001370 tx=0x7fd55c009680 comp rx=0 tx=0).stop 2023-10-06T04:40:12.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.072+0000 7fd569439700 1 -- 172.21.15.112:0/174226058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd56406f650 msgr2=0x7fd5640c1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.072+0000 7fd569439700 1 --2- 172.21.15.112:0/174226058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd56406f650 0x7fd5640c1c20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00c790 tx=0x7fd54c007f40 comp rx=0 tx=0).stop 2023-10-06T04:40:12.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.072+0000 7fd569439700 1 -- 172.21.15.112:0/174226058 shutdown_connections 2023-10-06T04:40:12.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.072+0000 7fd569439700 1 --2- 172.21.15.112:0/174226058 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd544066f30 0x7fd5440693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.072+0000 7fd569439700 1 --2- 172.21.15.112:0/174226058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd564159900 0x7fd5640c2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.072+0000 7fd569439700 1 --2- 172.21.15.112:0/174226058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd564067eb0 0x7fd5640c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.072+0000 7fd569439700 1 --2- 172.21.15.112:0/174226058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd56406f650 0x7fd5640c1c20 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.072+0000 7fd569439700 1 -- 172.21.15.112:0/174226058 >> 172.21.15.112:0/174226058 conn(0x7fd5640ce5e0 msgr2=0x7fd564157d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:12.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.072+0000 7fd569439700 1 -- 172.21.15.112:0/174226058 shutdown_connections 2023-10-06T04:40:12.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.072+0000 7fd569439700 1 -- 172.21.15.112:0/174226058 wait complete. 2023-10-06T04:40:12.076 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2023-10-06T04:40:12.487 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:40:06.223840+0000', 'modified': '2023-10-06T04:40:09.873795+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4989}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4989': {'gid': 4989, 'name': 'd', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6834/1886371745', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6832', 'nonce': 1886371745}, {'type': 'v1', 'addr': '172.21.15.179:6834', 'nonce': 1886371745}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:40:12.488 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:40:12.488 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T04:40:12.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.603+0000 7ff6c359e700 1 Processor -- start 2023-10-06T04:40:12.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.603+0000 7ff6c359e700 1 -- start start 2023-10-06T04:40:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.604+0000 7ff6c359e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff6c4143270 0x7ff6c40b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.604+0000 7ff6c359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c40cd100 0x7ff6c4159e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.604+0000 7ff6c359e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff6c406d9a0 0x7ff6c406de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.604+0000 7ff6c359e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c406e380 con 0x7ff6c4143270 2023-10-06T04:40:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.604+0000 7ff6c359e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c415a360 con 0x7ff6c406d9a0 2023-10-06T04:40:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.604+0000 7ff6c359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c4143640 con 0x7ff6c40cd100 2023-10-06T04:40:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.604+0000 7ff6c259c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff6c4143270 0x7ff6c40b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.604+0000 7ff6c259c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff6c4143270 0x7ff6c40b64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60540/0 (socket says 172.21.15.112:60540) 2023-10-06T04:40:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.604+0000 7ff6c259c700 1 -- 172.21.15.112:0/1350761532 learned_addr learned my addr 172.21.15.112:0/1350761532 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:12.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.604+0000 7ff6c259c700 1 -- 172.21.15.112:0/1350761532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c40cd100 msgr2=0x7ff6c4159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:12.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.604+0000 7ff6c259c700 1 --2- 172.21.15.112:0/1350761532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c40cd100 0x7ff6c4159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.604+0000 7ff6c2d9d700 1 --2- 172.21.15.112:0/1350761532 >> v2:172.21.15.179:3300/0 conn(0x7ff6c406d9a0 0x7ff6c406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.604+0000 7ff6c259c700 1 -- 172.21.15.112:0/1350761532 >> v2:172.21.15.179:3300/0 conn(0x7ff6c406d9a0 msgr2=0x7ff6c406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:12.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.604+0000 7ff6c259c700 1 --2- 172.21.15.112:0/1350761532 >> v2:172.21.15.179:3300/0 conn(0x7ff6c406d9a0 0x7ff6c406de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.604+0000 7ff6c259c700 1 -- 172.21.15.112:0/1350761532 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c40cd650 con 0x7ff6c4143270 2023-10-06T04:40:12.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.604+0000 7ff6c259c700 1 --2- 172.21.15.112:0/1350761532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6c4143270 0x7ff6c40b64a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4089b00 tx=0x7ff6b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8310a362e66cf3f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:12.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.605+0000 7ff6c1d9b700 1 -- 172.21.15.112:0/1350761532 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b400b860 con 0x7ff6c4143270 2023-10-06T04:40:12.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.605+0000 7ff6c1d9b700 1 -- 172.21.15.112:0/1350761532 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b400b9c0 con 0x7ff6c4143270 2023-10-06T04:40:12.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.605+0000 7ff6c1d9b700 1 -- 172.21.15.112:0/1350761532 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b400bd60 con 0x7ff6c4143270 2023-10-06T04:40:12.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.605+0000 7ff6c359e700 1 -- 172.21.15.112:0/1350761532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6c4143270 msgr2=0x7ff6c40b64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.605+0000 7ff6c359e700 1 --2- 172.21.15.112:0/1350761532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6c4143270 0x7ff6c40b64a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4089b00 tx=0x7ff6b4009250 comp rx=0 tx=0).stop 2023-10-06T04:40:12.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.605+0000 7ff6c359e700 1 -- 172.21.15.112:0/1350761532 shutdown_connections 2023-10-06T04:40:12.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.605+0000 7ff6c359e700 1 --2- 172.21.15.112:0/1350761532 >> v2:172.21.15.179:3300/0 conn(0x7ff6c406d9a0 0x7ff6c406de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.605+0000 7ff6c359e700 1 --2- 172.21.15.112:0/1350761532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6c4143270 0x7ff6c40b64a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.605+0000 7ff6c359e700 1 --2- 172.21.15.112:0/1350761532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c40cd100 0x7ff6c4159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.605+0000 7ff6c359e700 1 -- 172.21.15.112:0/1350761532 >> 172.21.15.112:0/1350761532 conn(0x7ff6c406d2a0 msgr2=0x7ff6c40b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:12.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.605+0000 7ff6c359e700 1 -- 172.21.15.112:0/1350761532 shutdown_connections 2023-10-06T04:40:12.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.605+0000 7ff6c359e700 1 -- 172.21.15.112:0/1350761532 wait complete. 2023-10-06T04:40:12.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.606+0000 7ff6c359e700 1 Processor -- start 2023-10-06T04:40:12.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.606+0000 7ff6c359e700 1 -- start start 2023-10-06T04:40:12.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.607+0000 7ff6c359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c406d9a0 0x7ff6c4142260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.607+0000 7ff6c359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c40cd100 0x7ff6c40cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.607+0000 7ff6c359e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6c4143270 0x7ff6c415f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.607+0000 7ff6c359e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c40c63b0 con 0x7ff6c4143270 2023-10-06T04:40:12.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.607+0000 7ff6c359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c40c57a0 con 0x7ff6c40cd100 2023-10-06T04:40:12.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.607+0000 7ff6c359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c40c5a80 con 0x7ff6c406d9a0 2023-10-06T04:40:12.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.607+0000 7ff6c2d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6c4143270 0x7ff6c415f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.607+0000 7ff6c2d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6c4143270 0x7ff6c415f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60552/0 (socket says 172.21.15.112:60552) 2023-10-06T04:40:12.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.607+0000 7ff6c2d9d700 1 -- 172.21.15.112:0/36597792 learned_addr learned my addr 172.21.15.112:0/36597792 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:12.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.607+0000 7ff6b9d9b700 1 --2- 172.21.15.112:0/36597792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c40cd100 0x7ff6c40cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.607+0000 7ff6c259c700 1 --2- 172.21.15.112:0/36597792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c406d9a0 0x7ff6c4142260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.607+0000 7ff6c2d9d700 1 -- 172.21.15.112:0/36597792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c406d9a0 msgr2=0x7ff6c4142260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.607+0000 7ff6c2d9d700 1 --2- 172.21.15.112:0/36597792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c406d9a0 0x7ff6c4142260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.607+0000 7ff6c2d9d700 1 -- 172.21.15.112:0/36597792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c40cd100 msgr2=0x7ff6c40cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.607+0000 7ff6c2d9d700 1 --2- 172.21.15.112:0/36597792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c40cd100 0x7ff6c40cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.608+0000 7ff6c2d9d700 1 -- 172.21.15.112:0/36597792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b40094f0 con 0x7ff6c4143270 2023-10-06T04:40:12.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.608+0000 7ff6c2d9d700 1 --2- 172.21.15.112:0/36597792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6c4143270 0x7ff6c415f3c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc00ceb0 tx=0x7ff6bc007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:12.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.608+0000 7ff6baffd700 1 -- 172.21.15.112:0/36597792 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc00ae40 con 0x7ff6c4143270 2023-10-06T04:40:12.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.608+0000 7ff6baffd700 1 -- 172.21.15.112:0/36597792 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc016430 con 0x7ff6c4143270 2023-10-06T04:40:12.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.608+0000 7ff6c359e700 1 -- 172.21.15.112:0/36597792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c40c5d60 con 0x7ff6c4143270 2023-10-06T04:40:12.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.608+0000 7ff6baffd700 1 -- 172.21.15.112:0/36597792 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc0167d0 con 0x7ff6c4143270 2023-10-06T04:40:12.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.608+0000 7ff6c359e700 1 -- 172.21.15.112:0/36597792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c41427a0 con 0x7ff6c4143270 2023-10-06T04:40:12.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.609+0000 7ff6baffd700 1 -- 172.21.15.112:0/36597792 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6bc003020 con 0x7ff6c4143270 2023-10-06T04:40:12.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.609+0000 7ff6baffd700 1 --2- 172.21.15.112:0/36597792 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff6a4066f30 0x7ff6a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.610+0000 7ff6baffd700 1 -- 172.21.15.112:0/36597792 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff6bc012070 con 0x7ff6c4143270 2023-10-06T04:40:12.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.610+0000 7ff6c259c700 1 --2- 172.21.15.112:0/36597792 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff6a4066f30 0x7ff6a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.610+0000 7ff6c259c700 1 --2- 172.21.15.112:0/36597792 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff6a4066f30 0x7ff6a40693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4089b00 tx=0x7ff6b4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:12.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.612+0000 7ff6d20bab80 1 Processor -- start 2023-10-06T04:40:12.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.612+0000 7ff6d20bab80 1 -- start start 2023-10-06T04:40:12.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.612+0000 7ff6d20bab80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b0d98ff950 0x55b0d98ffd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.612+0000 7ff6d20bab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9949bc0 0x55b0d9928920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.612+0000 7ff6d20bab80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b0d9928e60 0x55b0d98fb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.612+0000 7ff6d20bab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0d987fc80 con 0x55b0d9949bc0 2023-10-06T04:40:12.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.612+0000 7ff6d20bab80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0d9856a70 con 0x55b0d9928e60 2023-10-06T04:40:12.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.612+0000 7ff6d20bab80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0d9854270 con 0x55b0d98ff950 2023-10-06T04:40:12.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.612+0000 7ff6b9d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9949bc0 0x55b0d9928920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.612+0000 7ff6b9d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9949bc0 0x55b0d9928920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60556/0 (socket says 172.21.15.112:60556) 2023-10-06T04:40:12.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.612+0000 7ff6b9d9b700 1 -- 172.21.15.112:0/2929564673 learned_addr learned my addr 172.21.15.112:0/2929564673 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:12.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.613+0000 7ff6c259c700 1 --2- 172.21.15.112:0/2929564673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b0d98ff950 0x55b0d98ffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.613+0000 7ff6b9d9b700 1 -- 172.21.15.112:0/2929564673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b0d98ff950 msgr2=0x55b0d98ffd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:12.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.613+0000 7ff6c2d9d700 1 --2- 172.21.15.112:0/2929564673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b0d9928e60 0x55b0d98fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.613+0000 7ff6b9d9b700 1 --2- 172.21.15.112:0/2929564673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b0d98ff950 0x55b0d98ffd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.613+0000 7ff6b9d9b700 1 -- 172.21.15.112:0/2929564673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b0d9928e60 msgr2=0x55b0d98fb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:12.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.613+0000 7ff6b9d9b700 1 --2- 172.21.15.112:0/2929564673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b0d9928e60 0x55b0d98fb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.613+0000 7ff6b9d9b700 1 -- 172.21.15.112:0/2929564673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0d96ea270 con 0x55b0d9949bc0 2023-10-06T04:40:12.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.613+0000 7ff6c2d9d700 1 --2- 172.21.15.112:0/2929564673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b0d9928e60 0x55b0d98fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:12.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.613+0000 7ff6b9d9b700 1 --2- 172.21.15.112:0/2929564673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9949bc0 0x55b0d9928920 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00b8a0 tx=0x7ff6ac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b91a53bffa8dbde server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:12.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.613+0000 7ff6a37fe700 1 -- 172.21.15.112:0/2929564673 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac00d6b0 con 0x55b0d9949bc0 2023-10-06T04:40:12.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.613+0000 7ff6a37fe700 1 -- 172.21.15.112:0/2929564673 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac00d830 con 0x55b0d9949bc0 2023-10-06T04:40:12.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.613+0000 7ff6a37fe700 1 -- 172.21.15.112:0/2929564673 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac00dbf0 con 0x55b0d9949bc0 2023-10-06T04:40:12.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.614+0000 7ff6d20bab80 1 -- 172.21.15.112:0/2929564673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9949bc0 msgr2=0x55b0d9928920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.614+0000 7ff6d20bab80 1 --2- 172.21.15.112:0/2929564673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9949bc0 0x55b0d9928920 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00b8a0 tx=0x7ff6ac008040 comp rx=0 tx=0).stop 2023-10-06T04:40:12.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.614+0000 7ff6d20bab80 1 -- 172.21.15.112:0/2929564673 shutdown_connections 2023-10-06T04:40:12.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.614+0000 7ff6d20bab80 1 --2- 172.21.15.112:0/2929564673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b0d9928e60 0x55b0d98fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.614+0000 7ff6d20bab80 1 --2- 172.21.15.112:0/2929564673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b0d98ff950 0x55b0d98ffd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.614+0000 7ff6d20bab80 1 --2- 172.21.15.112:0/2929564673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9949bc0 0x55b0d9928920 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.614+0000 7ff6d20bab80 1 -- 172.21.15.112:0/2929564673 >> 172.21.15.112:0/2929564673 conn(0x55b0d9901270 msgr2=0x55b0d9901640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:12.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.614+0000 7ff6d20bab80 1 -- 172.21.15.112:0/2929564673 shutdown_connections 2023-10-06T04:40:12.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.614+0000 7ff6d20bab80 1 -- 172.21.15.112:0/2929564673 wait complete. 2023-10-06T04:40:12.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.614+0000 7ff6d20bab80 1 -- start start 2023-10-06T04:40:12.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.614+0000 7ff6d20bab80 1 Processor -- start 2023-10-06T04:40:12.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.615+0000 7ff6d20bab80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b0d98ff950 0x55b0d9925210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.615+0000 7ff6d20bab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9928e60 0x55b0d9943280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.615+0000 7ff6d20bab80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b0d9949bc0 0x55b0d99437c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.615+0000 7ff6d20bab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0d9850060 con 0x55b0d9928e60 2023-10-06T04:40:12.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.615+0000 7ff6d20bab80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0d97fb890 con 0x55b0d98ff950 2023-10-06T04:40:12.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.615+0000 7ff6d20bab80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0d9816ea0 con 0x55b0d9949bc0 2023-10-06T04:40:12.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.615+0000 7ff6d20bab80 10 client.0 _ll_register_callbacks cb 0x55b0d96ecf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:40:12.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.615+0000 7ff6b9d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9928e60 0x55b0d9943280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.615+0000 7ff6b9d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9928e60 0x55b0d9943280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60562/0 (socket says 172.21.15.112:60562) 2023-10-06T04:40:12.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.615+0000 7ff6b9d9b700 1 -- 172.21.15.112:0/4134172807 learned_addr learned my addr 172.21.15.112:0/4134172807 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:12.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6c2d9d700 1 --2- 172.21.15.112:0/4134172807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b0d9949bc0 0x55b0d99437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6c259c700 1 --2- 172.21.15.112:0/4134172807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b0d98ff950 0x55b0d9925210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6b9d9b700 1 -- 172.21.15.112:0/4134172807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b0d9949bc0 msgr2=0x55b0d99437c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:12.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6b9d9b700 1 --2- 172.21.15.112:0/4134172807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b0d9949bc0 0x55b0d99437c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6b9d9b700 1 -- 172.21.15.112:0/4134172807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b0d98ff950 msgr2=0x55b0d9925210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:12.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6b9d9b700 1 --2- 172.21.15.112:0/4134172807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b0d98ff950 0x55b0d9925210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6b9d9b700 1 -- 172.21.15.112:0/4134172807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ac00e040 con 0x55b0d9928e60 2023-10-06T04:40:12.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6b9d9b700 1 --2- 172.21.15.112:0/4134172807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9928e60 0x55b0d9943280 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac006b10 tx=0x7ff6ac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc00a7e64e1e9c3a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:12.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6a0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-06T04:40:12.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6a0ff9700 1 -- 172.21.15.112:0/4134172807 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac012730 con 0x55b0d9928e60 2023-10-06T04:40:12.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6a0ff9700 1 -- 172.21.15.112:0/4134172807 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff6ac012890 con 0x55b0d9928e60 2023-10-06T04:40:12.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6d20bab80 1 -- 172.21.15.112:0/4134172807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b0d98f4690 con 0x55b0d9928e60 2023-10-06T04:40:12.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6a0ff9700 1 -- 172.21.15.112:0/4134172807 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6ac012c60 con 0x55b0d9928e60 2023-10-06T04:40:12.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6d20bab80 10 client.5169 fetch_fsmap learned FSMap version 15 2023-10-06T04:40:12.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6d20bab80 1 -- 172.21.15.112:0/4134172807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55b0d968cfe0 con 0x55b0d9928e60 2023-10-06T04:40:12.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6a0ff9700 1 -- 172.21.15.112:0/4134172807 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b0d98f4690 con 0x55b0d9928e60 2023-10-06T04:40:12.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6a0ff9700 1 -- 172.21.15.112:0/4134172807 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff6ac025420 con 0x55b0d9928e60 2023-10-06T04:40:12.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6d20bab80 10 client.5169 fetch_fsmap finished waiting for FSMap version 15 2023-10-06T04:40:12.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6d20bab80 10 client.5169 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T04:40:12.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6d20bab80 20 client.5169 populate_metadata read hostname 'smithi112' 2023-10-06T04:40:12.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6d20bab80 1 --2- 172.21.15.112:0/4134172807 >> [v2:172.21.15.179:6832/1886371745,v1:172.21.15.179:6834/1886371745] conn(0x55b0d9942480 0x55b0d9942850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6d20bab80 4 client.5169 mds_command: new command op to 4989 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:40:12.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.616+0000 7ff6d20bab80 1 -- 172.21.15.112:0/4134172807 --> [v2:172.21.15.179:6832/1886371745,v1:172.21.15.179:6834/1886371745] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b0d98d15c0 con 0x55b0d9942480 2023-10-06T04:40:12.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.617+0000 7ff6c259c700 1 --2- 172.21.15.112:0/4134172807 >> [v2:172.21.15.179:6832/1886371745,v1:172.21.15.179:6834/1886371745] conn(0x55b0d9942480 0x55b0d9942850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.617+0000 7ff6a0ff9700 10 client.5169 ms_handle_connect on v2:172.21.15.179:6832/1886371745 2023-10-06T04:40:12.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.617+0000 7ff6c259c700 1 --2- 172.21.15.112:0/4134172807 >> [v2:172.21.15.179:6832/1886371745,v1:172.21.15.179:6834/1886371745] conn(0x55b0d9942480 0x55b0d9942850 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=693b2c3832bd245f server_cookie=279a90dd0acfa2ce in_seq=0 out_seq=0 2023-10-06T04:40:12.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.618+0000 7ff6a0ff9700 1 -- 172.21.15.112:0/4134172807 <== mds.0 v2:172.21.15.179:6832/1886371745 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55b0d98d15c0 con 0x55b0d9942480 2023-10-06T04:40:12.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.618+0000 7ff6a0ff9700 10 client.5169 handle_command_reply: tid=0 2023-10-06T04:40:12.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.618+0000 7ff6d20bab80 1 client.5169 shutdown 2023-10-06T04:40:12.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.618+0000 7ff6d20bab80 1 -- 172.21.15.112:0/4134172807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9928e60 msgr2=0x55b0d9943280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.618+0000 7ff6d20bab80 1 --2- 172.21.15.112:0/4134172807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9928e60 0x55b0d9943280 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac006b10 tx=0x7ff6ac019000 comp rx=0 tx=0).stop 2023-10-06T04:40:12.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.618+0000 7ff6d20bab80 1 -- 172.21.15.112:0/4134172807 shutdown_connections 2023-10-06T04:40:12.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.618+0000 7ff6d20bab80 1 --2- 172.21.15.112:0/4134172807 >> [v2:172.21.15.179:6832/1886371745,v1:172.21.15.179:6834/1886371745] conn(0x55b0d9942480 0x55b0d9942850 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.618+0000 7ff6d20bab80 1 --2- 172.21.15.112:0/4134172807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b0d9949bc0 0x55b0d99437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.618+0000 7ff6d20bab80 1 --2- 172.21.15.112:0/4134172807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b0d98ff950 0x55b0d9925210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.618+0000 7ff6a0ff9700 0 client.5169 ms_handle_reset on v2:172.21.15.179:6832/1886371745 2023-10-06T04:40:12.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.618+0000 7ff6d20bab80 1 --2- 172.21.15.112:0/4134172807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9928e60 0x55b0d9943280 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.618+0000 7ff6d20bab80 1 -- 172.21.15.112:0/4134172807 >> 172.21.15.112:0/4134172807 conn(0x55b0d9901270 msgr2=0x55b0d98f61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:12.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.618+0000 7ff6d20bab80 1 -- 172.21.15.112:0/4134172807 shutdown_connections 2023-10-06T04:40:12.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.618+0000 7ff6d20bab80 1 -- 172.21.15.112:0/4134172807 wait complete. 2023-10-06T04:40:12.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.618+0000 7ff6d20bab80 20 client.5169 trim_cache size 0 max 16384 2023-10-06T04:40:12.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.635+0000 7ff6d20bab80 1 Processor -- start 2023-10-06T04:40:12.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.635+0000 7ff6d20bab80 1 -- start start 2023-10-06T04:40:12.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.636+0000 7ff6d20bab80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b0d98ff950 0x55b0d98f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.636+0000 7ff6d20bab80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b0d9928e60 0x55b0d993f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.636+0000 7ff6d20bab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9949bc0 0x55b0d9927c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.636+0000 7ff6d20bab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0d96d2e30 con 0x55b0d9949bc0 2023-10-06T04:40:12.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.636+0000 7ff6d20bab80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0d9944fb0 con 0x55b0d98ff950 2023-10-06T04:40:12.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.636+0000 7ff6d20bab80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0d9945210 con 0x55b0d9928e60 2023-10-06T04:40:12.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.636+0000 7ff6c2d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9949bc0 0x55b0d9927c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.636+0000 7ff6c2d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9949bc0 0x55b0d9927c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60574/0 (socket says 172.21.15.112:60574) 2023-10-06T04:40:12.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.636+0000 7ff6c2d9d700 1 -- 172.21.15.112:0/3288917109 learned_addr learned my addr 172.21.15.112:0/3288917109 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:12.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.636+0000 7ff6c2d9d700 1 -- 172.21.15.112:0/3288917109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b0d9928e60 msgr2=0x55b0d993f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:12.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.636+0000 7ff6c2d9d700 1 --2- 172.21.15.112:0/3288917109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b0d9928e60 0x55b0d993f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.636+0000 7ff6c2d9d700 1 -- 172.21.15.112:0/3288917109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b0d98ff950 msgr2=0x55b0d98f61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:12.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.636+0000 7ff6c2d9d700 1 --2- 172.21.15.112:0/3288917109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b0d98ff950 0x55b0d98f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.636+0000 7ff6c2d9d700 1 -- 172.21.15.112:0/3288917109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0d9941340 con 0x55b0d9949bc0 2023-10-06T04:40:12.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.636+0000 7ff6c2d9d700 1 --2- 172.21.15.112:0/3288917109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9949bc0 0x55b0d9927c60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc052840 tx=0x7ff6bc083890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d14ca972beb4ce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:12.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.636+0000 7ff6a3fff700 1 -- 172.21.15.112:0/3288917109 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc05d2e0 con 0x55b0d9949bc0 2023-10-06T04:40:12.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.636+0000 7ff6a3fff700 1 -- 172.21.15.112:0/3288917109 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc054480 con 0x55b0d9949bc0 2023-10-06T04:40:12.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.636+0000 7ff6a3fff700 1 -- 172.21.15.112:0/3288917109 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc0565a0 con 0x55b0d9949bc0 2023-10-06T04:40:12.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.637+0000 7ff6d20bab80 1 -- 172.21.15.112:0/3288917109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9949bc0 msgr2=0x55b0d9927c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.637+0000 7ff6d20bab80 1 --2- 172.21.15.112:0/3288917109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9949bc0 0x55b0d9927c60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc052840 tx=0x7ff6bc083890 comp rx=0 tx=0).stop 2023-10-06T04:40:12.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.637+0000 7ff6d20bab80 1 -- 172.21.15.112:0/3288917109 shutdown_connections 2023-10-06T04:40:12.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.637+0000 7ff6d20bab80 1 --2- 172.21.15.112:0/3288917109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9949bc0 0x55b0d9927c60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.637+0000 7ff6d20bab80 1 --2- 172.21.15.112:0/3288917109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b0d98ff950 0x55b0d98f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.637+0000 7ff6d20bab80 1 --2- 172.21.15.112:0/3288917109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b0d9928e60 0x55b0d993f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.637+0000 7ff6d20bab80 1 -- 172.21.15.112:0/3288917109 >> 172.21.15.112:0/3288917109 conn(0x55b0d9901270 msgr2=0x55b0d9925210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:12.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.637+0000 7ff6d20bab80 1 -- 172.21.15.112:0/3288917109 shutdown_connections 2023-10-06T04:40:12.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.637+0000 7ff6d20bab80 1 -- 172.21.15.112:0/3288917109 wait complete. 2023-10-06T04:40:12.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.637+0000 7ff6d20bab80 1 -- start start 2023-10-06T04:40:12.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.637+0000 7ff6d20bab80 1 Processor -- start 2023-10-06T04:40:12.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.638+0000 7ff6d20bab80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b0d98ff950 0x55b0d98fb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.638+0000 7ff6d20bab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9928e60 0x55b0d994a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.638+0000 7ff6d20bab80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b0d9949bc0 0x55b0d98f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.638+0000 7ff6d20bab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0d99ab940 con 0x55b0d9928e60 2023-10-06T04:40:12.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.638+0000 7ff6d20bab80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0d99ac550 con 0x55b0d9949bc0 2023-10-06T04:40:12.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.638+0000 7ff6d20bab80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0d99abc20 con 0x55b0d98ff950 2023-10-06T04:40:12.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.638+0000 7ff6d20bab80 10 client.0 _ll_register_callbacks cb 0x55b0d96ecf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:40:12.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.638+0000 7ff6b9d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9928e60 0x55b0d994a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.638+0000 7ff6b9d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9928e60 0x55b0d994a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60586/0 (socket says 172.21.15.112:60586) 2023-10-06T04:40:12.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.638+0000 7ff6b9d9b700 1 -- 172.21.15.112:0/1185166705 learned_addr learned my addr 172.21.15.112:0/1185166705 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:12.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6c259c700 1 --2- 172.21.15.112:0/1185166705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b0d98ff950 0x55b0d98fb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6c2d9d700 1 --2- 172.21.15.112:0/1185166705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b0d9949bc0 0x55b0d98f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6b9d9b700 1 -- 172.21.15.112:0/1185166705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b0d98ff950 msgr2=0x55b0d98fb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:12.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6b9d9b700 1 --2- 172.21.15.112:0/1185166705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b0d98ff950 0x55b0d98fb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6b9d9b700 1 -- 172.21.15.112:0/1185166705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b0d9949bc0 msgr2=0x55b0d98f61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:12.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6b9d9b700 1 --2- 172.21.15.112:0/1185166705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b0d9949bc0 0x55b0d98f61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6b9d9b700 1 -- 172.21.15.112:0/1185166705 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c41427a0 con 0x55b0d9928e60 2023-10-06T04:40:12.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6b9d9b700 1 --2- 172.21.15.112:0/1185166705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9928e60 0x55b0d994a960 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00b770 tx=0x7ff6ac01f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fae5f07a30a5b87 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:12.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6a0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-10-06T04:40:12.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6a0ff9700 1 -- 172.21.15.112:0/1185166705 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac025af0 con 0x55b0d9928e60 2023-10-06T04:40:12.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6a0ff9700 1 -- 172.21.15.112:0/1185166705 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff6ac025c50 con 0x55b0d9928e60 2023-10-06T04:40:12.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6d20bab80 1 -- 172.21.15.112:0/1185166705 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff6ac00d830 con 0x55b0d9928e60 2023-10-06T04:40:12.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6a0ff9700 1 -- 172.21.15.112:0/1185166705 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6ac01d620 con 0x55b0d9928e60 2023-10-06T04:40:12.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6d20bab80 10 client.5175 fetch_fsmap learned FSMap version 15 2023-10-06T04:40:12.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6d20bab80 1 -- 172.21.15.112:0/1185166705 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55b0d981e780 con 0x55b0d9928e60 2023-10-06T04:40:12.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6a0ff9700 1 -- 172.21.15.112:0/1185166705 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac00d830 con 0x55b0d9928e60 2023-10-06T04:40:12.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6a0ff9700 1 -- 172.21.15.112:0/1185166705 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff6ac01d780 con 0x55b0d9928e60 2023-10-06T04:40:12.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6d20bab80 10 client.5175 fetch_fsmap finished waiting for FSMap version 15 2023-10-06T04:40:12.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6d20bab80 10 client.5175 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T04:40:12.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6d20bab80 20 client.5175 populate_metadata read hostname 'smithi112' 2023-10-06T04:40:12.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6d20bab80 1 --2- 172.21.15.112:0/1185166705 >> [v2:172.21.15.179:6832/1886371745,v1:172.21.15.179:6834/1886371745] conn(0x55b0d99aefd0 0x55b0d99af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6d20bab80 4 client.5175 mds_command: new command op to 4989 tid=0[{"prefix": "status"}] 2023-10-06T04:40:12.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.639+0000 7ff6d20bab80 1 -- 172.21.15.112:0/1185166705 --> [v2:172.21.15.179:6832/1886371745,v1:172.21.15.179:6834/1886371745] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b0d97f2e00 con 0x55b0d99aefd0 2023-10-06T04:40:12.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.640+0000 7ff6c259c700 1 --2- 172.21.15.112:0/1185166705 >> [v2:172.21.15.179:6832/1886371745,v1:172.21.15.179:6834/1886371745] conn(0x55b0d99aefd0 0x55b0d99af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.640+0000 7ff6a0ff9700 10 client.5175 ms_handle_connect on v2:172.21.15.179:6832/1886371745 2023-10-06T04:40:12.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.640+0000 7ff6c259c700 1 --2- 172.21.15.112:0/1185166705 >> [v2:172.21.15.179:6832/1886371745,v1:172.21.15.179:6834/1886371745] conn(0x55b0d99aefd0 0x55b0d99af3a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d234ad6f37fd98d7 server_cookie=17f8b549b2a99fa2 in_seq=0 out_seq=0 2023-10-06T04:40:12.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.640+0000 7ff6a0ff9700 1 -- 172.21.15.112:0/1185166705 <== mds.0 v2:172.21.15.179:6832/1886371745 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55b0d97f2e00 con 0x55b0d99aefd0 2023-10-06T04:40:12.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.640+0000 7ff6a0ff9700 10 client.5175 handle_command_reply: tid=0 2023-10-06T04:40:12.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.640+0000 7ff6d20bab80 1 client.5175 shutdown 2023-10-06T04:40:12.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.640+0000 7ff6d20bab80 1 -- 172.21.15.112:0/1185166705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9928e60 msgr2=0x55b0d994a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.640+0000 7ff6d20bab80 1 --2- 172.21.15.112:0/1185166705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9928e60 0x55b0d994a960 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00b770 tx=0x7ff6ac01f070 comp rx=0 tx=0).stop 2023-10-06T04:40:12.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.640+0000 7ff6d20bab80 1 -- 172.21.15.112:0/1185166705 shutdown_connections 2023-10-06T04:40:12.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.640+0000 7ff6d20bab80 1 --2- 172.21.15.112:0/1185166705 >> [v2:172.21.15.179:6832/1886371745,v1:172.21.15.179:6834/1886371745] conn(0x55b0d99aefd0 0x55b0d99af3a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.640+0000 7ff6d20bab80 1 --2- 172.21.15.112:0/1185166705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b0d9949bc0 0x55b0d98f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.640+0000 7ff6a0ff9700 0 client.5175 ms_handle_reset on v2:172.21.15.179:6832/1886371745 2023-10-06T04:40:12.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.640+0000 7ff6d20bab80 1 --2- 172.21.15.112:0/1185166705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b0d98ff950 0x55b0d98fb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.640+0000 7ff6d20bab80 1 --2- 172.21.15.112:0/1185166705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0d9928e60 0x55b0d994a960 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.640+0000 7ff6d20bab80 1 -- 172.21.15.112:0/1185166705 >> 172.21.15.112:0/1185166705 conn(0x55b0d9901270 msgr2=0x55b0d9928280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:12.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.640+0000 7ff6d20bab80 1 -- 172.21.15.112:0/1185166705 shutdown_connections 2023-10-06T04:40:12.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.640+0000 7ff6d20bab80 1 -- 172.21.15.112:0/1185166705 wait complete. 2023-10-06T04:40:12.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.641+0000 7ff6d20bab80 20 client.5175 trim_cache size 0 max 16384 2023-10-06T04:40:12.650 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-10-06T04:40:12.650 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "3e2b8a43-6e3c-475a-8b31-8dbcc20d6445", 2023-10-06T04:40:12.650 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2023-10-06T04:40:12.650 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 4989, 2023-10-06T04:40:12.650 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2023-10-06T04:40:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2023-10-06T04:40:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2023-10-06T04:40:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 5.7758686729999997, 2023-10-06T04:40:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 15, 2023-10-06T04:40:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 31, 2023-10-06T04:40:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 31, 2023-10-06T04:40:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 13.668247291 2023-10-06T04:40:12.651 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-10-06T04:40:12.652 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.641+0000 7ff6c359e700 1 -- 172.21.15.112:0/36597792 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff6a4066f30 msgr2=0x7ff6a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.652 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.641+0000 7ff6c359e700 1 --2- 172.21.15.112:0/36597792 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff6a4066f30 0x7ff6a40693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4089b00 tx=0x7ff6b4017000 comp rx=0 tx=0).stop 2023-10-06T04:40:12.652 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.641+0000 7ff6c359e700 1 -- 172.21.15.112:0/36597792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6c4143270 msgr2=0x7ff6c415f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.652 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.641+0000 7ff6c359e700 1 --2- 172.21.15.112:0/36597792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6c4143270 0x7ff6c415f3c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc00ceb0 tx=0x7ff6bc007870 comp rx=0 tx=0).stop 2023-10-06T04:40:12.652 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.641+0000 7ff6c359e700 1 -- 172.21.15.112:0/36597792 shutdown_connections 2023-10-06T04:40:12.652 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.641+0000 7ff6c359e700 1 --2- 172.21.15.112:0/36597792 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff6a4066f30 0x7ff6a40693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.641+0000 7ff6c359e700 1 --2- 172.21.15.112:0/36597792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6c4143270 0x7ff6c415f3c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.641+0000 7ff6c359e700 1 --2- 172.21.15.112:0/36597792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c406d9a0 0x7ff6c4142260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.641+0000 7ff6c359e700 1 --2- 172.21.15.112:0/36597792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c40cd100 0x7ff6c40cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.641+0000 7ff6c359e700 1 -- 172.21.15.112:0/36597792 >> 172.21.15.112:0/36597792 conn(0x7ff6c406d2a0 msgr2=0x7ff6c40b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:12.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.641+0000 7ff6c359e700 1 -- 172.21.15.112:0/36597792 shutdown_connections 2023-10-06T04:40:12.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.641+0000 7ff6c359e700 1 -- 172.21.15.112:0/36597792 wait complete. 2023-10-06T04:40:12.654 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:40:12.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.767+0000 7f4f59f1e700 1 Processor -- start 2023-10-06T04:40:12.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.767+0000 7f4f59f1e700 1 -- start start 2023-10-06T04:40:12.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.768+0000 7f4f59f1e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f54159d50 0x7f4f540b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.768+0000 7f4f59f1e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f540cd740 con 0x7f4f5415a120 2023-10-06T04:40:12.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.768+0000 7f4f59f1e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f540ccb30 con 0x7f4f540b0e70 2023-10-06T04:40:12.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.768+0000 7f4f59f1e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f540cce10 con 0x7f4f54159d50 2023-10-06T04:40:12.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.768+0000 7f4f4affd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4f5415a120 0x7f4f540cdbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48364/0 (socket says 172.21.15.112:48364) 2023-10-06T04:40:12.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.768+0000 7f4f4affd700 1 -- 172.21.15.112:0/2629347250 learned_addr learned my addr 172.21.15.112:0/2629347250 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:12.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.768+0000 7f4f537fe700 1 --2- 172.21.15.112:0/2629347250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f54159d50 0x7f4f540b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.768+0000 7f4f52ffd700 1 -- 172.21.15.112:0/2629347250 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890181944 0 0) 0x7f4f540cd740 con 0x7f4f5415a120 2023-10-06T04:40:12.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.768+0000 7f4f52ffd700 1 -- 172.21.15.112:0/2629347250 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f40003570 con 0x7f4f5415a120 2023-10-06T04:40:12.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.768+0000 7f4f52ffd700 1 -- 172.21.15.112:0/2629347250 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846114670 0 0) 0x7f4f540ccb30 con 0x7f4f540b0e70 2023-10-06T04:40:12.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.768+0000 7f4f52ffd700 1 -- 172.21.15.112:0/2629347250 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f540cd740 con 0x7f4f540b0e70 2023-10-06T04:40:12.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.768+0000 7f4f52ffd700 1 -- 172.21.15.112:0/2629347250 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 136343012 0 0) 0x7f4f40003570 con 0x7f4f5415a120 2023-10-06T04:40:12.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.768+0000 7f4f52ffd700 1 -- 172.21.15.112:0/2629347250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f54159d50 msgr2=0x7f4f540b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:12.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.768+0000 7f4f52ffd700 1 --2- 172.21.15.112:0/2629347250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f54159d50 0x7f4f540b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.768+0000 7f4f52ffd700 1 -- 172.21.15.112:0/2629347250 >> v1:172.21.15.179:6789/0 conn(0x7f4f540b0e70 legacy=0x7f4f5406db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.768+0000 7f4f52ffd700 1 -- 172.21.15.112:0/2629347250 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f540cd0f0 con 0x7f4f5415a120 2023-10-06T04:40:12.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.768+0000 7f4f52ffd700 1 -- 172.21.15.112:0/2629347250 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f4f3c001470 con 0x7f4f5415a120 2023-10-06T04:40:12.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.768+0000 7f4f537fe700 1 --2- 172.21.15.112:0/2629347250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f54159d50 0x7f4f540b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:12.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.768+0000 7f4f52ffd700 1 -- 172.21.15.112:0/2629347250 >> v1:172.21.15.112:6789/0 conn(0x7f4f5415a120 legacy=0x7f4f540cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.768+0000 7f4f52ffd700 1 --2- 172.21.15.112:0/2629347250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f40003c20 0x7f4f40004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.769+0000 7f4f52ffd700 1 --2- 172.21.15.112:0/2629347250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f54159d50 0x7f4f40004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.769+0000 7f4f52ffd700 1 --2- 172.21.15.112:0/2629347250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f40004d50 0x7f4f400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.769+0000 7f4f52ffd700 1 -- 172.21.15.112:0/2629347250 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f540cce10 con 0x7f4f40003c20 2023-10-06T04:40:12.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.769+0000 7f4f52ffd700 1 -- 172.21.15.112:0/2629347250 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4000bb70 con 0x7f4f40004d50 2023-10-06T04:40:12.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.769+0000 7f4f52ffd700 1 -- 172.21.15.112:0/2629347250 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4000bd30 con 0x7f4f54159d50 2023-10-06T04:40:12.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.769+0000 7f4f537fe700 1 --2- 172.21.15.112:0/2629347250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f40003c20 0x7f4f40004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.769+0000 7f4f4affd700 1 --2- 172.21.15.112:0/2629347250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f54159d50 0x7f4f40004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.769+0000 7f4f53fff700 1 --2- 172.21.15.112:0/2629347250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f40004d50 0x7f4f400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.769+0000 7f4f537fe700 1 -- 172.21.15.112:0/2629347250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f54159d50 msgr2=0x7f4f40004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:12.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.769+0000 7f4f537fe700 1 --2- 172.21.15.112:0/2629347250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f54159d50 0x7f4f40004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.769+0000 7f4f537fe700 1 -- 172.21.15.112:0/2629347250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f40004d50 msgr2=0x7f4f400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:12.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.769+0000 7f4f537fe700 1 --2- 172.21.15.112:0/2629347250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f40004d50 0x7f4f400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.769+0000 7f4f537fe700 1 -- 172.21.15.112:0/2629347250 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f44009420 con 0x7f4f40003c20 2023-10-06T04:40:12.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.769+0000 7f4f4affd700 1 --2- 172.21.15.112:0/2629347250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f54159d50 0x7f4f40004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:12.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.769+0000 7f4f537fe700 1 --2- 172.21.15.112:0/2629347250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f40003c20 0x7f4f40004010 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009df0 tx=0x7f4f440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=674490ff70065a87 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:12.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.769+0000 7f4f52ffd700 1 -- 172.21.15.112:0/2629347250 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f44009740 con 0x7f4f40003c20 2023-10-06T04:40:12.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.769+0000 7f4f52ffd700 1 -- 172.21.15.112:0/2629347250 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4400e920 con 0x7f4f40003c20 2023-10-06T04:40:12.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.769+0000 7f4f52ffd700 1 -- 172.21.15.112:0/2629347250 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4400ece0 con 0x7f4f40003c20 2023-10-06T04:40:12.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.770+0000 7f4f59f1e700 1 -- 172.21.15.112:0/2629347250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f40003c20 msgr2=0x7f4f40004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.770+0000 7f4f59f1e700 1 --2- 172.21.15.112:0/2629347250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f40003c20 0x7f4f40004010 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009df0 tx=0x7f4f440091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.770+0000 7f4f53fff700 1 -- 172.21.15.112:0/2629347250 reap_dead start 2023-10-06T04:40:12.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.770+0000 7f4f59f1e700 1 -- 172.21.15.112:0/2629347250 shutdown_connections 2023-10-06T04:40:12.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.770+0000 7f4f59f1e700 1 -- 172.21.15.112:0/2629347250 >> 172.21.15.112:0/2629347250 conn(0x7f4f54099b60 msgr2=0x7f4f5406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:12.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.770+0000 7f4f59f1e700 1 -- 172.21.15.112:0/2629347250 shutdown_connections 2023-10-06T04:40:12.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.770+0000 7f4f59f1e700 1 -- 172.21.15.112:0/2629347250 wait complete. 2023-10-06T04:40:12.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.771+0000 7f4f59f1e700 1 Processor -- start 2023-10-06T04:40:12.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.771+0000 7f4f59f1e700 1 -- start start 2023-10-06T04:40:12.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f59f1e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f40003c20 0x7f4f54158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f59f1e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f5409d580 0x7f4f54153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f59f1e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f5409aa30 0x7f4f5409ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f59f1e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f54158a50 con 0x7f4f5409d580 2023-10-06T04:40:12.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f59f1e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5409edc0 con 0x7f4f40003c20 2023-10-06T04:40:12.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f59f1e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5409b3c0 con 0x7f4f5409aa30 2023-10-06T04:40:12.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f4affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f5409d580 0x7f4f54153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f4affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f5409d580 0x7f4f54153a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60604/0 (socket says 172.21.15.112:60604) 2023-10-06T04:40:12.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f4affd700 1 -- 172.21.15.112:0/3623268855 learned_addr learned my addr 172.21.15.112:0/3623268855 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:12.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f537fe700 1 --2- 172.21.15.112:0/3623268855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f40003c20 0x7f4f54158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f53fff700 1 --2- 172.21.15.112:0/3623268855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f5409aa30 0x7f4f5409ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f4affd700 1 -- 172.21.15.112:0/3623268855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f5409aa30 msgr2=0x7f4f5409ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f4affd700 1 --2- 172.21.15.112:0/3623268855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f5409aa30 0x7f4f5409ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f4affd700 1 -- 172.21.15.112:0/3623268855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f40003c20 msgr2=0x7f4f54158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:12.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f4affd700 1 --2- 172.21.15.112:0/3623268855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f40003c20 0x7f4f54158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:12.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f4affd700 1 -- 172.21.15.112:0/3623268855 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5409dce0 con 0x7f4f5409d580 2023-10-06T04:40:12.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f537fe700 1 --2- 172.21.15.112:0/3623268855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f40003c20 0x7f4f54158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:12.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f4affd700 1 --2- 172.21.15.112:0/3623268855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f5409d580 0x7f4f54153a50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c00e850 tx=0x7f4f3c001d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:12.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f4bfff700 1 -- 172.21.15.112:0/3623268855 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c00c600 con 0x7f4f5409d580 2023-10-06T04:40:12.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f4bfff700 1 -- 172.21.15.112:0/3623268855 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3c00c760 con 0x7f4f5409d580 2023-10-06T04:40:12.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f59f1e700 1 -- 172.21.15.112:0/3623268855 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5409dfc0 con 0x7f4f5409d580 2023-10-06T04:40:12.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.772+0000 7f4f4bfff700 1 -- 172.21.15.112:0/3623268855 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c00cb00 con 0x7f4f5409d580 2023-10-06T04:40:12.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.773+0000 7f4f59f1e700 1 -- 172.21.15.112:0/3623268855 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5409d9f0 con 0x7f4f5409d580 2023-10-06T04:40:12.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.773+0000 7f4f59f1e700 1 -- 172.21.15.112:0/3623268855 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5409ef70 con 0x7f4f5409d580 2023-10-06T04:40:12.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.774+0000 7f4f4bfff700 1 -- 172.21.15.112:0/3623268855 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f3c01d460 con 0x7f4f5409d580 2023-10-06T04:40:12.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.774+0000 7f4f4bfff700 1 --2- 172.21.15.112:0/3623268855 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4f34066f30 0x7f4f340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:12.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.774+0000 7f4f4bfff700 1 -- 172.21.15.112:0/3623268855 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4f3c0845e0 con 0x7f4f5409d580 2023-10-06T04:40:12.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.774+0000 7f4f537fe700 1 --2- 172.21.15.112:0/3623268855 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4f34066f30 0x7f4f340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:12.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.775+0000 7f4f537fe700 1 --2- 172.21.15.112:0/3623268855 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4f34066f30 0x7f4f340693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4f440093f0 tx=0x7f4f4401a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:12.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:12.778+0000 7f4f4bfff700 1 -- 172.21.15.112:0/3623268855 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f5409ef70 con 0x7f4f5409d580 2023-10-06T04:40:13.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.004+0000 7f4f59f1e700 1 -- 172.21.15.112:0/3623268855 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4f5409ef70 con 0x7f4f5409d580 2023-10-06T04:40:13.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.004+0000 7f4f4bfff700 1 -- 172.21.15.112:0/3623268855 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4f5409ef70 con 0x7f4f5409d580 2023-10-06T04:40:13.005 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:40:13.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.006+0000 7f4f59f1e700 1 -- 172.21.15.112:0/3623268855 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4f34066f30 msgr2=0x7f4f340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.006+0000 7f4f59f1e700 1 --2- 172.21.15.112:0/3623268855 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4f34066f30 0x7f4f340693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4f440093f0 tx=0x7f4f4401a000 comp rx=0 tx=0).stop 2023-10-06T04:40:13.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.006+0000 7f4f59f1e700 1 -- 172.21.15.112:0/3623268855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f5409d580 msgr2=0x7f4f54153a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.006+0000 7f4f59f1e700 1 --2- 172.21.15.112:0/3623268855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f5409d580 0x7f4f54153a50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c00e850 tx=0x7f4f3c001d10 comp rx=0 tx=0).stop 2023-10-06T04:40:13.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.006+0000 7f4f59f1e700 1 -- 172.21.15.112:0/3623268855 shutdown_connections 2023-10-06T04:40:13.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.006+0000 7f4f59f1e700 1 --2- 172.21.15.112:0/3623268855 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4f34066f30 0x7f4f340693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.006+0000 7f4f59f1e700 1 --2- 172.21.15.112:0/3623268855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f5409aa30 0x7f4f5409ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.006+0000 7f4f59f1e700 1 --2- 172.21.15.112:0/3623268855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f40003c20 0x7f4f54158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.006+0000 7f4f59f1e700 1 --2- 172.21.15.112:0/3623268855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f5409d580 0x7f4f54153a50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.006+0000 7f4f59f1e700 1 -- 172.21.15.112:0/3623268855 >> 172.21.15.112:0/3623268855 conn(0x7f4f54099b60 msgr2=0x7f4f540b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:13.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.006+0000 7f4f59f1e700 1 -- 172.21.15.112:0/3623268855 shutdown_connections 2023-10-06T04:40:13.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.006+0000 7f4f59f1e700 1 -- 172.21.15.112:0/3623268855 wait complete. 2023-10-06T04:40:13.019 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T04:40:13.019 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:40:13.019 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-10-06T04:40:13.019 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T04:40:13.020 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T04:40:13.020 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T04:40:13.020 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T04:40:13.020 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:40:13.020 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:40:13.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:13.020 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-10-06T04:40:13.035 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:40:13.035 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:40:13.035 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:40:13.035 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:13.037 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-10-06T04:40:13.037 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:13.037 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:40:13.037 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:13.037 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2023-10-06T04:40:13.037 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:40:13.037 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:13.037 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2023-10-06T04:40:13.038 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:40:13.038 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:13.038 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:40:13.038 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:13.038 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T04:40:13.038 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42461sec preferred_lft 42461sec 2023-10-06T04:40:13.038 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2023-10-06T04:40:13.038 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:13.038 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:40:13.038 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 2e:bd:21:e7:e6:0e brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:13.038 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:40:13.038 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:13.039 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c08a:26ff:fea3:da8e/64 scope link 2023-10-06T04:40:13.039 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:13.039 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:40:13.039 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether ca:d2:a2:df:0f:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:40:13.039 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c8d2:a2ff:fedf:fa2/64 scope link 2023-10-06T04:40:13.039 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:13.039 INFO:teuthology.orchestra.run.smithi112.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:40:13.039 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 2e:bd:21:e7:e6:0e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:40:13.039 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::2cbd:21ff:fee7:e60e/64 scope link 2023-10-06T04:40:13.039 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:13.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:13.040 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:40:13.098 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-10-06T04:40:13.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:13.099 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-10-06T04:40:13.154 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-10-06T04:40:13.155 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:40:13.155 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:40:13.155 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T04:40:13.155 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:40:13.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:13.155 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-10-06T04:40:13.155 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-10-06T04:40:13.155 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:40:13.156 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:40:13.156 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:40:13.156 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-10-06T04:40:13.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:13.255 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-10-06T04:40:13.270 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T04:40:13.270 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:40:13.270 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:40:13.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:13.270 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2023-10-06T04:40:13.335 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:40:13.335 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T04:40:13.389 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:40:13.390 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:40:13.390 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:40:13.444 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T04:40:13.445 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:40:13.445 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:40:13.524 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:40:13.525 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:40:13.525 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2023-10-06T04:40:13.533 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:40:13.533 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:40:13.533 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2023-10-06T04:40:13.533 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-06T04:40:13.533 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:40:13.556 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:40:13.556 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:40:13.556 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2023-10-06T04:40:13.556 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-06T04:40:13.556 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:40:13.557 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:6789,172.21.15.179:6789,172.21.15.179:6790" 2023-10-06T04:40:13.557 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.112:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2023-10-06T04:40:13.557 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3e2b8a43-6e3c-475a-8b31-8dbcc20d6445" will pass to kernel 2023-10-06T04:40:13.558 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:40:13.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:13.558 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:40:13.623 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:40:13.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.777+0000 7f99de927700 1 Processor -- start 2023-10-06T04:40:13.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.777+0000 7f99de927700 1 -- start start 2023-10-06T04:40:13.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.778+0000 7f99de927700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f99d80b3040 0x7f99d80cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.778+0000 7f99de927700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d80cd740 con 0x7f99d80b0e70 2023-10-06T04:40:13.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.778+0000 7f99de927700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d80ccb30 con 0x7f99d8159d50 2023-10-06T04:40:13.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.778+0000 7f99de927700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d80b3490 con 0x7f99d80b3040 2023-10-06T04:40:13.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.778+0000 7f99d77fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f99d80b3040 0x7f99d80cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.778+0000 7f99dcec4700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f99d80b0e70 0x7f99d80b1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48374/0 (socket says 172.21.15.112:48374) 2023-10-06T04:40:13.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.778+0000 7f99d77fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f99d80b3040 0x7f99d80cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60612/0 (socket says 172.21.15.112:60612) 2023-10-06T04:40:13.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.778+0000 7f99dcec4700 1 -- 172.21.15.112:0/3576286777 learned_addr learned my addr 172.21.15.112:0/3576286777 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:13.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.778+0000 7f99d77fe700 1 -- 172.21.15.112:0/3576286777 >> v1:172.21.15.179:6789/0 conn(0x7f99d8159d50 legacy=0x7f99d815a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:13.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.778+0000 7f99d6ffd700 1 -- 172.21.15.112:0/3576286777 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1118979905 0 0) 0x7f99d80cd740 con 0x7f99d80b0e70 2023-10-06T04:40:13.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.778+0000 7f99d77fe700 1 -- 172.21.15.112:0/3576286777 >> v1:172.21.15.112:6789/0 conn(0x7f99d80b0e70 legacy=0x7f99d80b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.778+0000 7f99d77fe700 1 -- 172.21.15.112:0/3576286777 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d80cce10 con 0x7f99d80b3040 2023-10-06T04:40:13.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.779+0000 7f99d77fe700 1 --2- 172.21.15.112:0/3576286777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d80b3040 0x7f99d80cdbd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0098e0 tx=0x7f99cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44aac30f3b2e5c5e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:13.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.779+0000 7f99d6ffd700 1 -- 172.21.15.112:0/3576286777 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc009e80 con 0x7f99d80b3040 2023-10-06T04:40:13.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.779+0000 7f99d6ffd700 1 -- 172.21.15.112:0/3576286777 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc00b860 con 0x7f99d80b3040 2023-10-06T04:40:13.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.779+0000 7f99d6ffd700 1 -- 172.21.15.112:0/3576286777 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc00bbe0 con 0x7f99d80b3040 2023-10-06T04:40:13.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.779+0000 7f99de927700 1 -- 172.21.15.112:0/3576286777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d80b3040 msgr2=0x7f99d80cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.779+0000 7f99de927700 1 --2- 172.21.15.112:0/3576286777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d80b3040 0x7f99d80cdbd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0098e0 tx=0x7f99cc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.779+0000 7f99de927700 1 -- 172.21.15.112:0/3576286777 shutdown_connections 2023-10-06T04:40:13.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.779+0000 7f99de927700 1 --2- 172.21.15.112:0/3576286777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d80b3040 0x7f99d80cdbd0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.779+0000 7f99de927700 1 -- 172.21.15.112:0/3576286777 >> 172.21.15.112:0/3576286777 conn(0x7f99d8099b60 msgr2=0x7f99d806cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:13.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.779+0000 7f99de927700 1 -- 172.21.15.112:0/3576286777 shutdown_connections 2023-10-06T04:40:13.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.779+0000 7f99de927700 1 -- 172.21.15.112:0/3576286777 wait complete. 2023-10-06T04:40:13.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.780+0000 7f99de927700 1 Processor -- start 2023-10-06T04:40:13.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.780+0000 7f99de927700 1 -- start start 2023-10-06T04:40:13.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.781+0000 7f99de927700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d80b0e70 0x7f99d8149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.781+0000 7f99de927700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99d80b3040 0x7f99d80b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.781+0000 7f99de927700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99d8159d50 0x7f99d80b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.781+0000 7f99de927700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d80b68c0 con 0x7f99d80b0e70 2023-10-06T04:40:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.781+0000 7f99de927700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d815c7f0 con 0x7f99d8159d50 2023-10-06T04:40:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.781+0000 7f99de927700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d8156380 con 0x7f99d80b3040 2023-10-06T04:40:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.781+0000 7f99d7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d80b0e70 0x7f99d8149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.781+0000 7f99d7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d80b0e70 0x7f99d8149d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60616/0 (socket says 172.21.15.112:60616) 2023-10-06T04:40:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.781+0000 7f99d7fff700 1 -- 172.21.15.112:0/2426884115 learned_addr learned my addr 172.21.15.112:0/2426884115 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.781+0000 7f99d77fe700 1 --2- 172.21.15.112:0/2426884115 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99d80b3040 0x7f99d80b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.781+0000 7f99d7fff700 1 -- 172.21.15.112:0/2426884115 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99d80b3040 msgr2=0x7f99d80b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.781+0000 7f99dcec4700 1 --2- 172.21.15.112:0/2426884115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99d8159d50 0x7f99d80b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.781+0000 7f99d7fff700 1 --2- 172.21.15.112:0/2426884115 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99d80b3040 0x7f99d80b54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.782+0000 7f99d7fff700 1 -- 172.21.15.112:0/2426884115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99d8159d50 msgr2=0x7f99d80b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.782+0000 7f99d7fff700 1 --2- 172.21.15.112:0/2426884115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99d8159d50 0x7f99d80b59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.782+0000 7f99d7fff700 1 -- 172.21.15.112:0/2426884115 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc009420 con 0x7f99d80b0e70 2023-10-06T04:40:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.782+0000 7f99d7fff700 1 --2- 172.21.15.112:0/2426884115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d80b0e70 0x7f99d8149d70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f99c800c5c0 tx=0x7f99c800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.782+0000 7f99bffff700 1 -- 172.21.15.112:0/2426884115 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c8011590 con 0x7f99d80b0e70 2023-10-06T04:40:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.782+0000 7f99bffff700 1 -- 172.21.15.112:0/2426884115 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c8011710 con 0x7f99d80b0e70 2023-10-06T04:40:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.782+0000 7f99bffff700 1 -- 172.21.15.112:0/2426884115 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c8011ad0 con 0x7f99d80b0e70 2023-10-06T04:40:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.782+0000 7f99de927700 1 -- 172.21.15.112:0/2426884115 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d80b6020 con 0x7f99d80b0e70 2023-10-06T04:40:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.782+0000 7f99de927700 1 -- 172.21.15.112:0/2426884115 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d80b65e0 con 0x7f99d80b0e70 2023-10-06T04:40:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.783+0000 7f99de927700 1 -- 172.21.15.112:0/2426884115 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d815c5c0 con 0x7f99d80b0e70 2023-10-06T04:40:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.783+0000 7f99bffff700 1 -- 172.21.15.112:0/2426884115 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99c801b3b0 con 0x7f99d80b0e70 2023-10-06T04:40:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.784+0000 7f99bffff700 1 --2- 172.21.15.112:0/2426884115 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f99c4066f30 0x7f99c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.784+0000 7f99bffff700 1 -- 172.21.15.112:0/2426884115 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f99c8083cb0 con 0x7f99d80b0e70 2023-10-06T04:40:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.784+0000 7f99d77fe700 1 --2- 172.21.15.112:0/2426884115 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f99c4066f30 0x7f99c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.784+0000 7f99d77fe700 1 --2- 172.21.15.112:0/2426884115 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f99c4066f30 0x7f99c40693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f99d80b0300 tx=0x7f99cc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:13.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:13.788+0000 7f99bffff700 1 -- 172.21.15.112:0/2426884115 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99c8050dc0 con 0x7f99d80b0e70 2023-10-06T04:40:14.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.017+0000 7f99de927700 1 -- 172.21.15.112:0/2426884115 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f99d805f230 con 0x7f99d80b0e70 2023-10-06T04:40:14.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.018+0000 7f99bffff700 1 -- 172.21.15.112:0/2426884115 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f99c8017070 con 0x7f99d80b0e70 2023-10-06T04:40:14.019 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:40:14.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.020+0000 7f99de927700 1 -- 172.21.15.112:0/2426884115 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f99c4066f30 msgr2=0x7f99c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:14.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.020+0000 7f99de927700 1 --2- 172.21.15.112:0/2426884115 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f99c4066f30 0x7f99c40693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f99d80b0300 tx=0x7f99cc017000 comp rx=0 tx=0).stop 2023-10-06T04:40:14.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.020+0000 7f99de927700 1 -- 172.21.15.112:0/2426884115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d80b0e70 msgr2=0x7f99d8149d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:14.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.020+0000 7f99de927700 1 --2- 172.21.15.112:0/2426884115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d80b0e70 0x7f99d8149d70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f99c800c5c0 tx=0x7f99c800c980 comp rx=0 tx=0).stop 2023-10-06T04:40:14.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.020+0000 7f99de927700 1 -- 172.21.15.112:0/2426884115 shutdown_connections 2023-10-06T04:40:14.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.020+0000 7f99de927700 1 --2- 172.21.15.112:0/2426884115 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f99c4066f30 0x7f99c40693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:14.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.020+0000 7f99de927700 1 --2- 172.21.15.112:0/2426884115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99d8159d50 0x7f99d80b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:14.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.020+0000 7f99de927700 1 --2- 172.21.15.112:0/2426884115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d80b0e70 0x7f99d8149d70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:14.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.020+0000 7f99de927700 1 --2- 172.21.15.112:0/2426884115 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99d80b3040 0x7f99d80b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:14.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.020+0000 7f99de927700 1 -- 172.21.15.112:0/2426884115 >> 172.21.15.112:0/2426884115 conn(0x7f99d8099b60 msgr2=0x7f99d8156890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:14.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.020+0000 7f99de927700 1 -- 172.21.15.112:0/2426884115 shutdown_connections 2023-10-06T04:40:14.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.020+0000 7f99de927700 1 -- 172.21.15.112:0/2426884115 wait complete. 2023-10-06T04:40:14.033 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T04:40:14.033 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:40:14.033 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-10-06T04:40:14.033 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T04:40:14.033 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T04:40:14.034 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T04:40:14.034 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T04:40:14.034 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:40:14.034 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T04:40:14.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:14.034 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-10-06T04:40:14.054 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:40:14.054 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:40:14.054 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:40:14.054 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:14.055 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-10-06T04:40:14.055 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:14.055 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:40:14.055 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:14.055 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-10-06T04:40:14.055 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:40:14.055 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:14.055 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-10-06T04:40:14.055 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:40:14.055 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:14.055 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:40:14.056 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:14.056 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T04:40:14.056 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42461sec preferred_lft 42461sec 2023-10-06T04:40:14.056 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link noprefixroute 2023-10-06T04:40:14.056 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:14.056 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:40:14.056 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether ca:5a:13:3d:e2:5a brd ff:ff:ff:ff:ff:ff 2023-10-06T04:40:14.056 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:40:14.056 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:14.056 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::9cdd:62ff:fe2b:d5d6/64 scope link 2023-10-06T04:40:14.056 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:14.057 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:40:14.057 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether d2:1e:51:ad:08:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:40:14.057 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::d01e:51ff:fead:800/64 scope link 2023-10-06T04:40:14.057 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:14.057 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:40:14.057 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether ca:5a:13:3d:e2:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T04:40:14.057 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::c85a:13ff:fe3d:e25a/64 scope link 2023-10-06T04:40:14.057 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:40:14.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:14.058 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:40:14.124 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-10-06T04:40:14.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:14.126 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-10-06T04:40:14.185 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-10-06T04:40:14.185 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:40:14.185 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:40:14.185 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T04:40:14.185 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:40:14.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:14.186 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-06T04:40:14.186 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-06T04:40:14.186 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:40:14.186 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:40:14.186 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:40:14.186 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-06T04:40:14.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:14.291 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-10-06T04:40:14.306 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T04:40:14.307 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T04:40:14.307 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T04:40:14.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:14.307 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-10-06T04:40:14.372 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:40:14.372 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T04:40:14.427 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T04:40:14.427 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:40:14.428 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T04:40:14.483 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T04:40:14.483 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:40:14.483 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T04:40:14.563 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T04:40:14.563 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T04:40:14.564 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2023-10-06T04:40:14.571 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T04:40:14.571 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T04:40:14.572 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2023-10-06T04:40:14.572 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-06T04:40:14.572 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:40:14.593 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T04:40:14.593 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T04:40:14.594 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2023-10-06T04:40:14.594 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-06T04:40:14.594 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:40:14.594 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.112:6789,172.21.15.179:6789,172.21.15.179:6790" 2023-10-06T04:40:14.594 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.112:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2023-10-06T04:40:14.594 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=3e2b8a43-6e3c-475a-8b31-8dbcc20d6445" will pass to kernel 2023-10-06T04:40:14.596 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:40:14.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:14.596 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T04:40:14.659 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-06T04:40:14.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.777+0000 7f1966330700 1 Processor -- start 2023-10-06T04:40:14.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.777+0000 7f1966330700 1 -- start start 2023-10-06T04:40:14.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.778+0000 7f1966330700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1960159a20 0x7f19600cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:14.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.778+0000 7f1966330700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f196006d3b0 0x7f19600cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:14.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.778+0000 7f1966330700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f196015a9f0 0x7f196015d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:14.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.778+0000 7f1966330700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19600cca70 con 0x7f196015a9f0 2023-10-06T04:40:14.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.778+0000 7f1966330700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196008a080 con 0x7f1960159a20 2023-10-06T04:40:14.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.778+0000 7f1966330700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196015af50 con 0x7f196006d3b0 2023-10-06T04:40:14.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.778+0000 7f19648cd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f196015a9f0 0x7f196015d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:14.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.778+0000 7f19648cd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f196015a9f0 0x7f196015d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60628/0 (socket says 172.21.15.112:60628) 2023-10-06T04:40:14.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.778+0000 7f19648cd700 1 -- 172.21.15.112:0/41608121 learned_addr learned my addr 172.21.15.112:0/41608121 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:14.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.778+0000 7f195f7fe700 1 --2- 172.21.15.112:0/41608121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f196006d3b0 0x7f19600cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:14.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.778+0000 7f195ffff700 1 --2- 172.21.15.112:0/41608121 >> v2:172.21.15.179:3300/0 conn(0x7f1960159a20 0x7f19600cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:14.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.778+0000 7f19648cd700 1 -- 172.21.15.112:0/41608121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f196006d3b0 msgr2=0x7f19600cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:14.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.778+0000 7f19648cd700 1 --2- 172.21.15.112:0/41608121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f196006d3b0 0x7f19600cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:14.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.778+0000 7f19648cd700 1 -- 172.21.15.112:0/41608121 >> v2:172.21.15.179:3300/0 conn(0x7f1960159a20 msgr2=0x7f19600cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:14.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.778+0000 7f19648cd700 1 --2- 172.21.15.112:0/41608121 >> v2:172.21.15.179:3300/0 conn(0x7f1960159a20 0x7f19600cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:14.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.778+0000 7f19648cd700 1 -- 172.21.15.112:0/41608121 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19600cae50 con 0x7f196015a9f0 2023-10-06T04:40:14.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.778+0000 7f195ffff700 1 --2- 172.21.15.112:0/41608121 >> v2:172.21.15.179:3300/0 conn(0x7f1960159a20 0x7f19600cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:14.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.778+0000 7f19648cd700 1 --2- 172.21.15.112:0/41608121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f196015a9f0 0x7f196015d550 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1960088260 tx=0x7f1958009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37586f6440c9026 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:14.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.778+0000 7f195effd700 1 -- 172.21.15.112:0/41608121 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195800e070 con 0x7f196015a9f0 2023-10-06T04:40:14.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.779+0000 7f195effd700 1 -- 172.21.15.112:0/41608121 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195800ba40 con 0x7f196015a9f0 2023-10-06T04:40:14.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.779+0000 7f195effd700 1 -- 172.21.15.112:0/41608121 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19580092e0 con 0x7f196015a9f0 2023-10-06T04:40:14.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.779+0000 7f1966330700 1 -- 172.21.15.112:0/41608121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f196015a9f0 msgr2=0x7f196015d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:14.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.779+0000 7f1966330700 1 --2- 172.21.15.112:0/41608121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f196015a9f0 0x7f196015d550 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1960088260 tx=0x7f1958009840 comp rx=0 tx=0).stop 2023-10-06T04:40:14.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.779+0000 7f1966330700 1 -- 172.21.15.112:0/41608121 shutdown_connections 2023-10-06T04:40:14.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.779+0000 7f1966330700 1 --2- 172.21.15.112:0/41608121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f196015a9f0 0x7f196015d550 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:14.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.779+0000 7f1966330700 1 --2- 172.21.15.112:0/41608121 >> v2:172.21.15.179:3300/0 conn(0x7f1960159a20 0x7f19600cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:14.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.779+0000 7f1966330700 1 --2- 172.21.15.112:0/41608121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f196006d3b0 0x7f19600cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:14.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.779+0000 7f1966330700 1 -- 172.21.15.112:0/41608121 >> 172.21.15.112:0/41608121 conn(0x7f196006cfb0 msgr2=0x7f19600d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:14.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.779+0000 7f1966330700 1 -- 172.21.15.112:0/41608121 shutdown_connections 2023-10-06T04:40:14.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.779+0000 7f1966330700 1 -- 172.21.15.112:0/41608121 wait complete. 2023-10-06T04:40:14.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.780+0000 7f1966330700 1 Processor -- start 2023-10-06T04:40:14.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.780+0000 7f1966330700 1 -- start start 2023-10-06T04:40:14.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.781+0000 7f1966330700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f196006d3b0 0x7f19600b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:14.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.781+0000 7f1966330700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1960159a20 0x7f196014a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:14.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.781+0000 7f1966330700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f196015a9f0 0x7f196014aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:14.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.781+0000 7f1966330700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19600b3220 con 0x7f196006d3b0 2023-10-06T04:40:14.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.781+0000 7f1966330700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19600b0fa0 con 0x7f196015a9f0 2023-10-06T04:40:14.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.781+0000 7f1966330700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19600b1970 con 0x7f1960159a20 2023-10-06T04:40:14.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.781+0000 7f195ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f196006d3b0 0x7f19600b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:14.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.781+0000 7f195ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f196006d3b0 0x7f19600b1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60632/0 (socket says 172.21.15.112:60632) 2023-10-06T04:40:14.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.781+0000 7f195ffff700 1 -- 172.21.15.112:0/1972527310 learned_addr learned my addr 172.21.15.112:0/1972527310 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:14.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.781+0000 7f195f7fe700 1 --2- 172.21.15.112:0/1972527310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1960159a20 0x7f196014a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:14.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.781+0000 7f19648cd700 1 --2- 172.21.15.112:0/1972527310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f196015a9f0 0x7f196014aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:14.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.781+0000 7f195ffff700 1 -- 172.21.15.112:0/1972527310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1960159a20 msgr2=0x7f196014a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:14.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.781+0000 7f195ffff700 1 --2- 172.21.15.112:0/1972527310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1960159a20 0x7f196014a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:14.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.781+0000 7f195ffff700 1 -- 172.21.15.112:0/1972527310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f196015a9f0 msgr2=0x7f196014aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:14.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.781+0000 7f195ffff700 1 --2- 172.21.15.112:0/1972527310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f196015a9f0 0x7f196014aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:14.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.781+0000 7f195ffff700 1 -- 172.21.15.112:0/1972527310 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1958009ae0 con 0x7f196006d3b0 2023-10-06T04:40:14.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.782+0000 7f195ffff700 1 --2- 172.21.15.112:0/1972527310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f196006d3b0 0x7f19600b1430 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f195000e8d0 tx=0x7f1950008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:14.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.782+0000 7f1947fff700 1 -- 172.21.15.112:0/1972527310 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1950013410 con 0x7f196006d3b0 2023-10-06T04:40:14.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.782+0000 7f1947fff700 1 -- 172.21.15.112:0/1972527310 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1950013570 con 0x7f196006d3b0 2023-10-06T04:40:14.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.782+0000 7f1966330700 1 -- 172.21.15.112:0/1972527310 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19600cfb60 con 0x7f196006d3b0 2023-10-06T04:40:14.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.782+0000 7f1947fff700 1 -- 172.21.15.112:0/1972527310 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1950013910 con 0x7f196006d3b0 2023-10-06T04:40:14.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.782+0000 7f1966330700 1 -- 172.21.15.112:0/1972527310 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19600b0c30 con 0x7f196006d3b0 2023-10-06T04:40:14.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.783+0000 7f1966330700 1 -- 172.21.15.112:0/1972527310 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196005f230 con 0x7f196006d3b0 2023-10-06T04:40:14.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.783+0000 7f1947fff700 1 -- 172.21.15.112:0/1972527310 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1950013d00 con 0x7f196006d3b0 2023-10-06T04:40:14.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.783+0000 7f1947fff700 1 --2- 172.21.15.112:0/1972527310 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f194c066f30 0x7f194c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:14.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.783+0000 7f1947fff700 1 -- 172.21.15.112:0/1972527310 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f19500843b0 con 0x7f196006d3b0 2023-10-06T04:40:14.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.783+0000 7f195f7fe700 1 --2- 172.21.15.112:0/1972527310 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f194c066f30 0x7f194c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:14.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.784+0000 7f195f7fe700 1 --2- 172.21.15.112:0/1972527310 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f194c066f30 0x7f194c0693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f19601513d0 tx=0x7f1954008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:14.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:14.788+0000 7f1947fff700 1 -- 172.21.15.112:0/1972527310 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19500514c0 con 0x7f196006d3b0 2023-10-06T04:40:15.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:15.020+0000 7f1966330700 1 -- 172.21.15.112:0/1972527310 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f19600cb0f0 con 0x7f196006d3b0 2023-10-06T04:40:15.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:15.899+0000 7f1947fff700 1 -- 172.21.15.112:0/1972527310 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 136+0+0 (secure 0 0 0) 0x7f1950054ae0 con 0x7f196006d3b0 2023-10-06T04:40:15.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:15.902+0000 7f1966330700 1 -- 172.21.15.112:0/1972527310 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f194c066f30 msgr2=0x7f194c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:15.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:15.902+0000 7f1966330700 1 --2- 172.21.15.112:0/1972527310 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f194c066f30 0x7f194c0693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f19601513d0 tx=0x7f1954008040 comp rx=0 tx=0).stop 2023-10-06T04:40:15.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:15.902+0000 7f1966330700 1 -- 172.21.15.112:0/1972527310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f196006d3b0 msgr2=0x7f19600b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:15.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:15.902+0000 7f1966330700 1 --2- 172.21.15.112:0/1972527310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f196006d3b0 0x7f19600b1430 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f195000e8d0 tx=0x7f1950008040 comp rx=0 tx=0).stop 2023-10-06T04:40:15.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:15.902+0000 7f1966330700 1 -- 172.21.15.112:0/1972527310 shutdown_connections 2023-10-06T04:40:15.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:15.902+0000 7f1966330700 1 --2- 172.21.15.112:0/1972527310 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f194c066f30 0x7f194c0693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:15.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:15.902+0000 7f1966330700 1 --2- 172.21.15.112:0/1972527310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f196015a9f0 0x7f196014aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:15.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:15.902+0000 7f1966330700 1 --2- 172.21.15.112:0/1972527310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f196006d3b0 0x7f19600b1430 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:15.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:15.902+0000 7f1966330700 1 --2- 172.21.15.112:0/1972527310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1960159a20 0x7f196014a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:15.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:15.902+0000 7f1966330700 1 -- 172.21.15.112:0/1972527310 >> 172.21.15.112:0/1972527310 conn(0x7f196006cfb0 msgr2=0x7f19600ad960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:15.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:15.902+0000 7f1966330700 1 -- 172.21.15.112:0/1972527310 shutdown_connections 2023-10-06T04:40:15.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:15.902+0000 7f1966330700 1 -- 172.21.15.112:0/1972527310 wait complete. 2023-10-06T04:40:15.916 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-06T04:40:16.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.030+0000 7fe7e2471700 1 Processor -- start 2023-10-06T04:40:16.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.030+0000 7fe7e2471700 1 -- start start 2023-10-06T04:40:16.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.031+0000 7fe7e2471700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7dc15cd20 0x7fe7dc0ad870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.031+0000 7fe7e2471700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe7dc0d1410 0x7fe7dc0addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.031+0000 7fe7e2471700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe7dc0d0350 0x7fe7dc0cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.031+0000 7fe7e2471700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7dc0cf2c0 con 0x7fe7dc0d0350 2023-10-06T04:40:16.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.031+0000 7fe7e2471700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7dc0cecb0 con 0x7fe7dc0d1410 2023-10-06T04:40:16.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.031+0000 7fe7e2471700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc0cbfc0 con 0x7fe7dc15cd20 2023-10-06T04:40:16.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.031+0000 7fe7e0a0e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe7dc0d0350 0x7fe7dc0cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.031+0000 7fe7e0a0e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe7dc0d0350 0x7fe7dc0cf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60642/0 (socket says 172.21.15.112:60642) 2023-10-06T04:40:16.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.031+0000 7fe7e0a0e700 1 -- 172.21.15.112:0/645410081 learned_addr learned my addr 172.21.15.112:0/645410081 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:16.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.032+0000 7fe7dbfff700 1 --2- 172.21.15.112:0/645410081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7dc15cd20 0x7fe7dc0ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.032+0000 7fe7db7fe700 1 --2- 172.21.15.112:0/645410081 >> v2:172.21.15.179:3300/0 conn(0x7fe7dc0d1410 0x7fe7dc0addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.032+0000 7fe7e0a0e700 1 -- 172.21.15.112:0/645410081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7dc15cd20 msgr2=0x7fe7dc0ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:16.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.032+0000 7fe7e0a0e700 1 --2- 172.21.15.112:0/645410081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7dc15cd20 0x7fe7dc0ad870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.032+0000 7fe7e0a0e700 1 -- 172.21.15.112:0/645410081 >> v2:172.21.15.179:3300/0 conn(0x7fe7dc0d1410 msgr2=0x7fe7dc0addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:16.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.032+0000 7fe7e0a0e700 1 --2- 172.21.15.112:0/645410081 >> v2:172.21.15.179:3300/0 conn(0x7fe7dc0d1410 0x7fe7dc0addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.032+0000 7fe7e0a0e700 1 -- 172.21.15.112:0/645410081 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc0cef50 con 0x7fe7dc0d0350 2023-10-06T04:40:16.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.032+0000 7fe7dbfff700 1 --2- 172.21.15.112:0/645410081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7dc15cd20 0x7fe7dc0ad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:16.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.032+0000 7fe7e0a0e700 1 --2- 172.21.15.112:0/645410081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7dc0d0350 0x7fe7dc0cf750 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc089430 tx=0x7fe7d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744a3ae6199a7803 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:16.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.032+0000 7fe7daffd700 1 -- 172.21.15.112:0/645410081 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d400e070 con 0x7fe7dc0d0350 2023-10-06T04:40:16.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.032+0000 7fe7daffd700 1 -- 172.21.15.112:0/645410081 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d400ba20 con 0x7fe7dc0d0350 2023-10-06T04:40:16.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.032+0000 7fe7daffd700 1 -- 172.21.15.112:0/645410081 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d40092e0 con 0x7fe7dc0d0350 2023-10-06T04:40:16.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.032+0000 7fe7e2471700 1 -- 172.21.15.112:0/645410081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7dc0d0350 msgr2=0x7fe7dc0cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.032+0000 7fe7e2471700 1 --2- 172.21.15.112:0/645410081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7dc0d0350 0x7fe7dc0cf750 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc089430 tx=0x7fe7d4009840 comp rx=0 tx=0).stop 2023-10-06T04:40:16.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.033+0000 7fe7e2471700 1 -- 172.21.15.112:0/645410081 shutdown_connections 2023-10-06T04:40:16.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.033+0000 7fe7e2471700 1 --2- 172.21.15.112:0/645410081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7dc15cd20 0x7fe7dc0ad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.033+0000 7fe7e2471700 1 --2- 172.21.15.112:0/645410081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7dc0d0350 0x7fe7dc0cf750 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.033+0000 7fe7e2471700 1 --2- 172.21.15.112:0/645410081 >> v2:172.21.15.179:3300/0 conn(0x7fe7dc0d1410 0x7fe7dc0addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.033+0000 7fe7e2471700 1 -- 172.21.15.112:0/645410081 >> 172.21.15.112:0/645410081 conn(0x7fe7dc06cfb0 msgr2=0x7fe7dc0d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:16.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.033+0000 7fe7e2471700 1 -- 172.21.15.112:0/645410081 shutdown_connections 2023-10-06T04:40:16.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.033+0000 7fe7e2471700 1 -- 172.21.15.112:0/645410081 wait complete. 2023-10-06T04:40:16.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.034+0000 7fe7e2471700 1 Processor -- start 2023-10-06T04:40:16.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.034+0000 7fe7e2471700 1 -- start start 2023-10-06T04:40:16.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7e2471700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7dc0d0350 0x7fe7dc145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7e2471700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7dc0d1410 0x7fe7dc06db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7e2471700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7dc15cd20 0x7fe7dc06e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7e2471700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc1553e0 con 0x7fe7dc0d1410 2023-10-06T04:40:16.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7e2471700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc156200 con 0x7fe7dc0d0350 2023-10-06T04:40:16.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7e2471700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc1555f0 con 0x7fe7dc15cd20 2023-10-06T04:40:16.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7db7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7dc0d1410 0x7fe7dc06db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7db7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7dc0d1410 0x7fe7dc06db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60648/0 (socket says 172.21.15.112:60648) 2023-10-06T04:40:16.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7db7fe700 1 -- 172.21.15.112:0/3105953218 learned_addr learned my addr 172.21.15.112:0/3105953218 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:16.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7e0a0e700 1 --2- 172.21.15.112:0/3105953218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7dc15cd20 0x7fe7dc06e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7dbfff700 1 --2- 172.21.15.112:0/3105953218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7dc0d0350 0x7fe7dc145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7db7fe700 1 -- 172.21.15.112:0/3105953218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7dc15cd20 msgr2=0x7fe7dc06e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7db7fe700 1 --2- 172.21.15.112:0/3105953218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7dc15cd20 0x7fe7dc06e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7db7fe700 1 -- 172.21.15.112:0/3105953218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7dc0d0350 msgr2=0x7fe7dc145080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7db7fe700 1 --2- 172.21.15.112:0/3105953218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7dc0d0350 0x7fe7dc145080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7db7fe700 1 -- 172.21.15.112:0/3105953218 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d4009ae0 con 0x7fe7dc0d1410 2023-10-06T04:40:16.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7dbfff700 1 --2- 172.21.15.112:0/3105953218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7dc0d0350 0x7fe7dc145080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:16.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7e0a0e700 1 --2- 172.21.15.112:0/3105953218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7dc15cd20 0x7fe7dc06e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:16.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7db7fe700 1 --2- 172.21.15.112:0/3105953218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7dc0d1410 0x7fe7dc06db00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00ec80 tx=0x7fe7cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:16.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7c3fff700 1 -- 172.21.15.112:0/3105953218 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc00c9d0 con 0x7fe7dc0d1410 2023-10-06T04:40:16.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7c3fff700 1 -- 172.21.15.112:0/3105953218 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc00cb30 con 0x7fe7dc0d1410 2023-10-06T04:40:16.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7c3fff700 1 -- 172.21.15.112:0/3105953218 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc013470 con 0x7fe7dc0d1410 2023-10-06T04:40:16.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7e2471700 1 -- 172.21.15.112:0/3105953218 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7dc1558d0 con 0x7fe7dc0d1410 2023-10-06T04:40:16.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.035+0000 7fe7e2471700 1 -- 172.21.15.112:0/3105953218 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7dc155e90 con 0x7fe7dc0d1410 2023-10-06T04:40:16.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.036+0000 7fe7e2471700 1 -- 172.21.15.112:0/3105953218 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7dc156390 con 0x7fe7dc0d1410 2023-10-06T04:40:16.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.037+0000 7fe7c3fff700 1 -- 172.21.15.112:0/3105953218 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7cc013820 con 0x7fe7dc0d1410 2023-10-06T04:40:16.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.037+0000 7fe7c3fff700 1 --2- 172.21.15.112:0/3105953218 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe7c8066f30 0x7fe7c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.037+0000 7fe7c3fff700 1 -- 172.21.15.112:0/3105953218 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe7cc084a20 con 0x7fe7dc0d1410 2023-10-06T04:40:16.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.037+0000 7fe7dbfff700 1 --2- 172.21.15.112:0/3105953218 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe7c8066f30 0x7fe7c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.037+0000 7fe7dbfff700 1 --2- 172.21.15.112:0/3105953218 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe7c8066f30 0x7fe7c80693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0006f00 tx=0x7fe7d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:16.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.041+0000 7fe7c3fff700 1 -- 172.21.15.112:0/3105953218 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7cc051b30 con 0x7fe7dc0d1410 2023-10-06T04:40:16.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.250+0000 7fe7e2471700 1 -- 172.21.15.112:0/3105953218 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7dc05f230 con 0x7fe7c8066f30 2023-10-06T04:40:16.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.251+0000 7fe7c3fff700 1 -- 172.21.15.112:0/3105953218 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fe7dc05f230 con 0x7fe7c8066f30 2023-10-06T04:40:16.253 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2023-10-06T04:40:16.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:16.253 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "cephfs" 2023-10-06T04:40:16.253 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:16.253 INFO:teuthology.orchestra.run.smithi112.stdout:] 2023-10-06T04:40:16.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.253+0000 7fe7e2471700 1 -- 172.21.15.112:0/3105953218 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe7c8066f30 msgr2=0x7fe7c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.253+0000 7fe7e2471700 1 --2- 172.21.15.112:0/3105953218 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe7c8066f30 0x7fe7c80693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0006f00 tx=0x7fe7d0008040 comp rx=0 tx=0).stop 2023-10-06T04:40:16.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.253+0000 7fe7e2471700 1 -- 172.21.15.112:0/3105953218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7dc0d1410 msgr2=0x7fe7dc06db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.253+0000 7fe7e2471700 1 --2- 172.21.15.112:0/3105953218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7dc0d1410 0x7fe7dc06db00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00ec80 tx=0x7fe7cc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.253+0000 7fe7e2471700 1 -- 172.21.15.112:0/3105953218 shutdown_connections 2023-10-06T04:40:16.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.253+0000 7fe7e2471700 1 --2- 172.21.15.112:0/3105953218 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe7c8066f30 0x7fe7c80693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.253+0000 7fe7e2471700 1 --2- 172.21.15.112:0/3105953218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7dc15cd20 0x7fe7dc06e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.253+0000 7fe7e2471700 1 --2- 172.21.15.112:0/3105953218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7dc0d0350 0x7fe7dc145080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.253+0000 7fe7e2471700 1 --2- 172.21.15.112:0/3105953218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7dc0d1410 0x7fe7dc06db00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.253+0000 7fe7e2471700 1 -- 172.21.15.112:0/3105953218 >> 172.21.15.112:0/3105953218 conn(0x7fe7dc06cfb0 msgr2=0x7fe7dc158230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:16.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.254+0000 7fe7e2471700 1 -- 172.21.15.112:0/3105953218 shutdown_connections 2023-10-06T04:40:16.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.254+0000 7fe7e2471700 1 -- 172.21.15.112:0/3105953218 wait complete. 2023-10-06T04:40:16.267 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T04:40:16.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.383+0000 7f73ceb59700 1 Processor -- start 2023-10-06T04:40:16.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.383+0000 7f73ceb59700 1 -- start start 2023-10-06T04:40:16.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.384+0000 7f73ceb59700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f73c806d3b0 0x7f73c815be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.384+0000 7f73ceb59700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c815af50 con 0x7f73c8159a20 2023-10-06T04:40:16.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.384+0000 7f73ceb59700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c80cae50 con 0x7f73c80cbf00 2023-10-06T04:40:16.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.384+0000 7f73ceb59700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c80cca70 con 0x7f73c806d3b0 2023-10-06T04:40:16.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.384+0000 7f73cc8f5700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f73c8159a20 0x7f73c80cb7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48386/0 (socket says 172.21.15.112:48386) 2023-10-06T04:40:16.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.384+0000 7f73cc8f5700 1 -- 172.21.15.112:0/1590609266 learned_addr learned my addr 172.21.15.112:0/1590609266 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:16.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.384+0000 7f73c77fe700 1 -- 172.21.15.112:0/1590609266 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3197108623 0 0) 0x7f73c815af50 con 0x7f73c8159a20 2023-10-06T04:40:16.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.384+0000 7f73c77fe700 1 -- 172.21.15.112:0/1590609266 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73b8003570 con 0x7f73c8159a20 2023-10-06T04:40:16.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.384+0000 7f73cd0f6700 1 --2- 172.21.15.112:0/1590609266 >> v2:172.21.15.179:3300/0 conn(0x7f73c806d3b0 0x7f73c815be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.384+0000 7f73c77fe700 1 -- 172.21.15.112:0/1590609266 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4281417363 0 0) 0x7f73b8003570 con 0x7f73c8159a20 2023-10-06T04:40:16.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.384+0000 7f73c77fe700 1 -- 172.21.15.112:0/1590609266 >> v2:172.21.15.179:3300/0 conn(0x7f73c806d3b0 msgr2=0x7f73c815be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:16.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.384+0000 7f73c77fe700 1 --2- 172.21.15.112:0/1590609266 >> v2:172.21.15.179:3300/0 conn(0x7f73c806d3b0 0x7f73c815be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.384+0000 7f73c77fe700 1 -- 172.21.15.112:0/1590609266 >> v1:172.21.15.179:6789/0 conn(0x7f73c80cbf00 legacy=0x7f73c815b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.384+0000 7f73c77fe700 1 -- 172.21.15.112:0/1590609266 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c80cb0f0 con 0x7f73c8159a20 2023-10-06T04:40:16.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.384+0000 7f73c77fe700 1 -- 172.21.15.112:0/1590609266 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f73bc001470 con 0x7f73c8159a20 2023-10-06T04:40:16.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.385+0000 7f73c77fe700 1 -- 172.21.15.112:0/1590609266 >> v1:172.21.15.112:6789/0 conn(0x7f73c8159a20 legacy=0x7f73c80cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.385+0000 7f73c77fe700 1 --2- 172.21.15.112:0/1590609266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b8003a60 0x7f73b8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.385+0000 7f73c77fe700 1 --2- 172.21.15.112:0/1590609266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b8004810 0x7f73b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.385+0000 7f73c77fe700 1 --2- 172.21.15.112:0/1590609266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b80051c0 0x7f73b800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.385+0000 7f73c77fe700 1 -- 172.21.15.112:0/1590609266 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c80cca70 con 0x7f73b8003a60 2023-10-06T04:40:16.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.385+0000 7f73c77fe700 1 -- 172.21.15.112:0/1590609266 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b800c160 con 0x7f73b8004810 2023-10-06T04:40:16.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.385+0000 7f73c77fe700 1 -- 172.21.15.112:0/1590609266 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b800c320 con 0x7f73b80051c0 2023-10-06T04:40:16.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.385+0000 7f73cc8f5700 1 --2- 172.21.15.112:0/1590609266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b8003a60 0x7f73b8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.385+0000 7f73c7fff700 1 --2- 172.21.15.112:0/1590609266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b8004810 0x7f73b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.385+0000 7f73cd0f6700 1 --2- 172.21.15.112:0/1590609266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b80051c0 0x7f73b800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.385+0000 7f73cc8f5700 1 -- 172.21.15.112:0/1590609266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b80051c0 msgr2=0x7f73b800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:16.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.385+0000 7f73cc8f5700 1 --2- 172.21.15.112:0/1590609266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b80051c0 0x7f73b800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.385+0000 7f73cc8f5700 1 -- 172.21.15.112:0/1590609266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b8004810 msgr2=0x7f73b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:16.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.385+0000 7f73cc8f5700 1 --2- 172.21.15.112:0/1590609266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b8004810 0x7f73b8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.385+0000 7f73cc8f5700 1 -- 172.21.15.112:0/1590609266 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b8003570 con 0x7f73b8003a60 2023-10-06T04:40:16.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.385+0000 7f73cd0f6700 1 -- 172.21.15.112:0/1590609266 reap_dead start 2023-10-06T04:40:16.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.385+0000 7f73c7fff700 1 --2- 172.21.15.112:0/1590609266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b8004810 0x7f73b8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:16.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.385+0000 7f73cc8f5700 1 --2- 172.21.15.112:0/1590609266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b8003a60 0x7f73b8003e70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00c390 tx=0x7f73c8064630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfd7cd482278566 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:16.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.385+0000 7f73c77fe700 1 -- 172.21.15.112:0/1590609266 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc00cbe0 con 0x7f73b8003a60 2023-10-06T04:40:16.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.385+0000 7f73c77fe700 1 -- 172.21.15.112:0/1590609266 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc00cd40 con 0x7f73b8003a60 2023-10-06T04:40:16.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.385+0000 7f73c77fe700 1 -- 172.21.15.112:0/1590609266 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc005b70 con 0x7f73b8003a60 2023-10-06T04:40:16.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.386+0000 7f73ceb59700 1 -- 172.21.15.112:0/1590609266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b8003a60 msgr2=0x7f73b8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.386+0000 7f73ceb59700 1 --2- 172.21.15.112:0/1590609266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b8003a60 0x7f73b8003e70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00c390 tx=0x7f73c8064630 comp rx=0 tx=0).stop 2023-10-06T04:40:16.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.386+0000 7f73ceb59700 1 -- 172.21.15.112:0/1590609266 shutdown_connections 2023-10-06T04:40:16.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.386+0000 7f73ceb59700 1 --2- 172.21.15.112:0/1590609266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b8003a60 0x7f73b8003e70 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.386+0000 7f73ceb59700 1 -- 172.21.15.112:0/1590609266 >> 172.21.15.112:0/1590609266 conn(0x7f73c806cfb0 msgr2=0x7f73c80d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:16.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.386+0000 7f73ceb59700 1 -- 172.21.15.112:0/1590609266 shutdown_connections 2023-10-06T04:40:16.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.386+0000 7f73ceb59700 1 -- 172.21.15.112:0/1590609266 wait complete. 2023-10-06T04:40:16.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.387+0000 7f73ceb59700 1 Processor -- start 2023-10-06T04:40:16.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.387+0000 7f73ceb59700 1 -- start start 2023-10-06T04:40:16.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73ceb59700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b8003a60 0x7f73c80b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73ceb59700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73c80b1d50 0x7f73c816a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73ceb59700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c80b3f40 0x7f73c816aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73ceb59700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c80b6650 con 0x7f73c80b3f40 2023-10-06T04:40:16.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73ceb59700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c80b2200 con 0x7f73b8003a60 2023-10-06T04:40:16.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73ceb59700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c80b24e0 con 0x7f73c80b1d50 2023-10-06T04:40:16.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73cd0f6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c80b3f40 0x7f73c816aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73cd0f6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c80b3f40 0x7f73c816aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60654/0 (socket says 172.21.15.112:60654) 2023-10-06T04:40:16.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73cd0f6700 1 -- 172.21.15.112:0/2885919098 learned_addr learned my addr 172.21.15.112:0/2885919098 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:16.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73c7fff700 1 --2- 172.21.15.112:0/2885919098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73c80b1d50 0x7f73c816a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73cc8f5700 1 --2- 172.21.15.112:0/2885919098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b8003a60 0x7f73c80b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73cd0f6700 1 -- 172.21.15.112:0/2885919098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73c80b1d50 msgr2=0x7f73c816a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73cd0f6700 1 --2- 172.21.15.112:0/2885919098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73c80b1d50 0x7f73c816a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73cd0f6700 1 -- 172.21.15.112:0/2885919098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b8003a60 msgr2=0x7f73c80b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73cd0f6700 1 --2- 172.21.15.112:0/2885919098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b8003a60 0x7f73c80b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73cd0f6700 1 -- 172.21.15.112:0/2885919098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c80b27c0 con 0x7f73c80b3f40 2023-10-06T04:40:16.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73cd0f6700 1 --2- 172.21.15.112:0/2885919098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c80b3f40 0x7f73c816aa00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f73c808aad0 tx=0x7f73c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:16.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73c4ff9700 1 -- 172.21.15.112:0/2885919098 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c000e070 con 0x7f73c80b3f40 2023-10-06T04:40:16.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73c4ff9700 1 -- 172.21.15.112:0/2885919098 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c0011b80 con 0x7f73c80b3f40 2023-10-06T04:40:16.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73ceb59700 1 -- 172.21.15.112:0/2885919098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c80b2aa0 con 0x7f73c80b3f40 2023-10-06T04:40:16.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73c4ff9700 1 -- 172.21.15.112:0/2885919098 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c0016470 con 0x7f73c80b3f40 2023-10-06T04:40:16.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.388+0000 7f73ceb59700 1 -- 172.21.15.112:0/2885919098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c816af40 con 0x7f73c80b3f40 2023-10-06T04:40:16.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.389+0000 7f73ceb59700 1 -- 172.21.15.112:0/2885919098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c80b2f40 con 0x7f73c80b3f40 2023-10-06T04:40:16.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.390+0000 7f73c4ff9700 1 -- 172.21.15.112:0/2885919098 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73c00168a0 con 0x7f73c80b3f40 2023-10-06T04:40:16.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.390+0000 7f73c4ff9700 1 --2- 172.21.15.112:0/2885919098 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f73ac066f30 0x7f73ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.390+0000 7f73c4ff9700 1 -- 172.21.15.112:0/2885919098 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f73c0085030 con 0x7f73c80b3f40 2023-10-06T04:40:16.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.390+0000 7f73cc8f5700 1 --2- 172.21.15.112:0/2885919098 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f73ac066f30 0x7f73ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.390+0000 7f73cc8f5700 1 --2- 172.21.15.112:0/2885919098 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f73ac066f30 0x7f73ac0693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f73bc007cd0 tx=0x7f73bc015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:16.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.394+0000 7f73c4ff9700 1 -- 172.21.15.112:0/2885919098 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73c0052140 con 0x7f73c80b3f40 2023-10-06T04:40:16.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.576+0000 7f73ceb59700 1 -- 172.21.15.112:0/2885919098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f73c805f230 con 0x7f73c80b3f40 2023-10-06T04:40:16.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.577+0000 7f73c4ff9700 1 -- 172.21.15.112:0/2885919098 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f73c0055760 con 0x7f73c80b3f40 2023-10-06T04:40:16.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.579+0000 7f73ceb59700 1 -- 172.21.15.112:0/2885919098 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f73ac066f30 msgr2=0x7f73ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.579+0000 7f73ceb59700 1 --2- 172.21.15.112:0/2885919098 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f73ac066f30 0x7f73ac0693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f73bc007cd0 tx=0x7f73bc015000 comp rx=0 tx=0).stop 2023-10-06T04:40:16.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.579+0000 7f73ceb59700 1 -- 172.21.15.112:0/2885919098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c80b3f40 msgr2=0x7f73c816aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.579+0000 7f73ceb59700 1 --2- 172.21.15.112:0/2885919098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c80b3f40 0x7f73c816aa00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f73c808aad0 tx=0x7f73c000b040 comp rx=0 tx=0).stop 2023-10-06T04:40:16.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.579+0000 7f73ceb59700 1 -- 172.21.15.112:0/2885919098 shutdown_connections 2023-10-06T04:40:16.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.579+0000 7f73ceb59700 1 --2- 172.21.15.112:0/2885919098 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f73ac066f30 0x7f73ac0693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.579+0000 7f73ceb59700 1 --2- 172.21.15.112:0/2885919098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c80b3f40 0x7f73c816aa00 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.579+0000 7f73ceb59700 1 --2- 172.21.15.112:0/2885919098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b8003a60 0x7f73c80b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.579+0000 7f73ceb59700 1 --2- 172.21.15.112:0/2885919098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73c80b1d50 0x7f73c816a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.579+0000 7f73ceb59700 1 -- 172.21.15.112:0/2885919098 >> 172.21.15.112:0/2885919098 conn(0x7f73c806cfb0 msgr2=0x7f73c80cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:16.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.579+0000 7f73ceb59700 1 -- 172.21.15.112:0/2885919098 shutdown_connections 2023-10-06T04:40:16.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.579+0000 7f73ceb59700 1 -- 172.21.15.112:0/2885919098 wait complete. 2023-10-06T04:40:16.592 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs group_0000000000647429 2023-10-06T04:40:16.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.708+0000 7f2cecc7a700 1 Processor -- start 2023-10-06T04:40:16.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.708+0000 7f2cecc7a700 1 -- start start 2023-10-06T04:40:16.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.709+0000 7f2cecc7a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2ce806d3b0 0x7f2ce815be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.709+0000 7f2cecc7a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce815af50 con 0x7f2ce80cbf00 2023-10-06T04:40:16.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.709+0000 7f2cecc7a700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce80cae50 con 0x7f2ce8159a20 2023-10-06T04:40:16.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.709+0000 7f2cecc7a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce80cca70 con 0x7f2ce806d3b0 2023-10-06T04:40:16.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.709+0000 7f2ce6d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2ce806d3b0 0x7f2ce815be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.709+0000 7f2ce5d9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2ce80cbf00 0x7f2ce815b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48402/0 (socket says 172.21.15.112:48402) 2023-10-06T04:40:16.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.709+0000 7f2ce5d9b700 1 -- 172.21.15.112:0/675872903 learned_addr learned my addr 172.21.15.112:0/675872903 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:16.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.709+0000 7f2ce6d9d700 1 -- 172.21.15.112:0/675872903 >> v1:172.21.15.179:6789/0 conn(0x7f2ce8159a20 legacy=0x7f2ce80cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:16.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.709+0000 7f2ce6d9d700 1 -- 172.21.15.112:0/675872903 >> v1:172.21.15.112:6789/0 conn(0x7f2ce80cbf00 legacy=0x7f2ce815b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.709+0000 7f2ce559a700 1 -- 172.21.15.112:0/675872903 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 746483403 0 0) 0x7f2ce815af50 con 0x7f2ce80cbf00 2023-10-06T04:40:16.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.709+0000 7f2ce6d9d700 1 -- 172.21.15.112:0/675872903 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce80cb0f0 con 0x7f2ce806d3b0 2023-10-06T04:40:16.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.709+0000 7f2ce6d9d700 1 --2- 172.21.15.112:0/675872903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ce806d3b0 0x7f2ce815be20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009e60 tx=0x7f2ce0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bdacc6943dada49 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:16.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.709+0000 7f2ce559a700 1 -- 172.21.15.112:0/675872903 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce000e070 con 0x7f2ce806d3b0 2023-10-06T04:40:16.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.709+0000 7f2ce559a700 1 -- 172.21.15.112:0/675872903 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce000bbf0 con 0x7f2ce806d3b0 2023-10-06T04:40:16.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.709+0000 7f2ce559a700 1 -- 172.21.15.112:0/675872903 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0012430 con 0x7f2ce806d3b0 2023-10-06T04:40:16.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.710+0000 7f2cecc7a700 1 -- 172.21.15.112:0/675872903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ce806d3b0 msgr2=0x7f2ce815be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.710+0000 7f2cecc7a700 1 --2- 172.21.15.112:0/675872903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ce806d3b0 0x7f2ce815be20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009e60 tx=0x7f2ce0009780 comp rx=0 tx=0).stop 2023-10-06T04:40:16.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.710+0000 7f2cecc7a700 1 -- 172.21.15.112:0/675872903 shutdown_connections 2023-10-06T04:40:16.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.710+0000 7f2cecc7a700 1 --2- 172.21.15.112:0/675872903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ce806d3b0 0x7f2ce815be20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.710+0000 7f2cecc7a700 1 -- 172.21.15.112:0/675872903 >> 172.21.15.112:0/675872903 conn(0x7f2ce806cfb0 msgr2=0x7f2ce80d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:16.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.710+0000 7f2cecc7a700 1 -- 172.21.15.112:0/675872903 shutdown_connections 2023-10-06T04:40:16.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.710+0000 7f2cecc7a700 1 -- 172.21.15.112:0/675872903 wait complete. 2023-10-06T04:40:16.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.711+0000 7f2cecc7a700 1 Processor -- start 2023-10-06T04:40:16.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.711+0000 7f2cecc7a700 1 -- start start 2023-10-06T04:40:16.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.712+0000 7f2cecc7a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce806d3b0 0x7f2ce814b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.712+0000 7f2cecc7a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ce80cbf00 0x7f2ce814cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.712+0000 7f2cecc7a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ce8159a20 0x7f2ce8153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.712+0000 7f2cecc7a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce81546b0 con 0x7f2ce80cbf00 2023-10-06T04:40:16.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.712+0000 7f2cecc7a700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce814c7f0 con 0x7f2ce806d3b0 2023-10-06T04:40:16.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.712+0000 7f2cecc7a700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce81543d0 con 0x7f2ce8159a20 2023-10-06T04:40:16.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.712+0000 7f2ce5d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ce80cbf00 0x7f2ce814cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.712+0000 7f2ce5d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ce80cbf00 0x7f2ce814cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60662/0 (socket says 172.21.15.112:60662) 2023-10-06T04:40:16.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.712+0000 7f2ce5d9b700 1 -- 172.21.15.112:0/167834910 learned_addr learned my addr 172.21.15.112:0/167834910 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:16.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.712+0000 7f2ce659c700 1 --2- 172.21.15.112:0/167834910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce806d3b0 0x7f2ce814b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.712+0000 7f2ce6d9d700 1 --2- 172.21.15.112:0/167834910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ce8159a20 0x7f2ce8153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.712+0000 7f2ce5d9b700 1 -- 172.21.15.112:0/167834910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ce8159a20 msgr2=0x7f2ce8153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.712+0000 7f2ce5d9b700 1 --2- 172.21.15.112:0/167834910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ce8159a20 0x7f2ce8153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.712+0000 7f2ce5d9b700 1 -- 172.21.15.112:0/167834910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce806d3b0 msgr2=0x7f2ce814b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.712+0000 7f2ce5d9b700 1 --2- 172.21.15.112:0/167834910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce806d3b0 0x7f2ce814b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.712+0000 7f2ce5d9b700 1 -- 172.21.15.112:0/167834910 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce0009a20 con 0x7f2ce80cbf00 2023-10-06T04:40:16.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.712+0000 7f2ce5d9b700 1 --2- 172.21.15.112:0/167834910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ce80cbf00 0x7f2ce814cc80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00c810 tx=0x7f2cdc007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:16.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.713+0000 7f2cd67fc700 1 -- 172.21.15.112:0/167834910 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc005c00 con 0x7f2ce80cbf00 2023-10-06T04:40:16.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.713+0000 7f2cd67fc700 1 -- 172.21.15.112:0/167834910 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc005d60 con 0x7f2ce80cbf00 2023-10-06T04:40:16.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.713+0000 7f2cecc7a700 1 -- 172.21.15.112:0/167834910 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce814c1a0 con 0x7f2ce80cbf00 2023-10-06T04:40:16.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.713+0000 7f2cd67fc700 1 -- 172.21.15.112:0/167834910 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc007300 con 0x7f2ce80cbf00 2023-10-06T04:40:16.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.713+0000 7f2cecc7a700 1 -- 172.21.15.112:0/167834910 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce814d930 con 0x7f2ce80cbf00 2023-10-06T04:40:16.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.714+0000 7f2cecc7a700 1 -- 172.21.15.112:0/167834910 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce814c640 con 0x7f2ce80cbf00 2023-10-06T04:40:16.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.714+0000 7f2cd67fc700 1 -- 172.21.15.112:0/167834910 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2cdc01b3b0 con 0x7f2ce80cbf00 2023-10-06T04:40:16.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.714+0000 7f2cd67fc700 1 --2- 172.21.15.112:0/167834910 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2cc8066f30 0x7f2cc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:16.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.714+0000 7f2ce659c700 1 --2- 172.21.15.112:0/167834910 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2cc8066f30 0x7f2cc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:16.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.715+0000 7f2cd67fc700 1 -- 172.21.15.112:0/167834910 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2cdc083b50 con 0x7f2ce80cbf00 2023-10-06T04:40:16.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.715+0000 7f2ce659c700 1 --2- 172.21.15.112:0/167834910 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2cc8066f30 0x7f2cc80693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8151430 tx=0x7f2cd8007ea0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:16.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.719+0000 7f2cd67fc700 1 -- 172.21.15.112:0/167834910 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2cdc050c60 con 0x7f2ce80cbf00 2023-10-06T04:40:16.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.931+0000 7f2cecc7a700 1 -- 172.21.15.112:0/167834910 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "group_0000000000647429", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ce814c960 con 0x7f2cc8066f30 2023-10-06T04:40:16.936 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:40:16.935+0000 7f1e726fa700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T04:40:16.936 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:40:16.935+0000 7f1e726fa700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T04:40:16.936 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:40:16.935+0000 7f1e726fa700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T04:40:16.936 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:40:16.935+0000 7f1e726fa700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T04:40:16.936 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:40:16.935+0000 7f1e726fa700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T04:40:16.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.950+0000 7f2cd67fc700 1 -- 172.21.15.112:0/167834910 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2ce814c960 con 0x7f2cc8066f30 2023-10-06T04:40:16.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.952+0000 7f2cecc7a700 1 -- 172.21.15.112:0/167834910 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2cc8066f30 msgr2=0x7f2cc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.952+0000 7f2cecc7a700 1 --2- 172.21.15.112:0/167834910 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2cc8066f30 0x7f2cc80693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8151430 tx=0x7f2cd8007ea0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.952+0000 7f2cecc7a700 1 -- 172.21.15.112:0/167834910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ce80cbf00 msgr2=0x7f2ce814cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:16.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.952+0000 7f2cecc7a700 1 --2- 172.21.15.112:0/167834910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ce80cbf00 0x7f2ce814cc80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00c810 tx=0x7f2cdc007db0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.952+0000 7f2cecc7a700 1 -- 172.21.15.112:0/167834910 shutdown_connections 2023-10-06T04:40:16.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.952+0000 7f2cecc7a700 1 --2- 172.21.15.112:0/167834910 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f2cc8066f30 0x7f2cc80693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.952+0000 7f2cecc7a700 1 --2- 172.21.15.112:0/167834910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ce8159a20 0x7f2ce8153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.952+0000 7f2cecc7a700 1 --2- 172.21.15.112:0/167834910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce806d3b0 0x7f2ce814b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.952+0000 7f2cecc7a700 1 --2- 172.21.15.112:0/167834910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ce80cbf00 0x7f2ce814cc80 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:16.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.952+0000 7f2cecc7a700 1 -- 172.21.15.112:0/167834910 >> 172.21.15.112:0/167834910 conn(0x7f2ce806cfb0 msgr2=0x7f2ce80ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:16.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.952+0000 7f2cecc7a700 1 -- 172.21.15.112:0/167834910 shutdown_connections 2023-10-06T04:40:16.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:16.952+0000 7f2cecc7a700 1 -- 172.21.15.112:0/167834910 wait complete. 2023-10-06T04:40:16.965 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000649362 --group_name group_0000000000647429 2023-10-06T04:40:17.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.083+0000 7f186759e700 1 Processor -- start 2023-10-06T04:40:17.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.083+0000 7f186759e700 1 -- start start 2023-10-06T04:40:17.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.084+0000 7f186759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18680c8f70 0x7f18680c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.084+0000 7f186759e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18680c9920 con 0x7f18681564c0 2023-10-06T04:40:17.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.084+0000 7f186759e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186806aa20 con 0x7f186806b470 2023-10-06T04:40:17.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.084+0000 7f186759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186806afe0 con 0x7f18680c8f70 2023-10-06T04:40:17.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.084+0000 7f186659c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f18681564c0 0x7f18680c9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48416/0 (socket says 172.21.15.112:48416) 2023-10-06T04:40:17.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.084+0000 7f186659c700 1 -- 172.21.15.112:0/3916772631 learned_addr learned my addr 172.21.15.112:0/3916772631 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:17.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.084+0000 7f1865d9b700 1 -- 172.21.15.112:0/3916772631 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202020238 0 0) 0x7f18680c9920 con 0x7f18681564c0 2023-10-06T04:40:17.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.084+0000 7f1865d9b700 1 -- 172.21.15.112:0/3916772631 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1854003570 con 0x7f18681564c0 2023-10-06T04:40:17.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.084+0000 7f185dd9b700 1 --2- 172.21.15.112:0/3916772631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18680c8f70 0x7f18680c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f1865d9b700 1 -- 172.21.15.112:0/3916772631 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 231363466 0 0) 0x7f1854003570 con 0x7f18681564c0 2023-10-06T04:40:17.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f1865d9b700 1 -- 172.21.15.112:0/3916772631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18680c8f70 msgr2=0x7f18680c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:17.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f1865d9b700 1 --2- 172.21.15.112:0/3916772631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18680c8f70 0x7f18680c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f1865d9b700 1 -- 172.21.15.112:0/3916772631 >> v1:172.21.15.179:6789/0 conn(0x7f186806b470 legacy=0x7f186806b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f1865d9b700 1 -- 172.21.15.112:0/3916772631 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18680b1aa0 con 0x7f18681564c0 2023-10-06T04:40:17.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f1865d9b700 1 -- 172.21.15.112:0/3916772631 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f1858001470 con 0x7f18681564c0 2023-10-06T04:40:17.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f1865d9b700 1 -- 172.21.15.112:0/3916772631 >> v1:172.21.15.112:6789/0 conn(0x7f18681564c0 legacy=0x7f18680c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f1865d9b700 1 --2- 172.21.15.112:0/3916772631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1854003a90 0x7f1854003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f1865d9b700 1 --2- 172.21.15.112:0/3916772631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1854004810 0x7f1854004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f1865d9b700 1 --2- 172.21.15.112:0/3916772631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18680c8f70 0x7f1854005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f1865d9b700 1 -- 172.21.15.112:0/3916772631 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186806afe0 con 0x7f1854004810 2023-10-06T04:40:17.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f1865d9b700 1 -- 172.21.15.112:0/3916772631 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185400bc20 con 0x7f1854003a90 2023-10-06T04:40:17.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f1865d9b700 1 -- 172.21.15.112:0/3916772631 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185400dff0 con 0x7f18680c8f70 2023-10-06T04:40:17.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f185dd9b700 1 --2- 172.21.15.112:0/3916772631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1854004810 0x7f1854004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f186659c700 1 --2- 172.21.15.112:0/3916772631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1854003a90 0x7f1854003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f1866d9d700 1 --2- 172.21.15.112:0/3916772631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18680c8f70 0x7f1854005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f185dd9b700 1 -- 172.21.15.112:0/3916772631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18680c8f70 msgr2=0x7f1854005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:17.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f185dd9b700 1 --2- 172.21.15.112:0/3916772631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18680c8f70 0x7f1854005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f185dd9b700 1 -- 172.21.15.112:0/3916772631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1854003a90 msgr2=0x7f1854003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:17.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f185dd9b700 1 --2- 172.21.15.112:0/3916772631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1854003a90 0x7f1854003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f185dd9b700 1 -- 172.21.15.112:0/3916772631 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1854003570 con 0x7f1854004810 2023-10-06T04:40:17.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f185dd9b700 1 --2- 172.21.15.112:0/3916772631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1854004810 0x7f1854004c80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f185000bb60 tx=0x7f1850008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32a3327c262b479 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:17.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f1865d9b700 1 -- 172.21.15.112:0/3916772631 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185000d5d0 con 0x7f1854004810 2023-10-06T04:40:17.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f1865d9b700 1 -- 172.21.15.112:0/3916772631 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185000d730 con 0x7f1854004810 2023-10-06T04:40:17.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.085+0000 7f1865d9b700 1 -- 172.21.15.112:0/3916772631 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185000daf0 con 0x7f1854004810 2023-10-06T04:40:17.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.086+0000 7f186759e700 1 -- 172.21.15.112:0/3916772631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1854004810 msgr2=0x7f1854004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.086+0000 7f186759e700 1 --2- 172.21.15.112:0/3916772631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1854004810 0x7f1854004c80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f185000bb60 tx=0x7f1850008040 comp rx=0 tx=0).stop 2023-10-06T04:40:17.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.086+0000 7f1866d9d700 1 -- 172.21.15.112:0/3916772631 reap_dead start 2023-10-06T04:40:17.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.086+0000 7f186759e700 1 -- 172.21.15.112:0/3916772631 shutdown_connections 2023-10-06T04:40:17.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.086+0000 7f186759e700 1 -- 172.21.15.112:0/3916772631 >> 172.21.15.112:0/3916772631 conn(0x7f186806d8e0 msgr2=0x7f186806dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:17.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.086+0000 7f186759e700 1 -- 172.21.15.112:0/3916772631 shutdown_connections 2023-10-06T04:40:17.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.086+0000 7f186759e700 1 -- 172.21.15.112:0/3916772631 wait complete. 2023-10-06T04:40:17.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.087+0000 7f186759e700 1 Processor -- start 2023-10-06T04:40:17.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.087+0000 7f186759e700 1 -- start start 2023-10-06T04:40:17.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.088+0000 7f186759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1854004810 0x7f18680aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.088+0000 7f186759e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18680c3450 0x7f18680cc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.088+0000 7f186759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18680cc840 0x7f1868165890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.088+0000 7f186759e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18680cccc0 con 0x7f18680c3450 2023-10-06T04:40:17.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.088+0000 7f186759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18680c2fc0 con 0x7f18680cc840 2023-10-06T04:40:17.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.088+0000 7f186759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1868166690 con 0x7f1854004810 2023-10-06T04:40:17.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.088+0000 7f185dd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18680c3450 0x7f18680cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.088+0000 7f185dd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18680c3450 0x7f18680cc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60690/0 (socket says 172.21.15.112:60690) 2023-10-06T04:40:17.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.088+0000 7f185dd9b700 1 -- 172.21.15.112:0/3220762571 learned_addr learned my addr 172.21.15.112:0/3220762571 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:17.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.088+0000 7f186659c700 1 --2- 172.21.15.112:0/3220762571 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1854004810 0x7f18680aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.088+0000 7f1866d9d700 1 --2- 172.21.15.112:0/3220762571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18680cc840 0x7f1868165890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.088+0000 7f185dd9b700 1 -- 172.21.15.112:0/3220762571 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1854004810 msgr2=0x7f18680aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.088+0000 7f185dd9b700 1 --2- 172.21.15.112:0/3220762571 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1854004810 0x7f18680aecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.088+0000 7f185dd9b700 1 -- 172.21.15.112:0/3220762571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18680cc840 msgr2=0x7f1868165890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.088+0000 7f185dd9b700 1 --2- 172.21.15.112:0/3220762571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18680cc840 0x7f1868165890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.088+0000 7f185dd9b700 1 -- 172.21.15.112:0/3220762571 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18680c2970 con 0x7f18680c3450 2023-10-06T04:40:17.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.088+0000 7f185dd9b700 1 --2- 172.21.15.112:0/3220762571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18680c3450 0x7f18680cc300 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1850006fd0 tx=0x7f185001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:17.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.089+0000 7f185effd700 1 -- 172.21.15.112:0/3220762571 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18500146c0 con 0x7f18680c3450 2023-10-06T04:40:17.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.089+0000 7f185effd700 1 -- 172.21.15.112:0/3220762571 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1850014820 con 0x7f18680c3450 2023-10-06T04:40:17.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.089+0000 7f186759e700 1 -- 172.21.15.112:0/3220762571 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18680c2c50 con 0x7f18680c3450 2023-10-06T04:40:17.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.089+0000 7f185effd700 1 -- 172.21.15.112:0/3220762571 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1850014be0 con 0x7f18680c3450 2023-10-06T04:40:17.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.089+0000 7f186759e700 1 -- 172.21.15.112:0/3220762571 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1868165f90 con 0x7f18680c3450 2023-10-06T04:40:17.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.090+0000 7f186759e700 1 -- 172.21.15.112:0/3220762571 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18680c27d0 con 0x7f18680c3450 2023-10-06T04:40:17.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.090+0000 7f185effd700 1 -- 172.21.15.112:0/3220762571 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f185001d400 con 0x7f18680c3450 2023-10-06T04:40:17.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.090+0000 7f185effd700 1 --2- 172.21.15.112:0/3220762571 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1848066f30 0x7f18480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.090+0000 7f185effd700 1 -- 172.21.15.112:0/3220762571 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1850086010 con 0x7f18680c3450 2023-10-06T04:40:17.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.090+0000 7f186659c700 1 --2- 172.21.15.112:0/3220762571 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1848066f30 0x7f18480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.091+0000 7f186659c700 1 --2- 172.21.15.112:0/3220762571 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1848066f30 0x7f18480693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1858007ed0 tx=0x7f1858009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:17.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.094+0000 7f185effd700 1 -- 172.21.15.112:0/3220762571 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18680c27d0 con 0x7f18680c3450 2023-10-06T04:40:17.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.306+0000 7f186759e700 1 -- 172.21.15.112:0/3220762571 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000649362", "group_name": "group_0000000000647429", "target": ["mon-mgr", ""]}) v1 -- 0x7f18680c27d0 con 0x7f1848066f30 2023-10-06T04:40:17.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.333+0000 7f185effd700 1 -- 172.21.15.112:0/3220762571 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f18680c27d0 con 0x7f1848066f30 2023-10-06T04:40:17.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.335+0000 7f186759e700 1 -- 172.21.15.112:0/3220762571 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1848066f30 msgr2=0x7f18480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.335+0000 7f186759e700 1 --2- 172.21.15.112:0/3220762571 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1848066f30 0x7f18480693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1858007ed0 tx=0x7f1858009040 comp rx=0 tx=0).stop 2023-10-06T04:40:17.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.335+0000 7f186759e700 1 -- 172.21.15.112:0/3220762571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18680c3450 msgr2=0x7f18680cc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.335+0000 7f186759e700 1 --2- 172.21.15.112:0/3220762571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18680c3450 0x7f18680cc300 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1850006fd0 tx=0x7f185001b000 comp rx=0 tx=0).stop 2023-10-06T04:40:17.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.335+0000 7f186759e700 1 -- 172.21.15.112:0/3220762571 shutdown_connections 2023-10-06T04:40:17.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.335+0000 7f186759e700 1 --2- 172.21.15.112:0/3220762571 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1848066f30 0x7f18480693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.335+0000 7f186759e700 1 --2- 172.21.15.112:0/3220762571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18680cc840 0x7f1868165890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.335+0000 7f186759e700 1 --2- 172.21.15.112:0/3220762571 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1854004810 0x7f18680aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.335+0000 7f186759e700 1 --2- 172.21.15.112:0/3220762571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18680c3450 0x7f18680cc300 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.335+0000 7f186759e700 1 -- 172.21.15.112:0/3220762571 >> 172.21.15.112:0/3220762571 conn(0x7f186806d8e0 msgr2=0x7f186815a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:17.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.335+0000 7f186759e700 1 -- 172.21.15.112:0/3220762571 shutdown_connections 2023-10-06T04:40:17.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.335+0000 7f186759e700 1 -- 172.21.15.112:0/3220762571 wait complete. 2023-10-06T04:40:17.348 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000649363 --group_name group_0000000000647429 2023-10-06T04:40:17.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.465+0000 7f54df76b700 1 Processor -- start 2023-10-06T04:40:17.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.465+0000 7f54df76b700 1 -- start start 2023-10-06T04:40:17.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.466+0000 7f54df76b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f54d8159a20 0x7f54d80cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.466+0000 7f54df76b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d815af50 con 0x7f54d806d3b0 2023-10-06T04:40:17.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.466+0000 7f54df76b700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d815e370 con 0x7f54d815c720 2023-10-06T04:40:17.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.466+0000 7f54df76b700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d80cca70 con 0x7f54d8159a20 2023-10-06T04:40:17.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.466+0000 7f54dcd06700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f54d806d3b0 0x7f54d815d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48418/0 (socket says 172.21.15.112:48418) 2023-10-06T04:40:17.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.466+0000 7f54dcd06700 1 -- 172.21.15.112:0/979350117 learned_addr learned my addr 172.21.15.112:0/979350117 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:17.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.466+0000 7f54dd507700 1 --2- 172.21.15.112:0/979350117 >> v2:172.21.15.179:3300/0 conn(0x7f54d8159a20 0x7f54d80cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.466+0000 7f54cffff700 1 -- 172.21.15.112:0/979350117 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141999678 0 0) 0x7f54d815af50 con 0x7f54d806d3b0 2023-10-06T04:40:17.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.466+0000 7f54cffff700 1 -- 172.21.15.112:0/979350117 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54c4003570 con 0x7f54d806d3b0 2023-10-06T04:40:17.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54cffff700 1 -- 172.21.15.112:0/979350117 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 354476610 0 0) 0x7f54c4003570 con 0x7f54d806d3b0 2023-10-06T04:40:17.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54cffff700 1 -- 172.21.15.112:0/979350117 >> v2:172.21.15.179:3300/0 conn(0x7f54d8159a20 msgr2=0x7f54d80cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:17.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54cffff700 1 --2- 172.21.15.112:0/979350117 >> v2:172.21.15.179:3300/0 conn(0x7f54d8159a20 0x7f54d80cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54cffff700 1 -- 172.21.15.112:0/979350117 >> v1:172.21.15.179:6789/0 conn(0x7f54d815c720 legacy=0x7f54d815dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54cffff700 1 -- 172.21.15.112:0/979350117 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d80cae50 con 0x7f54d806d3b0 2023-10-06T04:40:17.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54cffff700 1 -- 172.21.15.112:0/979350117 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f54c8001470 con 0x7f54d806d3b0 2023-10-06T04:40:17.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54cffff700 1 -- 172.21.15.112:0/979350117 >> v1:172.21.15.112:6789/0 conn(0x7f54d806d3b0 legacy=0x7f54d815d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54cffff700 1 --2- 172.21.15.112:0/979350117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54c4003a60 0x7f54c4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54cffff700 1 --2- 172.21.15.112:0/979350117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c4004810 0x7f54c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54cffff700 1 --2- 172.21.15.112:0/979350117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54c40051c0 0x7f54c400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54cffff700 1 -- 172.21.15.112:0/979350117 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d80cca70 con 0x7f54c40051c0 2023-10-06T04:40:17.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54cffff700 1 -- 172.21.15.112:0/979350117 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c400c160 con 0x7f54c4003a60 2023-10-06T04:40:17.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54cffff700 1 -- 172.21.15.112:0/979350117 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c400c320 con 0x7f54c4004810 2023-10-06T04:40:17.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54ddd08700 1 --2- 172.21.15.112:0/979350117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54c40051c0 0x7f54c400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54dd507700 1 --2- 172.21.15.112:0/979350117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54c4003a60 0x7f54c4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54dcd06700 1 --2- 172.21.15.112:0/979350117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c4004810 0x7f54c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54ddd08700 1 -- 172.21.15.112:0/979350117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c4004810 msgr2=0x7f54c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:17.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54ddd08700 1 --2- 172.21.15.112:0/979350117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c4004810 0x7f54c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54ddd08700 1 -- 172.21.15.112:0/979350117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54c4003a60 msgr2=0x7f54c4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:17.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54ddd08700 1 --2- 172.21.15.112:0/979350117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54c4003a60 0x7f54c4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54ddd08700 1 -- 172.21.15.112:0/979350117 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c4003570 con 0x7f54c40051c0 2023-10-06T04:40:17.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54dcd06700 1 --2- 172.21.15.112:0/979350117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c4004810 0x7f54c4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:17.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54ddd08700 1 -- 172.21.15.112:0/979350117 reap_dead start 2023-10-06T04:40:17.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54ddd08700 1 --2- 172.21.15.112:0/979350117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54c40051c0 0x7f54c400ba60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f54d00018b0 tx=0x7f54d0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a4f5c21573019c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:17.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54cffff700 1 -- 172.21.15.112:0/979350117 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d0012420 con 0x7f54c40051c0 2023-10-06T04:40:17.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54cffff700 1 -- 172.21.15.112:0/979350117 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d0012580 con 0x7f54c40051c0 2023-10-06T04:40:17.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.467+0000 7f54cffff700 1 -- 172.21.15.112:0/979350117 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d0012920 con 0x7f54c40051c0 2023-10-06T04:40:17.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.468+0000 7f54df76b700 1 -- 172.21.15.112:0/979350117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54c40051c0 msgr2=0x7f54c400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.468+0000 7f54df76b700 1 --2- 172.21.15.112:0/979350117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54c40051c0 0x7f54c400ba60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f54d00018b0 tx=0x7f54d0007d30 comp rx=0 tx=0).stop 2023-10-06T04:40:17.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.468+0000 7f54df76b700 1 -- 172.21.15.112:0/979350117 shutdown_connections 2023-10-06T04:40:17.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.468+0000 7f54df76b700 1 --2- 172.21.15.112:0/979350117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54c40051c0 0x7f54c400ba60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.468+0000 7f54df76b700 1 -- 172.21.15.112:0/979350117 >> 172.21.15.112:0/979350117 conn(0x7f54d806cfb0 msgr2=0x7f54d80d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:17.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.468+0000 7f54df76b700 1 -- 172.21.15.112:0/979350117 shutdown_connections 2023-10-06T04:40:17.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.468+0000 7f54df76b700 1 -- 172.21.15.112:0/979350117 wait complete. 2023-10-06T04:40:17.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.469+0000 7f54df76b700 1 Processor -- start 2023-10-06T04:40:17.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.469+0000 7f54df76b700 1 -- start start 2023-10-06T04:40:17.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.470+0000 7f54df76b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c40051c0 0x7f54d80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.470+0000 7f54df76b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54d815d080 0x7f54d806db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.470+0000 7f54df76b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54d815d4f0 0x7f54d806e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.470+0000 7f54df76b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d80b57b0 con 0x7f54d815d080 2023-10-06T04:40:17.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.470+0000 7f54df76b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d80b5a90 con 0x7f54d815d4f0 2023-10-06T04:40:17.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.470+0000 7f54df76b700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d80b5d70 con 0x7f54c40051c0 2023-10-06T04:40:17.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.470+0000 7f54dcd06700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54d815d080 0x7f54d806db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.470+0000 7f54dcd06700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54d815d080 0x7f54d806db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60712/0 (socket says 172.21.15.112:60712) 2023-10-06T04:40:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.470+0000 7f54dcd06700 1 -- 172.21.15.112:0/2499448833 learned_addr learned my addr 172.21.15.112:0/2499448833 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.470+0000 7f54dd507700 1 --2- 172.21.15.112:0/2499448833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c40051c0 0x7f54d80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.470+0000 7f54ddd08700 1 --2- 172.21.15.112:0/2499448833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54d815d4f0 0x7f54d806e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.470+0000 7f54dcd06700 1 -- 172.21.15.112:0/2499448833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c40051c0 msgr2=0x7f54d80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.470+0000 7f54dcd06700 1 --2- 172.21.15.112:0/2499448833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c40051c0 0x7f54d80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.470+0000 7f54dcd06700 1 -- 172.21.15.112:0/2499448833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54d815d4f0 msgr2=0x7f54d806e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.470+0000 7f54dcd06700 1 --2- 172.21.15.112:0/2499448833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54d815d4f0 0x7f54d806e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.470+0000 7f54dcd06700 1 -- 172.21.15.112:0/2499448833 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d80b6050 con 0x7f54d815d080 2023-10-06T04:40:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.470+0000 7f54ddd08700 1 --2- 172.21.15.112:0/2499448833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54d815d4f0 0x7f54d806e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:17.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.470+0000 7f54dcd06700 1 --2- 172.21.15.112:0/2499448833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54d815d080 0x7f54d806db00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f54c800e900 tx=0x7f54d8064630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:17.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.471+0000 7f54cd7fa700 1 -- 172.21.15.112:0/2499448833 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c800a580 con 0x7f54d815d080 2023-10-06T04:40:17.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.471+0000 7f54cd7fa700 1 -- 172.21.15.112:0/2499448833 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c8010040 con 0x7f54d815d080 2023-10-06T04:40:17.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.471+0000 7f54df76b700 1 -- 172.21.15.112:0/2499448833 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d80b6330 con 0x7f54d815d080 2023-10-06T04:40:17.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.471+0000 7f54cd7fa700 1 -- 172.21.15.112:0/2499448833 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c800a910 con 0x7f54d815d080 2023-10-06T04:40:17.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.471+0000 7f54df76b700 1 -- 172.21.15.112:0/2499448833 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d806e580 con 0x7f54d815d080 2023-10-06T04:40:17.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.471+0000 7f54df76b700 1 -- 172.21.15.112:0/2499448833 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d80b6570 con 0x7f54d815d080 2023-10-06T04:40:17.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.472+0000 7f54cd7fa700 1 -- 172.21.15.112:0/2499448833 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54c800ac80 con 0x7f54d815d080 2023-10-06T04:40:17.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.472+0000 7f54cd7fa700 1 --2- 172.21.15.112:0/2499448833 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f54bc066f30 0x7f54bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.472+0000 7f54cd7fa700 1 -- 172.21.15.112:0/2499448833 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f54c8083ab0 con 0x7f54d815d080 2023-10-06T04:40:17.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.472+0000 7f54dd507700 1 --2- 172.21.15.112:0/2499448833 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f54bc066f30 0x7f54bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.473+0000 7f54dd507700 1 --2- 172.21.15.112:0/2499448833 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f54bc066f30 0x7f54bc0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009fd0 tx=0x7f54d400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:17.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.476+0000 7f54cd7fa700 1 -- 172.21.15.112:0/2499448833 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54c804d5a0 con 0x7f54d815d080 2023-10-06T04:40:17.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.690+0000 7f54df76b700 1 -- 172.21.15.112:0/2499448833 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000649363", "group_name": "group_0000000000647429", "target": ["mon-mgr", ""]}) v1 -- 0x7f54d80b5c00 con 0x7f54bc066f30 2023-10-06T04:40:17.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.714+0000 7f54cd7fa700 1 -- 172.21.15.112:0/2499448833 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f54d80b5c00 con 0x7f54bc066f30 2023-10-06T04:40:17.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.716+0000 7f54df76b700 1 -- 172.21.15.112:0/2499448833 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f54bc066f30 msgr2=0x7f54bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.716+0000 7f54df76b700 1 --2- 172.21.15.112:0/2499448833 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f54bc066f30 0x7f54bc0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009fd0 tx=0x7f54d400b040 comp rx=0 tx=0).stop 2023-10-06T04:40:17.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.716+0000 7f54df76b700 1 -- 172.21.15.112:0/2499448833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54d815d080 msgr2=0x7f54d806db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.716+0000 7f54df76b700 1 --2- 172.21.15.112:0/2499448833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54d815d080 0x7f54d806db00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f54c800e900 tx=0x7f54d8064630 comp rx=0 tx=0).stop 2023-10-06T04:40:17.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.717+0000 7f54df76b700 1 -- 172.21.15.112:0/2499448833 shutdown_connections 2023-10-06T04:40:17.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.717+0000 7f54df76b700 1 --2- 172.21.15.112:0/2499448833 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f54bc066f30 0x7f54bc0693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.717+0000 7f54df76b700 1 --2- 172.21.15.112:0/2499448833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54d815d4f0 0x7f54d806e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.717+0000 7f54df76b700 1 --2- 172.21.15.112:0/2499448833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c40051c0 0x7f54d80b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.717+0000 7f54df76b700 1 --2- 172.21.15.112:0/2499448833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54d815d080 0x7f54d806db00 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.717+0000 7f54df76b700 1 -- 172.21.15.112:0/2499448833 >> 172.21.15.112:0/2499448833 conn(0x7f54d806cfb0 msgr2=0x7f54d806ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:17.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.717+0000 7f54df76b700 1 -- 172.21.15.112:0/2499448833 shutdown_connections 2023-10-06T04:40:17.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.717+0000 7f54df76b700 1 -- 172.21.15.112:0/2499448833 wait complete. 2023-10-06T04:40:17.730 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000649364 --group_name group_0000000000647429 2023-10-06T04:40:17.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.848+0000 7f195bfff700 1 Processor -- start 2023-10-06T04:40:17.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.848+0000 7f195bfff700 1 -- start start 2023-10-06T04:40:17.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.849+0000 7f195bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f195c0d0a90 0x7f195c0cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.849+0000 7f195bfff700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c0c5970 con 0x7f195c157030 2023-10-06T04:40:17.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.849+0000 7f195bfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c15d950 con 0x7f195c0c5e00 2023-10-06T04:40:17.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.849+0000 7f195bfff700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195c15dc20 con 0x7f195c0d0a90 2023-10-06T04:40:17.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.849+0000 7f195b7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f195c0d0a90 0x7f195c0cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.849+0000 7f195b7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f195c0d0a90 0x7f195c0cc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60722/0 (socket says 172.21.15.112:60722) 2023-10-06T04:40:17.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.849+0000 7f195affd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f195c157030 0x7f195c15d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48424/0 (socket says 172.21.15.112:48424) 2023-10-06T04:40:17.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.849+0000 7f195b7fe700 1 -- 172.21.15.112:0/2441956547 learned_addr learned my addr 172.21.15.112:0/2441956547 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:17.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.849+0000 7f195b7fe700 1 -- 172.21.15.112:0/2441956547 >> v1:172.21.15.179:6789/0 conn(0x7f195c0c5e00 legacy=0x7f195c0d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.849+0000 7f195b7fe700 1 -- 172.21.15.112:0/2441956547 >> v1:172.21.15.112:6789/0 conn(0x7f195c157030 legacy=0x7f195c15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.849+0000 7f1959ffb700 1 -- 172.21.15.112:0/2441956547 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588571406 0 0) 0x7f195c0c5970 con 0x7f195c157030 2023-10-06T04:40:17.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.849+0000 7f195b7fe700 1 -- 172.21.15.112:0/2441956547 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c15df00 con 0x7f195c0d0a90 2023-10-06T04:40:17.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.849+0000 7f195b7fe700 1 --2- 172.21.15.112:0/2441956547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f195c0d0a90 0x7f195c0cc7e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f194c0099b0 tx=0x7f194c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ead551ed0ab4225 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:17.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.849+0000 7f1959ffb700 1 -- 172.21.15.112:0/2441956547 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c00b860 con 0x7f195c0d0a90 2023-10-06T04:40:17.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.849+0000 7f1959ffb700 1 -- 172.21.15.112:0/2441956547 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194c00b9c0 con 0x7f195c0d0a90 2023-10-06T04:40:17.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.849+0000 7f1959ffb700 1 -- 172.21.15.112:0/2441956547 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c00bd60 con 0x7f195c0d0a90 2023-10-06T04:40:17.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.850+0000 7f195bfff700 1 -- 172.21.15.112:0/2441956547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f195c0d0a90 msgr2=0x7f195c0cc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.850+0000 7f195bfff700 1 --2- 172.21.15.112:0/2441956547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f195c0d0a90 0x7f195c0cc7e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f194c0099b0 tx=0x7f194c009250 comp rx=0 tx=0).stop 2023-10-06T04:40:17.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.850+0000 7f195bfff700 1 -- 172.21.15.112:0/2441956547 shutdown_connections 2023-10-06T04:40:17.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.850+0000 7f195bfff700 1 --2- 172.21.15.112:0/2441956547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f195c0d0a90 0x7f195c0cc7e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.850+0000 7f195bfff700 1 -- 172.21.15.112:0/2441956547 >> 172.21.15.112:0/2441956547 conn(0x7f195c06c7d0 msgr2=0x7f195c06cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:17.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.850+0000 7f195bfff700 1 -- 172.21.15.112:0/2441956547 shutdown_connections 2023-10-06T04:40:17.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.850+0000 7f195bfff700 1 -- 172.21.15.112:0/2441956547 wait complete. 2023-10-06T04:40:17.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.851+0000 7f195bfff700 1 Processor -- start 2023-10-06T04:40:17.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.851+0000 7f195bfff700 1 -- start start 2023-10-06T04:40:17.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.852+0000 7f195bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f195c0c5e00 0x7f195c13e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.852+0000 7f195bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f195c0d0a90 0x7f195c13f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.852+0000 7f195bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f195c157030 0x7f195c1519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.852+0000 7f195bfff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c151550 con 0x7f195c0d0a90 2023-10-06T04:40:17.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.852+0000 7f195bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c150c20 con 0x7f195c0c5e00 2023-10-06T04:40:17.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.852+0000 7f195bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c150f00 con 0x7f195c157030 2023-10-06T04:40:17.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.852+0000 7f195a7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f195c0d0a90 0x7f195c13f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.852+0000 7f195a7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f195c0d0a90 0x7f195c13f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60726/0 (socket says 172.21.15.112:60726) 2023-10-06T04:40:17.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.852+0000 7f195a7fc700 1 -- 172.21.15.112:0/2037046877 learned_addr learned my addr 172.21.15.112:0/2037046877 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:17.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.852+0000 7f195b7fe700 1 --2- 172.21.15.112:0/2037046877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f195c157030 0x7f195c1519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.852+0000 7f195affd700 1 --2- 172.21.15.112:0/2037046877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f195c0c5e00 0x7f195c13e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.852+0000 7f195a7fc700 1 -- 172.21.15.112:0/2037046877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f195c157030 msgr2=0x7f195c1519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.852+0000 7f195a7fc700 1 --2- 172.21.15.112:0/2037046877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f195c157030 0x7f195c1519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.852+0000 7f195a7fc700 1 -- 172.21.15.112:0/2037046877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f195c0c5e00 msgr2=0x7f195c13e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:17.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.852+0000 7f195a7fc700 1 --2- 172.21.15.112:0/2037046877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f195c0c5e00 0x7f195c13e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:17.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.852+0000 7f195a7fc700 1 -- 172.21.15.112:0/2037046877 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c0094f0 con 0x7f195c0d0a90 2023-10-06T04:40:17.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.852+0000 7f195a7fc700 1 --2- 172.21.15.112:0/2037046877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f195c0d0a90 0x7f195c13f1c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f194400c590 tx=0x7f194400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:17.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.853+0000 7f1952ffd700 1 -- 172.21.15.112:0/2037046877 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1944011590 con 0x7f195c0d0a90 2023-10-06T04:40:17.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.853+0000 7f1952ffd700 1 -- 172.21.15.112:0/2037046877 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1944011710 con 0x7f195c0d0a90 2023-10-06T04:40:17.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.853+0000 7f195bfff700 1 -- 172.21.15.112:0/2037046877 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195c1511e0 con 0x7f195c0d0a90 2023-10-06T04:40:17.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.853+0000 7f1952ffd700 1 -- 172.21.15.112:0/2037046877 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1944011ad0 con 0x7f195c0d0a90 2023-10-06T04:40:17.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.853+0000 7f195bfff700 1 -- 172.21.15.112:0/2037046877 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195c15ce70 con 0x7f195c0d0a90 2023-10-06T04:40:17.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.853+0000 7f195bfff700 1 -- 172.21.15.112:0/2037046877 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195c1516c0 con 0x7f195c0d0a90 2023-10-06T04:40:17.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.854+0000 7f1952ffd700 1 -- 172.21.15.112:0/2037046877 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f194401b3b0 con 0x7f195c0d0a90 2023-10-06T04:40:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.854+0000 7f1952ffd700 1 --2- 172.21.15.112:0/2037046877 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f193c066f30 0x7f193c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.854+0000 7f1952ffd700 1 -- 172.21.15.112:0/2037046877 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1944083b20 con 0x7f195c0d0a90 2023-10-06T04:40:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.854+0000 7f195affd700 1 --2- 172.21.15.112:0/2037046877 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f193c066f30 0x7f193c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.855+0000 7f195affd700 1 --2- 172.21.15.112:0/2037046877 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f193c066f30 0x7f193c0693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1954000f80 tx=0x7f1954001a10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:17.858+0000 7f1952ffd700 1 -- 172.21.15.112:0/2037046877 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1944050c30 con 0x7f195c0d0a90 2023-10-06T04:40:18.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.069+0000 7f195bfff700 1 -- 172.21.15.112:0/2037046877 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000649364", "group_name": "group_0000000000647429", "target": ["mon-mgr", ""]}) v1 -- 0x7f195c05f230 con 0x7f193c066f30 2023-10-06T04:40:18.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.096+0000 7f1952ffd700 1 -- 172.21.15.112:0/2037046877 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f195c05f230 con 0x7f193c066f30 2023-10-06T04:40:18.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.098+0000 7f195bfff700 1 -- 172.21.15.112:0/2037046877 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f193c066f30 msgr2=0x7f193c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:18.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.098+0000 7f195bfff700 1 --2- 172.21.15.112:0/2037046877 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f193c066f30 0x7f193c0693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1954000f80 tx=0x7f1954001a10 comp rx=0 tx=0).stop 2023-10-06T04:40:18.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.098+0000 7f195bfff700 1 -- 172.21.15.112:0/2037046877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f195c0d0a90 msgr2=0x7f195c13f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:18.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.098+0000 7f195bfff700 1 --2- 172.21.15.112:0/2037046877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f195c0d0a90 0x7f195c13f1c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f194400c590 tx=0x7f194400c8a0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.098+0000 7f195bfff700 1 -- 172.21.15.112:0/2037046877 shutdown_connections 2023-10-06T04:40:18.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.098+0000 7f195bfff700 1 --2- 172.21.15.112:0/2037046877 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f193c066f30 0x7f193c0693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.098+0000 7f195bfff700 1 --2- 172.21.15.112:0/2037046877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f195c157030 0x7f195c1519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.098+0000 7f195bfff700 1 --2- 172.21.15.112:0/2037046877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f195c0c5e00 0x7f195c13e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.098+0000 7f195bfff700 1 --2- 172.21.15.112:0/2037046877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f195c0d0a90 0x7f195c13f1c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.098+0000 7f195bfff700 1 -- 172.21.15.112:0/2037046877 >> 172.21.15.112:0/2037046877 conn(0x7f195c06c7d0 msgr2=0x7f195c0cca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:18.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.098+0000 7f195bfff700 1 -- 172.21.15.112:0/2037046877 shutdown_connections 2023-10-06T04:40:18.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.098+0000 7f195bfff700 1 -- 172.21.15.112:0/2037046877 wait complete. 2023-10-06T04:40:18.112 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000649362 group_0000000000647429 2023-10-06T04:40:18.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.227+0000 7fab76c96700 1 Processor -- start 2023-10-06T04:40:18.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.227+0000 7fab76c96700 1 -- start start 2023-10-06T04:40:18.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.228+0000 7fab76c96700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fab700cbf00 0x7fab7015b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:18.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.228+0000 7fab76c96700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab7006d3b0 0x7fab7015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:18.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.228+0000 7fab76c96700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab7015af50 con 0x7fab70159a20 2023-10-06T04:40:18.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.228+0000 7fab76c96700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab700cca70 con 0x7fab700cbf00 2023-10-06T04:40:18.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.228+0000 7fab76c96700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7008a080 con 0x7fab7006d3b0 2023-10-06T04:40:18.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.228+0000 7fab75233700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab7006d3b0 0x7fab7015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:18.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.228+0000 7fab75233700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab7006d3b0 0x7fab7015bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.112:49400/0 (socket says 172.21.15.112:49400) 2023-10-06T04:40:18.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.228+0000 7fab75233700 1 -- 172.21.15.112:0/3520853124 learned_addr learned my addr 172.21.15.112:0/3520853124 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:18.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.228+0000 7fab6ffff700 1 --2- 172.21.15.112:0/3520853124 >> v2:172.21.15.179:3300/0 conn(0x7fab700cbf00 0x7fab7015b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:18.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.229+0000 7fab75233700 1 -- 172.21.15.112:0/3520853124 >> v2:172.21.15.179:3300/0 conn(0x7fab700cbf00 msgr2=0x7fab7015b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:18.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.229+0000 7fab75233700 1 --2- 172.21.15.112:0/3520853124 >> v2:172.21.15.179:3300/0 conn(0x7fab700cbf00 0x7fab7015b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.229+0000 7fab75233700 1 -- 172.21.15.112:0/3520853124 >> v1:172.21.15.179:6789/0 conn(0x7fab70159a20 legacy=0x7fab700cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:18.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.229+0000 7fab75233700 1 -- 172.21.15.112:0/3520853124 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab700cae50 con 0x7fab7006d3b0 2023-10-06T04:40:18.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.229+0000 7fab6ffff700 1 --2- 172.21.15.112:0/3520853124 >> v2:172.21.15.179:3300/0 conn(0x7fab700cbf00 0x7fab7015b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:18.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.229+0000 7fab75233700 1 --2- 172.21.15.112:0/3520853124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab7006d3b0 0x7fab7015bc50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fab680099b0 tx=0x7fab68009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4278b74bfcb22ac0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:18.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.229+0000 7fab6f7fe700 1 -- 172.21.15.112:0/3520853124 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab68009ea0 con 0x7fab7006d3b0 2023-10-06T04:40:18.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.229+0000 7fab6f7fe700 1 -- 172.21.15.112:0/3520853124 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6800b860 con 0x7fab7006d3b0 2023-10-06T04:40:18.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.229+0000 7fab6f7fe700 1 -- 172.21.15.112:0/3520853124 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6800bc00 con 0x7fab7006d3b0 2023-10-06T04:40:18.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.229+0000 7fab76c96700 1 -- 172.21.15.112:0/3520853124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab7006d3b0 msgr2=0x7fab7015bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:18.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.229+0000 7fab76c96700 1 --2- 172.21.15.112:0/3520853124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab7006d3b0 0x7fab7015bc50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fab680099b0 tx=0x7fab68009250 comp rx=0 tx=0).stop 2023-10-06T04:40:18.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.229+0000 7fab76c96700 1 -- 172.21.15.112:0/3520853124 shutdown_connections 2023-10-06T04:40:18.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.229+0000 7fab76c96700 1 --2- 172.21.15.112:0/3520853124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab7006d3b0 0x7fab7015bc50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.229+0000 7fab76c96700 1 --2- 172.21.15.112:0/3520853124 >> v2:172.21.15.179:3300/0 conn(0x7fab700cbf00 0x7fab7015b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.229+0000 7fab76c96700 1 -- 172.21.15.112:0/3520853124 >> 172.21.15.112:0/3520853124 conn(0x7fab7006cfb0 msgr2=0x7fab700d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:18.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.229+0000 7fab76c96700 1 -- 172.21.15.112:0/3520853124 shutdown_connections 2023-10-06T04:40:18.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.230+0000 7fab76c96700 1 -- 172.21.15.112:0/3520853124 wait complete. 2023-10-06T04:40:18.236 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.230+0000 7fab76c96700 1 Processor -- start 2023-10-06T04:40:18.236 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.231+0000 7fab76c96700 1 -- start start 2023-10-06T04:40:18.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.231+0000 7fab76c96700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab7006d3b0 0x7fab700b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:18.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.231+0000 7fab76c96700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab700cbf00 0x7fab700b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:18.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.231+0000 7fab76c96700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab70159a20 0x7fab7016a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:18.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.231+0000 7fab76c96700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab700b1520 con 0x7fab7006d3b0 2023-10-06T04:40:18.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.231+0000 7fab76c96700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab701582a0 con 0x7fab700cbf00 2023-10-06T04:40:18.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.231+0000 7fab76c96700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab700b1750 con 0x7fab70159a20 2023-10-06T04:40:18.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.232+0000 7fab74a32700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab7006d3b0 0x7fab700b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:18.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.232+0000 7fab74a32700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab7006d3b0 0x7fab700b61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51672/0 (socket says 172.21.15.112:51672) 2023-10-06T04:40:18.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.232+0000 7fab74a32700 1 -- 172.21.15.112:0/2349659384 learned_addr learned my addr 172.21.15.112:0/2349659384 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:18.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.232+0000 7fab75233700 1 --2- 172.21.15.112:0/2349659384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab70159a20 0x7fab7016a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:18.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.232+0000 7fab6ffff700 1 --2- 172.21.15.112:0/2349659384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab700cbf00 0x7fab700b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:18.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.232+0000 7fab74a32700 1 -- 172.21.15.112:0/2349659384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab70159a20 msgr2=0x7fab7016a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:18.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.232+0000 7fab74a32700 1 --2- 172.21.15.112:0/2349659384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab70159a20 0x7fab7016a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.232+0000 7fab74a32700 1 -- 172.21.15.112:0/2349659384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab700cbf00 msgr2=0x7fab700b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:18.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.232+0000 7fab74a32700 1 --2- 172.21.15.112:0/2349659384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab700cbf00 0x7fab700b0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.232+0000 7fab74a32700 1 -- 172.21.15.112:0/2349659384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab64009420 con 0x7fab7006d3b0 2023-10-06T04:40:18.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.232+0000 7fab75233700 1 --2- 172.21.15.112:0/2349659384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab70159a20 0x7fab7016a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:18.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.232+0000 7fab74a32700 1 --2- 172.21.15.112:0/2349659384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab7006d3b0 0x7fab700b61e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fab6000c8e0 tx=0x7fab60001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:18.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.232+0000 7fab6cff9700 1 -- 172.21.15.112:0/2349659384 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6000ce80 con 0x7fab7006d3b0 2023-10-06T04:40:18.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.232+0000 7fab6cff9700 1 -- 172.21.15.112:0/2349659384 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6000a7e0 con 0x7fab7006d3b0 2023-10-06T04:40:18.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.232+0000 7fab76c96700 1 -- 172.21.15.112:0/2349659384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab680094f0 con 0x7fab7006d3b0 2023-10-06T04:40:18.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.232+0000 7fab6cff9700 1 -- 172.21.15.112:0/2349659384 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6000aba0 con 0x7fab7006d3b0 2023-10-06T04:40:18.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.232+0000 7fab76c96700 1 -- 172.21.15.112:0/2349659384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab700b1d10 con 0x7fab7006d3b0 2023-10-06T04:40:18.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.233+0000 7fab76c96700 1 -- 172.21.15.112:0/2349659384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab700b1f30 con 0x7fab7006d3b0 2023-10-06T04:40:18.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.234+0000 7fab6cff9700 1 -- 172.21.15.112:0/2349659384 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab60003030 con 0x7fab7006d3b0 2023-10-06T04:40:18.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.234+0000 7fab6cff9700 1 --2- 172.21.15.112:0/2349659384 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fab5c066f30 0x7fab5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:18.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.234+0000 7fab6ffff700 1 --2- 172.21.15.112:0/2349659384 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fab5c066f30 0x7fab5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:18.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.234+0000 7fab6cff9700 1 -- 172.21.15.112:0/2349659384 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fab600846f0 con 0x7fab7006d3b0 2023-10-06T04:40:18.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.235+0000 7fab6ffff700 1 --2- 172.21.15.112:0/2349659384 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fab5c066f30 0x7fab5c0693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fab640093f0 tx=0x7fab64008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:18.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.238+0000 7fab6cff9700 1 -- 172.21.15.112:0/2349659384 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab60055290 con 0x7fab7006d3b0 2023-10-06T04:40:18.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.451+0000 7fab76c96700 1 -- 172.21.15.112:0/2349659384 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000649362", "group_name": "group_0000000000647429", "target": ["mon-mgr", ""]}) v1 -- 0x7fab7005f230 con 0x7fab5c066f30 2023-10-06T04:40:18.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.467+0000 7fab6cff9700 1 -- 172.21.15.112:0/2349659384 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fab7005f230 con 0x7fab5c066f30 2023-10-06T04:40:18.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.469+0000 7fab76c96700 1 -- 172.21.15.112:0/2349659384 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fab5c066f30 msgr2=0x7fab5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:18.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.469+0000 7fab76c96700 1 --2- 172.21.15.112:0/2349659384 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fab5c066f30 0x7fab5c0693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fab640093f0 tx=0x7fab64008040 comp rx=0 tx=0).stop 2023-10-06T04:40:18.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.469+0000 7fab76c96700 1 -- 172.21.15.112:0/2349659384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab7006d3b0 msgr2=0x7fab700b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:18.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.469+0000 7fab76c96700 1 --2- 172.21.15.112:0/2349659384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab7006d3b0 0x7fab700b61e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fab6000c8e0 tx=0x7fab60001710 comp rx=0 tx=0).stop 2023-10-06T04:40:18.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.469+0000 7fab76c96700 1 -- 172.21.15.112:0/2349659384 shutdown_connections 2023-10-06T04:40:18.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.469+0000 7fab76c96700 1 --2- 172.21.15.112:0/2349659384 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fab5c066f30 0x7fab5c0693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.469+0000 7fab76c96700 1 --2- 172.21.15.112:0/2349659384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab70159a20 0x7fab7016a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.469+0000 7fab76c96700 1 --2- 172.21.15.112:0/2349659384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab7006d3b0 0x7fab700b61e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.469+0000 7fab76c96700 1 --2- 172.21.15.112:0/2349659384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab700cbf00 0x7fab700b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.469+0000 7fab76c96700 1 -- 172.21.15.112:0/2349659384 >> 172.21.15.112:0/2349659384 conn(0x7fab7006cfb0 msgr2=0x7fab70158af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:18.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.469+0000 7fab76c96700 1 -- 172.21.15.112:0/2349659384 shutdown_connections 2023-10-06T04:40:18.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.469+0000 7fab76c96700 1 -- 172.21.15.112:0/2349659384 wait complete. 2023-10-06T04:40:18.473 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:40:18.470+0000 7f1e75700700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T04:40:18.473 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:40:18.470+0000 7f1e75700700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T04:40:18.473 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:40:18.470+0000 7f1e75700700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T04:40:18.474 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:40:18.470+0000 7f1e75700700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T04:40:18.474 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:40:18.470+0000 7f1e75700700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T04:40:18.484 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000649363 group_0000000000647429 2023-10-06T04:40:18.487 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:40:18.485+0000 7f1e74eff700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T04:40:18.487 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:40:18.485+0000 7f1e74eff700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T04:40:18.487 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:40:18.485+0000 7f1e74eff700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T04:40:18.487 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:40:18.485+0000 7f1e74eff700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T04:40:18.487 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-10-06T04:40:18.485+0000 7f1e74eff700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T04:40:18.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.605+0000 7fced72f0700 1 Processor -- start 2023-10-06T04:40:18.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.605+0000 7fced72f0700 1 -- start start 2023-10-06T04:40:18.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.606+0000 7fced72f0700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced006d3b0 0x7fced015be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:18.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.606+0000 7fced72f0700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced015af50 con 0x7fced00cbf00 2023-10-06T04:40:18.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.606+0000 7fced72f0700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced00cae50 con 0x7fced0159a20 2023-10-06T04:40:18.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.606+0000 7fced72f0700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced00cca70 con 0x7fced006d3b0 2023-10-06T04:40:18.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.606+0000 7fced488b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fced00cbf00 0x7fced015b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34812/0 (socket says 172.21.15.112:34812) 2023-10-06T04:40:18.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.606+0000 7fced488b700 1 -- 172.21.15.112:0/1660741723 learned_addr learned my addr 172.21.15.112:0/1660741723 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:18.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.606+0000 7fced588d700 1 --2- 172.21.15.112:0/1660741723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced006d3b0 0x7fced015be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:18.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.606+0000 7fcec7fff700 1 -- 172.21.15.112:0/1660741723 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480507320 0 0) 0x7fced015af50 con 0x7fced00cbf00 2023-10-06T04:40:18.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.606+0000 7fcec7fff700 1 -- 172.21.15.112:0/1660741723 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcebc003570 con 0x7fced00cbf00 2023-10-06T04:40:18.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.606+0000 7fcec7fff700 1 -- 172.21.15.112:0/1660741723 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547954294 0 0) 0x7fced00cae50 con 0x7fced0159a20 2023-10-06T04:40:18.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.606+0000 7fcec7fff700 1 -- 172.21.15.112:0/1660741723 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fced015af50 con 0x7fced0159a20 2023-10-06T04:40:18.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.606+0000 7fcec7fff700 1 -- 172.21.15.112:0/1660741723 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2800066754 0 0) 0x7fcebc003570 con 0x7fced00cbf00 2023-10-06T04:40:18.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.606+0000 7fcec7fff700 1 -- 172.21.15.112:0/1660741723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced006d3b0 msgr2=0x7fced015be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:18.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.606+0000 7fcec7fff700 1 --2- 172.21.15.112:0/1660741723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced006d3b0 0x7fced015be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.606+0000 7fcec7fff700 1 -- 172.21.15.112:0/1660741723 >> v1:172.21.15.179:6789/0 conn(0x7fced0159a20 legacy=0x7fced00cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:18.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.606+0000 7fcec7fff700 1 -- 172.21.15.112:0/1660741723 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced00cb0f0 con 0x7fced00cbf00 2023-10-06T04:40:18.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.606+0000 7fcec7fff700 1 -- 172.21.15.112:0/1660741723 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7fcec0001470 con 0x7fced00cbf00 2023-10-06T04:40:18.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.607+0000 7fcec7fff700 1 -- 172.21.15.112:0/1660741723 >> v1:172.21.15.112:6789/0 conn(0x7fced00cbf00 legacy=0x7fced015b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:18.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.607+0000 7fcec7fff700 1 --2- 172.21.15.112:0/1660741723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced006d3b0 0x7fcebc003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:18.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.607+0000 7fcec7fff700 1 --2- 172.21.15.112:0/1660741723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcebc004180 0x7fcebc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:18.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.607+0000 7fcec7fff700 1 --2- 172.21.15.112:0/1660741723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcebc004d50 0x7fcebc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:18.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.607+0000 7fcec7fff700 1 -- 172.21.15.112:0/1660741723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced00cca70 con 0x7fcebc004180 2023-10-06T04:40:18.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.607+0000 7fcec7fff700 1 -- 172.21.15.112:0/1660741723 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc00bba0 con 0x7fcebc004d50 2023-10-06T04:40:18.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.607+0000 7fcec7fff700 1 -- 172.21.15.112:0/1660741723 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc00bd60 con 0x7fced006d3b0 2023-10-06T04:40:18.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.607+0000 7fced488b700 1 --2- 172.21.15.112:0/1660741723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcebc004180 0x7fcebc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:18.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.607+0000 7fced508c700 1 --2- 172.21.15.112:0/1660741723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced006d3b0 0x7fcebc003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:18.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.607+0000 7fced588d700 1 --2- 172.21.15.112:0/1660741723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcebc004d50 0x7fcebc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:18.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.607+0000 7fced488b700 1 -- 172.21.15.112:0/1660741723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced006d3b0 msgr2=0x7fcebc003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:18.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.607+0000 7fced488b700 1 --2- 172.21.15.112:0/1660741723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced006d3b0 0x7fcebc003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.607+0000 7fced488b700 1 -- 172.21.15.112:0/1660741723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcebc004d50 msgr2=0x7fcebc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:18.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.607+0000 7fced488b700 1 --2- 172.21.15.112:0/1660741723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcebc004d50 0x7fcebc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.607+0000 7fced488b700 1 -- 172.21.15.112:0/1660741723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc003570 con 0x7fcebc004180 2023-10-06T04:40:18.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.607+0000 7fced588d700 1 --2- 172.21.15.112:0/1660741723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcebc004d50 0x7fcebc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:18.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.607+0000 7fced488b700 1 --2- 172.21.15.112:0/1660741723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcebc004180 0x7fcebc004810 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcec000c2a0 tx=0x7fcec0001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6bd4e5af20b019 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:18.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.607+0000 7fcec7fff700 1 -- 172.21.15.112:0/1660741723 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec000cb90 con 0x7fcebc004180 2023-10-06T04:40:18.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.607+0000 7fcec7fff700 1 -- 172.21.15.112:0/1660741723 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec000ccf0 con 0x7fcebc004180 2023-10-06T04:40:18.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.607+0000 7fcec7fff700 1 -- 172.21.15.112:0/1660741723 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec0005b70 con 0x7fcebc004180 2023-10-06T04:40:18.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.608+0000 7fced72f0700 1 -- 172.21.15.112:0/1660741723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcebc004180 msgr2=0x7fcebc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:18.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.608+0000 7fced72f0700 1 --2- 172.21.15.112:0/1660741723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcebc004180 0x7fcebc004810 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcec000c2a0 tx=0x7fcec0001e10 comp rx=0 tx=0).stop 2023-10-06T04:40:18.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.608+0000 7fced588d700 1 -- 172.21.15.112:0/1660741723 reap_dead start 2023-10-06T04:40:18.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.608+0000 7fced72f0700 1 -- 172.21.15.112:0/1660741723 shutdown_connections 2023-10-06T04:40:18.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.608+0000 7fced72f0700 1 -- 172.21.15.112:0/1660741723 >> 172.21.15.112:0/1660741723 conn(0x7fced006cfb0 msgr2=0x7fced00d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:18.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.608+0000 7fced72f0700 1 -- 172.21.15.112:0/1660741723 shutdown_connections 2023-10-06T04:40:18.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.608+0000 7fced72f0700 1 -- 172.21.15.112:0/1660741723 wait complete. 2023-10-06T04:40:18.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.609+0000 7fced72f0700 1 Processor -- start 2023-10-06T04:40:18.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.609+0000 7fced72f0700 1 -- start start 2023-10-06T04:40:18.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fced72f0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcebc004180 0x7fced0153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:18.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fced72f0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fced009da90 0x7fced006db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:18.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fced72f0700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced009df00 0x7fced006e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:18.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fced72f0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced016b3c0 con 0x7fced009da90 2023-10-06T04:40:18.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fced72f0700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced00b6050 con 0x7fcebc004180 2023-10-06T04:40:18.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fced72f0700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced00b51f0 con 0x7fced009df00 2023-10-06T04:40:18.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fced488b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fced009da90 0x7fced006db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:18.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fced488b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fced009da90 0x7fced006db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51726/0 (socket says 172.21.15.112:51726) 2023-10-06T04:40:18.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fced488b700 1 -- 172.21.15.112:0/2960287054 learned_addr learned my addr 172.21.15.112:0/2960287054 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:18.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fced588d700 1 --2- 172.21.15.112:0/2960287054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced009df00 0x7fced006e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:18.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fced508c700 1 --2- 172.21.15.112:0/2960287054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcebc004180 0x7fced0153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:18.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fced488b700 1 -- 172.21.15.112:0/2960287054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced009df00 msgr2=0x7fced006e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:18.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fced488b700 1 --2- 172.21.15.112:0/2960287054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced009df00 0x7fced006e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fced488b700 1 -- 172.21.15.112:0/2960287054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcebc004180 msgr2=0x7fced0153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:18.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fced488b700 1 --2- 172.21.15.112:0/2960287054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcebc004180 0x7fced0153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fced488b700 1 -- 172.21.15.112:0/2960287054 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced00b5440 con 0x7fced009da90 2023-10-06T04:40:18.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fced588d700 1 --2- 172.21.15.112:0/2960287054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced009df00 0x7fced006e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:18.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fced488b700 1 --2- 172.21.15.112:0/2960287054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fced009da90 0x7fced006db00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fcec000c890 tx=0x7fcec0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:18.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fcec57fa700 1 -- 172.21.15.112:0/2960287054 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec0001b30 con 0x7fced009da90 2023-10-06T04:40:18.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fcec57fa700 1 -- 172.21.15.112:0/2960287054 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec0005b20 con 0x7fced009da90 2023-10-06T04:40:18.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fced72f0700 1 -- 172.21.15.112:0/2960287054 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced00b5720 con 0x7fced009da90 2023-10-06T04:40:18.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.610+0000 7fcec57fa700 1 -- 172.21.15.112:0/2960287054 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec0007320 con 0x7fced009da90 2023-10-06T04:40:18.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.611+0000 7fced72f0700 1 -- 172.21.15.112:0/2960287054 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced00b5ce0 con 0x7fced009da90 2023-10-06T04:40:18.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.611+0000 7fced72f0700 1 -- 172.21.15.112:0/2960287054 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced00b6200 con 0x7fced009da90 2023-10-06T04:40:18.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.612+0000 7fcec57fa700 1 -- 172.21.15.112:0/2960287054 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcec0019030 con 0x7fced009da90 2023-10-06T04:40:18.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.612+0000 7fcec57fa700 1 --2- 172.21.15.112:0/2960287054 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fceb4066f30 0x7fceb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:18.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.612+0000 7fcec57fa700 1 -- 172.21.15.112:0/2960287054 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcec0085bc0 con 0x7fced009da90 2023-10-06T04:40:18.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.612+0000 7fced508c700 1 --2- 172.21.15.112:0/2960287054 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fceb4066f30 0x7fceb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:18.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.613+0000 7fced508c700 1 --2- 172.21.15.112:0/2960287054 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fceb4066f30 0x7fceb40693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0010e0 tx=0x7fcecc007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:18.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.616+0000 7fcec57fa700 1 -- 172.21.15.112:0/2960287054 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fced00b6200 con 0x7fced009da90 2023-10-06T04:40:18.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.830+0000 7fced72f0700 1 -- 172.21.15.112:0/2960287054 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000649363", "group_name": "group_0000000000647429", "target": ["mon-mgr", ""]}) v1 -- 0x7fced00b6200 con 0x7fceb4066f30 2023-10-06T04:40:18.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.986+0000 7fcec57fa700 1 -- 172.21.15.112:0/2960287054 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fced00b6200 con 0x7fceb4066f30 2023-10-06T04:40:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.988+0000 7fced72f0700 1 -- 172.21.15.112:0/2960287054 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fceb4066f30 msgr2=0x7fceb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.988+0000 7fced72f0700 1 --2- 172.21.15.112:0/2960287054 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fceb4066f30 0x7fceb40693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0010e0 tx=0x7fcecc007d30 comp rx=0 tx=0).stop 2023-10-06T04:40:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.988+0000 7fced72f0700 1 -- 172.21.15.112:0/2960287054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fced009da90 msgr2=0x7fced006db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.988+0000 7fced72f0700 1 --2- 172.21.15.112:0/2960287054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fced009da90 0x7fced006db00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fcec000c890 tx=0x7fcec0015000 comp rx=0 tx=0).stop 2023-10-06T04:40:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.988+0000 7fced72f0700 1 -- 172.21.15.112:0/2960287054 shutdown_connections 2023-10-06T04:40:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.988+0000 7fced72f0700 1 --2- 172.21.15.112:0/2960287054 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fceb4066f30 0x7fceb40693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.988+0000 7fced72f0700 1 --2- 172.21.15.112:0/2960287054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced009df00 0x7fced006e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.988+0000 7fced72f0700 1 --2- 172.21.15.112:0/2960287054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcebc004180 0x7fced0153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.988+0000 7fced72f0700 1 --2- 172.21.15.112:0/2960287054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fced009da90 0x7fced006db00 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:18.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.988+0000 7fced72f0700 1 -- 172.21.15.112:0/2960287054 >> 172.21.15.112:0/2960287054 conn(0x7fced006cfb0 msgr2=0x7fced00cd990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:18.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.988+0000 7fced72f0700 1 -- 172.21.15.112:0/2960287054 shutdown_connections 2023-10-06T04:40:18.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:18.988+0000 7fced72f0700 1 -- 172.21.15.112:0/2960287054 wait complete. 2023-10-06T04:40:19.003 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000649364 group_0000000000647429 2023-10-06T04:40:19.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.159+0000 7fd44157a700 1 Processor -- start 2023-10-06T04:40:19.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.159+0000 7fd44157a700 1 -- start start 2023-10-06T04:40:19.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.160+0000 7fd44157a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd43c0cbf00 0x7fd43c15b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.160+0000 7fd44157a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43c15af50 con 0x7fd43c06d3b0 2023-10-06T04:40:19.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.160+0000 7fd44157a700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43c0cae50 con 0x7fd43c159a20 2023-10-06T04:40:19.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.160+0000 7fd44157a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43c0cca70 con 0x7fd43c0cbf00 2023-10-06T04:40:19.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.160+0000 7fd4327fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd43c0cbf00 0x7fd43c15b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.160+0000 7fd43b7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd43c06d3b0 0x7fd43c15bc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34820/0 (socket says 172.21.15.112:34820) 2023-10-06T04:40:19.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.160+0000 7fd43b7fe700 1 -- 172.21.15.112:0/1310848368 learned_addr learned my addr 172.21.15.112:0/1310848368 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:19.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.160+0000 7fd4327fc700 1 -- 172.21.15.112:0/1310848368 >> v1:172.21.15.179:6789/0 conn(0x7fd43c159a20 legacy=0x7fd43c0cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:19.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.160+0000 7fd43a7fc700 1 -- 172.21.15.112:0/1310848368 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555051886 0 0) 0x7fd43c15af50 con 0x7fd43c06d3b0 2023-10-06T04:40:19.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.160+0000 7fd4327fc700 1 -- 172.21.15.112:0/1310848368 >> v1:172.21.15.112:6789/0 conn(0x7fd43c06d3b0 legacy=0x7fd43c15bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.160+0000 7fd4327fc700 1 -- 172.21.15.112:0/1310848368 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c0cb0f0 con 0x7fd43c0cbf00 2023-10-06T04:40:19.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.160+0000 7fd4327fc700 1 --2- 172.21.15.112:0/1310848368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd43c0cbf00 0x7fd43c15b710 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd4240098e0 tx=0x7fd4240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b136865422a969 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:19.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.160+0000 7fd43a7fc700 1 -- 172.21.15.112:0/1310848368 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd424009e80 con 0x7fd43c0cbf00 2023-10-06T04:40:19.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.161+0000 7fd43a7fc700 1 -- 172.21.15.112:0/1310848368 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42400b820 con 0x7fd43c0cbf00 2023-10-06T04:40:19.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.161+0000 7fd43a7fc700 1 -- 172.21.15.112:0/1310848368 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42400bba0 con 0x7fd43c0cbf00 2023-10-06T04:40:19.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.161+0000 7fd44157a700 1 -- 172.21.15.112:0/1310848368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd43c0cbf00 msgr2=0x7fd43c15b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.161+0000 7fd44157a700 1 --2- 172.21.15.112:0/1310848368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd43c0cbf00 0x7fd43c15b710 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd4240098e0 tx=0x7fd4240091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.161+0000 7fd44157a700 1 -- 172.21.15.112:0/1310848368 shutdown_connections 2023-10-06T04:40:19.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.161+0000 7fd44157a700 1 --2- 172.21.15.112:0/1310848368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd43c0cbf00 0x7fd43c15b710 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.161+0000 7fd44157a700 1 -- 172.21.15.112:0/1310848368 >> 172.21.15.112:0/1310848368 conn(0x7fd43c06cfb0 msgr2=0x7fd43c0d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:19.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.161+0000 7fd44157a700 1 -- 172.21.15.112:0/1310848368 shutdown_connections 2023-10-06T04:40:19.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.161+0000 7fd44157a700 1 -- 172.21.15.112:0/1310848368 wait complete. 2023-10-06T04:40:19.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.162+0000 7fd44157a700 1 Processor -- start 2023-10-06T04:40:19.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.162+0000 7fd44157a700 1 -- start start 2023-10-06T04:40:19.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.163+0000 7fd44157a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd43c06d3b0 0x7fd43c158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.163+0000 7fd44157a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd43c0cbf00 0x7fd43c15ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.163+0000 7fd44157a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd43c159a20 0x7fd43c153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.163+0000 7fd44157a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c156d00 con 0x7fd43c159a20 2023-10-06T04:40:19.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.163+0000 7fd44157a700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c1560f0 con 0x7fd43c0cbf00 2023-10-06T04:40:19.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.163+0000 7fd44157a700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c1563d0 con 0x7fd43c06d3b0 2023-10-06T04:40:19.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.163+0000 7fd43b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd43c159a20 0x7fd43c153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.163+0000 7fd43b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd43c159a20 0x7fd43c153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51742/0 (socket says 172.21.15.112:51742) 2023-10-06T04:40:19.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.163+0000 7fd43b7fe700 1 -- 172.21.15.112:0/3497401106 learned_addr learned my addr 172.21.15.112:0/3497401106 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:19.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.163+0000 7fd4327fc700 1 --2- 172.21.15.112:0/3497401106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd43c0cbf00 0x7fd43c15ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.163+0000 7fd43affd700 1 --2- 172.21.15.112:0/3497401106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd43c06d3b0 0x7fd43c158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.164+0000 7fd43b7fe700 1 -- 172.21.15.112:0/3497401106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd43c06d3b0 msgr2=0x7fd43c158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.164+0000 7fd43b7fe700 1 --2- 172.21.15.112:0/3497401106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd43c06d3b0 0x7fd43c158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.164+0000 7fd43b7fe700 1 -- 172.21.15.112:0/3497401106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd43c0cbf00 msgr2=0x7fd43c15ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.164+0000 7fd43b7fe700 1 --2- 172.21.15.112:0/3497401106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd43c0cbf00 0x7fd43c15ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.164+0000 7fd43b7fe700 1 -- 172.21.15.112:0/3497401106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd424009420 con 0x7fd43c159a20 2023-10-06T04:40:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.164+0000 7fd43b7fe700 1 --2- 172.21.15.112:0/3497401106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd43c159a20 0x7fd43c153210 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd43400cbc0 tx=0x7fd434001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.164+0000 7fd4337fe700 1 -- 172.21.15.112:0/3497401106 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400a7e0 con 0x7fd43c159a20 2023-10-06T04:40:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.164+0000 7fd4337fe700 1 -- 172.21.15.112:0/3497401106 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43400a940 con 0x7fd43c159a20 2023-10-06T04:40:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.164+0000 7fd44157a700 1 -- 172.21.15.112:0/3497401106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd43c1566b0 con 0x7fd43c159a20 2023-10-06T04:40:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.164+0000 7fd4337fe700 1 -- 172.21.15.112:0/3497401106 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400ad00 con 0x7fd43c159a20 2023-10-06T04:40:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.164+0000 7fd44157a700 1 -- 172.21.15.112:0/3497401106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43c159170 con 0x7fd43c159a20 2023-10-06T04:40:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.165+0000 7fd44157a700 1 -- 172.21.15.112:0/3497401106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd43c156e70 con 0x7fd43c159a20 2023-10-06T04:40:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.165+0000 7fd4337fe700 1 -- 172.21.15.112:0/3497401106 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd434007300 con 0x7fd43c159a20 2023-10-06T04:40:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.166+0000 7fd4337fe700 1 --2- 172.21.15.112:0/3497401106 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd41c066f30 0x7fd41c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.166+0000 7fd4337fe700 1 -- 172.21.15.112:0/3497401106 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd434084930 con 0x7fd43c159a20 2023-10-06T04:40:19.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.166+0000 7fd43affd700 1 --2- 172.21.15.112:0/3497401106 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd41c066f30 0x7fd41c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.166+0000 7fd43affd700 1 --2- 172.21.15.112:0/3497401106 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd41c066f30 0x7fd41c0693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd42c003a30 tx=0x7fd42c007ea0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:19.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.170+0000 7fd4337fe700 1 -- 172.21.15.112:0/3497401106 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd434051ac0 con 0x7fd43c159a20 2023-10-06T04:40:19.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.381+0000 7fd44157a700 1 -- 172.21.15.112:0/3497401106 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000649364", "group_name": "group_0000000000647429", "target": ["mon-mgr", ""]}) v1 -- 0x7fd43c05f230 con 0x7fd41c066f30 2023-10-06T04:40:19.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.399+0000 7fd4337fe700 1 -- 172.21.15.112:0/3497401106 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd43c05f230 con 0x7fd41c066f30 2023-10-06T04:40:19.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.401+0000 7fd44157a700 1 -- 172.21.15.112:0/3497401106 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd41c066f30 msgr2=0x7fd41c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.401+0000 7fd44157a700 1 --2- 172.21.15.112:0/3497401106 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd41c066f30 0x7fd41c0693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd42c003a30 tx=0x7fd42c007ea0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.401+0000 7fd44157a700 1 -- 172.21.15.112:0/3497401106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd43c159a20 msgr2=0x7fd43c153210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.401+0000 7fd44157a700 1 --2- 172.21.15.112:0/3497401106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd43c159a20 0x7fd43c153210 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd43400cbc0 tx=0x7fd434001980 comp rx=0 tx=0).stop 2023-10-06T04:40:19.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.401+0000 7fd44157a700 1 -- 172.21.15.112:0/3497401106 shutdown_connections 2023-10-06T04:40:19.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.401+0000 7fd44157a700 1 --2- 172.21.15.112:0/3497401106 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd41c066f30 0x7fd41c0693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.401+0000 7fd44157a700 1 --2- 172.21.15.112:0/3497401106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd43c159a20 0x7fd43c153210 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.401+0000 7fd44157a700 1 --2- 172.21.15.112:0/3497401106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd43c06d3b0 0x7fd43c158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.401+0000 7fd44157a700 1 --2- 172.21.15.112:0/3497401106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd43c0cbf00 0x7fd43c15ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.401+0000 7fd44157a700 1 -- 172.21.15.112:0/3497401106 >> 172.21.15.112:0/3497401106 conn(0x7fd43c06cfb0 msgr2=0x7fd43c0cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:19.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.401+0000 7fd44157a700 1 -- 172.21.15.112:0/3497401106 shutdown_connections 2023-10-06T04:40:19.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.401+0000 7fd44157a700 1 -- 172.21.15.112:0/3497401106 wait complete. 2023-10-06T04:40:19.416 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs group_0000000000647429 2023-10-06T04:40:19.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.531+0000 7f13427cc700 1 Processor -- start 2023-10-06T04:40:19.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.531+0000 7f13427cc700 1 -- start start 2023-10-06T04:40:19.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.532+0000 7f13427cc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f133c159a20 0x7f133c0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.532+0000 7f13427cc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f133c15af50 con 0x7f133c06d3b0 2023-10-06T04:40:19.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.532+0000 7f13427cc700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f133c15e370 con 0x7f133c15c720 2023-10-06T04:40:19.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.532+0000 7f13427cc700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133c0cca70 con 0x7f133c159a20 2023-10-06T04:40:19.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.532+0000 7f133bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f133c159a20 0x7f133c0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.532+0000 7f133b7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f133c06d3b0 0x7f133c15d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34824/0 (socket says 172.21.15.112:34824) 2023-10-06T04:40:19.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.532+0000 7f133b7fe700 1 -- 172.21.15.112:0/3573924775 learned_addr learned my addr 172.21.15.112:0/3573924775 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:19.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.532+0000 7f133bfff700 1 -- 172.21.15.112:0/3573924775 >> v1:172.21.15.179:6789/0 conn(0x7f133c15c720 legacy=0x7f133c15dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.532+0000 7f133bfff700 1 -- 172.21.15.112:0/3573924775 >> v1:172.21.15.112:6789/0 conn(0x7f133c06d3b0 legacy=0x7f133c15d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.532+0000 7f133affd700 1 -- 172.21.15.112:0/3573924775 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660907876 0 0) 0x7f133c15af50 con 0x7f133c06d3b0 2023-10-06T04:40:19.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.532+0000 7f133bfff700 1 -- 172.21.15.112:0/3573924775 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c0cae50 con 0x7f133c159a20 2023-10-06T04:40:19.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.532+0000 7f133bfff700 1 --2- 172.21.15.112:0/3573924775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c159a20 0x7f133c0cb7f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f132c0098e0 tx=0x7f132c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a10716cf2cdfa15 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:19.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.533+0000 7f133affd700 1 -- 172.21.15.112:0/3573924775 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c009e80 con 0x7f133c159a20 2023-10-06T04:40:19.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.533+0000 7f133affd700 1 -- 172.21.15.112:0/3573924775 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c00b860 con 0x7f133c159a20 2023-10-06T04:40:19.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.533+0000 7f133affd700 1 -- 172.21.15.112:0/3573924775 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c00bbe0 con 0x7f133c159a20 2023-10-06T04:40:19.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.533+0000 7f13427cc700 1 -- 172.21.15.112:0/3573924775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c159a20 msgr2=0x7f133c0cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.533+0000 7f13427cc700 1 --2- 172.21.15.112:0/3573924775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c159a20 0x7f133c0cb7f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f132c0098e0 tx=0x7f132c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.533+0000 7f13427cc700 1 -- 172.21.15.112:0/3573924775 shutdown_connections 2023-10-06T04:40:19.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.533+0000 7f13427cc700 1 --2- 172.21.15.112:0/3573924775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c159a20 0x7f133c0cb7f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.533+0000 7f13427cc700 1 -- 172.21.15.112:0/3573924775 >> 172.21.15.112:0/3573924775 conn(0x7f133c06cfb0 msgr2=0x7f133c0d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:19.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.533+0000 7f13427cc700 1 -- 172.21.15.112:0/3573924775 shutdown_connections 2023-10-06T04:40:19.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.533+0000 7f13427cc700 1 -- 172.21.15.112:0/3573924775 wait complete. 2023-10-06T04:40:19.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.534+0000 7f13427cc700 1 Processor -- start 2023-10-06T04:40:19.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.534+0000 7f13427cc700 1 -- start start 2023-10-06T04:40:19.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.535+0000 7f13427cc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f133c06d3b0 0x7f133c16d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.535+0000 7f13427cc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f133c159a20 0x7f133c16ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.535+0000 7f13427cc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c15c720 0x7f133c06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.535+0000 7f13427cc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c16b090 con 0x7f133c15c720 2023-10-06T04:40:19.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.535+0000 7f13427cc700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0b2270 con 0x7f133c06d3b0 2023-10-06T04:40:19.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.535+0000 7f13427cc700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c16ddd0 con 0x7f133c159a20 2023-10-06T04:40:19.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.535+0000 7f1340d69700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c15c720 0x7f133c06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.535+0000 7f1340d69700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c15c720 0x7f133c06dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51764/0 (socket says 172.21.15.112:51764) 2023-10-06T04:40:19.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.535+0000 7f1340d69700 1 -- 172.21.15.112:0/1820788396 learned_addr learned my addr 172.21.15.112:0/1820788396 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:19.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.535+0000 7f133bfff700 1 --2- 172.21.15.112:0/1820788396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f133c06d3b0 0x7f133c16d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.535+0000 7f133b7fe700 1 --2- 172.21.15.112:0/1820788396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f133c159a20 0x7f133c16ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.536+0000 7f1340d69700 1 -- 172.21.15.112:0/1820788396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f133c159a20 msgr2=0x7f133c16ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.536+0000 7f1340d69700 1 --2- 172.21.15.112:0/1820788396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f133c159a20 0x7f133c16ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.536+0000 7f1340d69700 1 -- 172.21.15.112:0/1820788396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f133c06d3b0 msgr2=0x7f133c16d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.536+0000 7f1340d69700 1 --2- 172.21.15.112:0/1820788396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f133c06d3b0 0x7f133c16d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.536+0000 7f1340d69700 1 -- 172.21.15.112:0/1820788396 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c009420 con 0x7f133c15c720 2023-10-06T04:40:19.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.536+0000 7f1340d69700 1 --2- 172.21.15.112:0/1820788396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c15c720 0x7f133c06dd50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f133400c8e0 tx=0x7f1334001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:19.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.536+0000 7f1323fff700 1 -- 172.21.15.112:0/1820788396 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1334012630 con 0x7f133c15c720 2023-10-06T04:40:19.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.536+0000 7f1323fff700 1 -- 172.21.15.112:0/1820788396 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1334012790 con 0x7f133c15c720 2023-10-06T04:40:19.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.536+0000 7f13427cc700 1 -- 172.21.15.112:0/1820788396 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c16e0b0 con 0x7f133c15c720 2023-10-06T04:40:19.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.536+0000 7f1323fff700 1 -- 172.21.15.112:0/1820788396 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1334012b50 con 0x7f133c15c720 2023-10-06T04:40:19.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.536+0000 7f13427cc700 1 -- 172.21.15.112:0/1820788396 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133c06e290 con 0x7f133c15c720 2023-10-06T04:40:19.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.537+0000 7f13427cc700 1 -- 172.21.15.112:0/1820788396 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c16e5d0 con 0x7f133c15c720 2023-10-06T04:40:19.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.537+0000 7f1323fff700 1 -- 172.21.15.112:0/1820788396 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f133400a3b0 con 0x7f133c15c720 2023-10-06T04:40:19.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.537+0000 7f1323fff700 1 --2- 172.21.15.112:0/1820788396 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1328066f30 0x7f13280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:19.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.538+0000 7f1323fff700 1 -- 172.21.15.112:0/1820788396 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f13340849b0 con 0x7f133c15c720 2023-10-06T04:40:19.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.538+0000 7f133bfff700 1 --2- 172.21.15.112:0/1820788396 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1328066f30 0x7f13280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:19.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.538+0000 7f133bfff700 1 --2- 172.21.15.112:0/1820788396 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1328066f30 0x7f13280693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f132c0093f0 tx=0x7f132c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:19.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.542+0000 7f1323fff700 1 -- 172.21.15.112:0/1820788396 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1334051a20 con 0x7f133c15c720 2023-10-06T04:40:19.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.552+0000 7f1323fff700 1 -- 172.21.15.112:0/1820788396 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f1334051df0 con 0x7f133c15c720 2023-10-06T04:40:19.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.758+0000 7f13427cc700 1 -- 172.21.15.112:0/1820788396 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "group_0000000000647429", "target": ["mon-mgr", ""]}) v1 -- 0x7f133c0b20f0 con 0x7f1328066f30 2023-10-06T04:40:19.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.763+0000 7f1323fff700 1 -- 172.21.15.112:0/1820788396 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f132c020040 con 0x7f1328066f30 2023-10-06T04:40:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.765+0000 7f13427cc700 1 -- 172.21.15.112:0/1820788396 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1328066f30 msgr2=0x7f13280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.765+0000 7f13427cc700 1 --2- 172.21.15.112:0/1820788396 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1328066f30 0x7f13280693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f132c0093f0 tx=0x7f132c017000 comp rx=0 tx=0).stop 2023-10-06T04:40:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.765+0000 7f13427cc700 1 -- 172.21.15.112:0/1820788396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c15c720 msgr2=0x7f133c06dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.765+0000 7f13427cc700 1 --2- 172.21.15.112:0/1820788396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c15c720 0x7f133c06dd50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f133400c8e0 tx=0x7f1334001710 comp rx=0 tx=0).stop 2023-10-06T04:40:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.765+0000 7f13427cc700 1 -- 172.21.15.112:0/1820788396 shutdown_connections 2023-10-06T04:40:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.765+0000 7f13427cc700 1 --2- 172.21.15.112:0/1820788396 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1328066f30 0x7f13280693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.765+0000 7f13427cc700 1 --2- 172.21.15.112:0/1820788396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c15c720 0x7f133c06dd50 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.765+0000 7f13427cc700 1 --2- 172.21.15.112:0/1820788396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f133c06d3b0 0x7f133c16d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.765+0000 7f13427cc700 1 --2- 172.21.15.112:0/1820788396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f133c159a20 0x7f133c16ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:19.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.765+0000 7f13427cc700 1 -- 172.21.15.112:0/1820788396 >> 172.21.15.112:0/1820788396 conn(0x7f133c06cfb0 msgr2=0x7f133c0cb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:19.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.765+0000 7f13427cc700 1 -- 172.21.15.112:0/1820788396 shutdown_connections 2023-10-06T04:40:19.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:19.766+0000 7f13427cc700 1 -- 172.21.15.112:0/1820788396 wait complete. 2023-10-06T04:40:19.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:40:19.780 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-10-06T04:40:19.812 INFO:teuthology.orchestra.run.smithi112.stdout:2 2023-10-06T04:40:19.813 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T04:40:19.813 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:40:19.891 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:40:19.932 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T04:40:19.932 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T04:40:19.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:40:19.932 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T04:40:19.972 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-10-06T04:40:19.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:19.972 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T04:40:20.027 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T04:40:20.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:40:20.028 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T04:40:20.074 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-10-06T04:40:20.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:20.074 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T04:40:20.091 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:20.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.202+0000 7f05d70ee700 1 Processor -- start 2023-10-06T04:40:20.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.202+0000 7f05d70ee700 1 -- start start 2023-10-06T04:40:20.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.203+0000 7f05d70ee700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d0157490 0x7f05d00688f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.203+0000 7f05d70ee700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f05d0069720 0x7f05d0069b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.203+0000 7f05d70ee700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d006a0d0 con 0x7f05d00cc4e0 2023-10-06T04:40:20.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.203+0000 7f05d70ee700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d0158e60 con 0x7f05d0069720 2023-10-06T04:40:20.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.203+0000 7f05d70ee700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d0068460 con 0x7f05d0157490 2023-10-06T04:40:20.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.203+0000 7f05cffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f05d0069720 0x7f05d0069b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.203+0000 7f05d568b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f05d00cc4e0 0x7f05d00cc920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34826/0 (socket says 172.21.15.112:34826) 2023-10-06T04:40:20.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.203+0000 7f05d568b700 1 -- 172.21.15.112:0/2437373227 learned_addr learned my addr 172.21.15.112:0/2437373227 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:20.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.203+0000 7f05d4e8a700 1 --2- 172.21.15.112:0/2437373227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d0157490 0x7f05d00688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.203+0000 7f05cffff700 1 -- 172.21.15.112:0/2437373227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d0157490 msgr2=0x7f05d00688f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.203+0000 7f05cffff700 1 --2- 172.21.15.112:0/2437373227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d0157490 0x7f05d00688f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.203+0000 7f05cffff700 1 -- 172.21.15.112:0/2437373227 >> v1:172.21.15.112:6789/0 conn(0x7f05d00cc4e0 legacy=0x7f05d00cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.203+0000 7f05cf7fe700 1 -- 172.21.15.112:0/2437373227 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108669421 0 0) 0x7f05d006a0d0 con 0x7f05d00cc4e0 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.203+0000 7f05cffff700 1 -- 172.21.15.112:0/2437373227 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d01588a0 con 0x7f05d0069720 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.203+0000 7f05cffff700 1 --2- 172.21.15.112:0/2437373227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05d0069720 0x7f05d0069b90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0098e0 tx=0x7f05bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966682496e4fab90 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.203+0000 7f05cf7fe700 1 -- 172.21.15.112:0/2437373227 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc009e80 con 0x7f05d0069720 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.203+0000 7f05cf7fe700 1 -- 172.21.15.112:0/2437373227 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc00b860 con 0x7f05d0069720 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.204+0000 7f05cf7fe700 1 -- 172.21.15.112:0/2437373227 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc00bbe0 con 0x7f05d0069720 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.204+0000 7f05d70ee700 1 -- 172.21.15.112:0/2437373227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05d0069720 msgr2=0x7f05d0069b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.204+0000 7f05d70ee700 1 --2- 172.21.15.112:0/2437373227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05d0069720 0x7f05d0069b90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0098e0 tx=0x7f05bc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.204+0000 7f05d70ee700 1 -- 172.21.15.112:0/2437373227 shutdown_connections 2023-10-06T04:40:20.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.204+0000 7f05d70ee700 1 --2- 172.21.15.112:0/2437373227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d0157490 0x7f05d00688f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.204+0000 7f05d70ee700 1 --2- 172.21.15.112:0/2437373227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05d0069720 0x7f05d0069b90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.204+0000 7f05d70ee700 1 -- 172.21.15.112:0/2437373227 >> 172.21.15.112:0/2437373227 conn(0x7f05d00ce630 msgr2=0x7f05d00cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:20.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.204+0000 7f05d70ee700 1 -- 172.21.15.112:0/2437373227 shutdown_connections 2023-10-06T04:40:20.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.204+0000 7f05d70ee700 1 -- 172.21.15.112:0/2437373227 wait complete. 2023-10-06T04:40:20.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.205+0000 7f05d70ee700 1 Processor -- start 2023-10-06T04:40:20.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.205+0000 7f05d70ee700 1 -- start start 2023-10-06T04:40:20.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.206+0000 7f05d70ee700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05d0069720 0x7f05d015b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.206+0000 7f05d70ee700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05d00cc4e0 0x7f05d00b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.206+0000 7f05d70ee700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d0157490 0x7f05d00b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.206+0000 7f05d70ee700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d015b810 con 0x7f05d0069720 2023-10-06T04:40:20.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.206+0000 7f05d70ee700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d015c610 con 0x7f05d00cc4e0 2023-10-06T04:40:20.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.206+0000 7f05d70ee700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00b3120 con 0x7f05d0157490 2023-10-06T04:40:20.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.206+0000 7f05d4e8a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05d0069720 0x7f05d015b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.206+0000 7f05d4e8a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05d0069720 0x7f05d015b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51774/0 (socket says 172.21.15.112:51774) 2023-10-06T04:40:20.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.206+0000 7f05d4e8a700 1 -- 172.21.15.112:0/2020416277 learned_addr learned my addr 172.21.15.112:0/2020416277 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:20.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.206+0000 7f05d568b700 1 --2- 172.21.15.112:0/2020416277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d0157490 0x7f05d00b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.206+0000 7f05cffff700 1 --2- 172.21.15.112:0/2020416277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05d00cc4e0 0x7f05d00b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.206+0000 7f05d4e8a700 1 -- 172.21.15.112:0/2020416277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d0157490 msgr2=0x7f05d00b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.206+0000 7f05d4e8a700 1 --2- 172.21.15.112:0/2020416277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d0157490 0x7f05d00b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.206+0000 7f05d4e8a700 1 -- 172.21.15.112:0/2020416277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05d00cc4e0 msgr2=0x7f05d00b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.206+0000 7f05d4e8a700 1 --2- 172.21.15.112:0/2020416277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05d00cc4e0 0x7f05d00b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.206+0000 7f05d4e8a700 1 -- 172.21.15.112:0/2020416277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc009420 con 0x7f05d0069720 2023-10-06T04:40:20.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.206+0000 7f05cffff700 1 --2- 172.21.15.112:0/2020416277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05d00cc4e0 0x7f05d00b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:20.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.206+0000 7f05d4e8a700 1 --2- 172.21.15.112:0/2020416277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05d0069720 0x7f05d015b2d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f05c400d890 tx=0x7f05c4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:20.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.207+0000 7f05ccff9700 1 -- 172.21.15.112:0/2020416277 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c40125f0 con 0x7f05d0069720 2023-10-06T04:40:20.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.207+0000 7f05ccff9700 1 -- 172.21.15.112:0/2020416277 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c4012750 con 0x7f05d0069720 2023-10-06T04:40:20.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.207+0000 7f05ccff9700 1 -- 172.21.15.112:0/2020416277 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c4012ad0 con 0x7f05d0069720 2023-10-06T04:40:20.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.207+0000 7f05d70ee700 1 -- 172.21.15.112:0/2020416277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d015ba00 con 0x7f05d0069720 2023-10-06T04:40:20.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.207+0000 7f05d70ee700 1 -- 172.21.15.112:0/2020416277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d015c040 con 0x7f05d0069720 2023-10-06T04:40:20.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.208+0000 7f05d70ee700 1 -- 172.21.15.112:0/2020416277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d005f230 con 0x7f05d0069720 2023-10-06T04:40:20.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.208+0000 7f05ccff9700 1 -- 172.21.15.112:0/2020416277 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f05c401e460 con 0x7f05d0069720 2023-10-06T04:40:20.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.208+0000 7f05ccff9700 1 --2- 172.21.15.112:0/2020416277 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f05b40670e0 0x7f05b4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.208+0000 7f05ccff9700 1 -- 172.21.15.112:0/2020416277 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f05c4084fc0 con 0x7f05d0069720 2023-10-06T04:40:20.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.208+0000 7f05cffff700 1 --2- 172.21.15.112:0/2020416277 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f05b40670e0 0x7f05b4069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.209+0000 7f05cffff700 1 --2- 172.21.15.112:0/2020416277 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f05b40670e0 0x7f05b4069590 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0091e0 tx=0x7f05bc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:20.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.213+0000 7f05ccff9700 1 -- 172.21.15.112:0/2020416277 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05c4051e50 con 0x7f05d0069720 2023-10-06T04:40:20.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.437+0000 7f05d70ee700 1 -- 172.21.15.112:0/2020416277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05d0071030 con 0x7f05d0069720 2023-10-06T04:40:20.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.438+0000 7f05ccff9700 1 -- 172.21.15.112:0/2020416277 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f05c4055470 con 0x7f05d0069720 2023-10-06T04:40:20.572 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:20.572 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1053109253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1053109253},{"type":"v1","addr":"172.21.15.179:6835","nonce":1053109253}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4974,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3563478163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3563478163},{"type":"v1","addr":"172.21.15.112:6836","nonce":3563478163}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4977,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/925043938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":925043938},{"type":"v1","addr":"172.21.15.112:6837","nonce":925043938}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:06.223840+0000","modified":"2023-10-06T04:40:09.873795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1886371745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1886371745},{"type":"v1","addr":"172.21.15.179:6834","nonce":1886371745}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:40:20.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.440+0000 7f05d70ee700 1 -- 172.21.15.112:0/2020416277 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f05b40670e0 msgr2=0x7f05b4069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.440+0000 7f05d70ee700 1 --2- 172.21.15.112:0/2020416277 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f05b40670e0 0x7f05b4069590 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0091e0 tx=0x7f05bc017000 comp rx=0 tx=0).stop 2023-10-06T04:40:20.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.440+0000 7f05d70ee700 1 -- 172.21.15.112:0/2020416277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05d0069720 msgr2=0x7f05d015b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.440+0000 7f05d70ee700 1 --2- 172.21.15.112:0/2020416277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05d0069720 0x7f05d015b2d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f05c400d890 tx=0x7f05c4008040 comp rx=0 tx=0).stop 2023-10-06T04:40:20.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.440+0000 7f05d70ee700 1 -- 172.21.15.112:0/2020416277 shutdown_connections 2023-10-06T04:40:20.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.440+0000 7f05d70ee700 1 --2- 172.21.15.112:0/2020416277 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f05b40670e0 0x7f05b4069590 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.440+0000 7f05d70ee700 1 --2- 172.21.15.112:0/2020416277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d0157490 0x7f05d00b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.440+0000 7f05d70ee700 1 --2- 172.21.15.112:0/2020416277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05d0069720 0x7f05d015b2d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.440+0000 7f05d70ee700 1 --2- 172.21.15.112:0/2020416277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05d00cc4e0 0x7f05d00b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.440+0000 7f05d70ee700 1 -- 172.21.15.112:0/2020416277 >> 172.21.15.112:0/2020416277 conn(0x7f05d00ce630 msgr2=0x7f05d00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:20.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.440+0000 7f05d70ee700 1 -- 172.21.15.112:0/2020416277 shutdown_connections 2023-10-06T04:40:20.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.440+0000 7f05d70ee700 1 -- 172.21.15.112:0/2020416277 wait complete. 2023-10-06T04:40:20.576 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 16 2023-10-06T04:40:20.576 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:20.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.689+0000 7fda1ae0a700 1 Processor -- start 2023-10-06T04:40:20.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.689+0000 7fda1ae0a700 1 -- start start 2023-10-06T04:40:20.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.690+0000 7fda1ae0a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fda140b3040 0x7fda140cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.690+0000 7fda1ae0a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda140b0e70 0x7fda140b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.690+0000 7fda1ae0a700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda140b1810 con 0x7fda14159d50 2023-10-06T04:40:20.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.690+0000 7fda1ae0a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda140b3490 con 0x7fda140b3040 2023-10-06T04:40:20.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.690+0000 7fda1ae0a700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda140cd740 con 0x7fda140b0e70 2023-10-06T04:40:20.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.690+0000 7fda13fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fda140b3040 0x7fda140cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.690+0000 7fda13fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fda140b3040 0x7fda140cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51780/0 (socket says 172.21.15.112:51780) 2023-10-06T04:40:20.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.690+0000 7fda13fff700 1 -- 172.21.15.112:0/1487588879 learned_addr learned my addr 172.21.15.112:0/1487588879 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:20.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.690+0000 7fda193a7700 1 --2- 172.21.15.112:0/1487588879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda140b0e70 0x7fda140b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.690+0000 7fda13fff700 1 -- 172.21.15.112:0/1487588879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda140b0e70 msgr2=0x7fda140b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:20.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.690+0000 7fda13fff700 1 --2- 172.21.15.112:0/1487588879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda140b0e70 0x7fda140b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.690+0000 7fda13fff700 1 -- 172.21.15.112:0/1487588879 >> v1:172.21.15.179:6789/0 conn(0x7fda14159d50 legacy=0x7fda1415a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.691+0000 7fda13fff700 1 -- 172.21.15.112:0/1487588879 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda140ccb30 con 0x7fda140b3040 2023-10-06T04:40:20.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.691+0000 7fda13fff700 1 --2- 172.21.15.112:0/1487588879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda140b3040 0x7fda140cdbd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fda080099b0 tx=0x7fda08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db14e04902d1a150 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:20.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.691+0000 7fda137fe700 1 -- 172.21.15.112:0/1487588879 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0800b860 con 0x7fda140b3040 2023-10-06T04:40:20.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.691+0000 7fda137fe700 1 -- 172.21.15.112:0/1487588879 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0800b9c0 con 0x7fda140b3040 2023-10-06T04:40:20.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.691+0000 7fda137fe700 1 -- 172.21.15.112:0/1487588879 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0800bd60 con 0x7fda140b3040 2023-10-06T04:40:20.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.691+0000 7fda1ae0a700 1 -- 172.21.15.112:0/1487588879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda140b3040 msgr2=0x7fda140cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.691+0000 7fda1ae0a700 1 --2- 172.21.15.112:0/1487588879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda140b3040 0x7fda140cdbd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fda080099b0 tx=0x7fda08009250 comp rx=0 tx=0).stop 2023-10-06T04:40:20.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.691+0000 7fda1ae0a700 1 -- 172.21.15.112:0/1487588879 shutdown_connections 2023-10-06T04:40:20.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.691+0000 7fda1ae0a700 1 --2- 172.21.15.112:0/1487588879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda140b0e70 0x7fda140b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.691+0000 7fda1ae0a700 1 --2- 172.21.15.112:0/1487588879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda140b3040 0x7fda140cdbd0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.691+0000 7fda1ae0a700 1 -- 172.21.15.112:0/1487588879 >> 172.21.15.112:0/1487588879 conn(0x7fda14099b60 msgr2=0x7fda1406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:20.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.691+0000 7fda1ae0a700 1 -- 172.21.15.112:0/1487588879 shutdown_connections 2023-10-06T04:40:20.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.691+0000 7fda1ae0a700 1 -- 172.21.15.112:0/1487588879 wait complete. 2023-10-06T04:40:20.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.692+0000 7fda1ae0a700 1 Processor -- start 2023-10-06T04:40:20.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.693+0000 7fda1ae0a700 1 -- start start 2023-10-06T04:40:20.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.693+0000 7fda1ae0a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda140b0e70 0x7fda1414d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.693+0000 7fda1ae0a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda140b3040 0x7fda1415d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.693+0000 7fda1ae0a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda14159d50 0x7fda1414e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.693+0000 7fda1ae0a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1415ecc0 con 0x7fda140b0e70 2023-10-06T04:40:20.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.693+0000 7fda1ae0a700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1415f150 con 0x7fda140b3040 2023-10-06T04:40:20.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.693+0000 7fda1ae0a700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1415e0b0 con 0x7fda14159d50 2023-10-06T04:40:20.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.693+0000 7fda18ba6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda140b0e70 0x7fda1414d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.693+0000 7fda18ba6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda140b0e70 0x7fda1414d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51794/0 (socket says 172.21.15.112:51794) 2023-10-06T04:40:20.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.693+0000 7fda18ba6700 1 -- 172.21.15.112:0/1882190972 learned_addr learned my addr 172.21.15.112:0/1882190972 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:20.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.694+0000 7fda13fff700 1 --2- 172.21.15.112:0/1882190972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda140b3040 0x7fda1415d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.694+0000 7fda193a7700 1 --2- 172.21.15.112:0/1882190972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda14159d50 0x7fda1414e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.694+0000 7fda18ba6700 1 -- 172.21.15.112:0/1882190972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda14159d50 msgr2=0x7fda1414e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.694+0000 7fda18ba6700 1 --2- 172.21.15.112:0/1882190972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda14159d50 0x7fda1414e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.694+0000 7fda18ba6700 1 -- 172.21.15.112:0/1882190972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda140b3040 msgr2=0x7fda1415d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.694+0000 7fda18ba6700 1 --2- 172.21.15.112:0/1882190972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda140b3040 0x7fda1415d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.694+0000 7fda18ba6700 1 -- 172.21.15.112:0/1882190972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda080094f0 con 0x7fda140b0e70 2023-10-06T04:40:20.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.694+0000 7fda18ba6700 1 --2- 172.21.15.112:0/1882190972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda140b0e70 0x7fda1414d9e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fda0400c590 tx=0x7fda0400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:20.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.694+0000 7fda10ff9700 1 -- 172.21.15.112:0/1882190972 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda04011590 con 0x7fda140b0e70 2023-10-06T04:40:20.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.694+0000 7fda10ff9700 1 -- 172.21.15.112:0/1882190972 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda040116f0 con 0x7fda140b0e70 2023-10-06T04:40:20.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.694+0000 7fda10ff9700 1 -- 172.21.15.112:0/1882190972 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda04011ab0 con 0x7fda140b0e70 2023-10-06T04:40:20.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.694+0000 7fda1ae0a700 1 -- 172.21.15.112:0/1882190972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1415e390 con 0x7fda140b0e70 2023-10-06T04:40:20.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.694+0000 7fda1ae0a700 1 -- 172.21.15.112:0/1882190972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1415e950 con 0x7fda140b0e70 2023-10-06T04:40:20.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.695+0000 7fda1ae0a700 1 -- 172.21.15.112:0/1882190972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1415efa0 con 0x7fda140b0e70 2023-10-06T04:40:20.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.695+0000 7fda10ff9700 1 -- 172.21.15.112:0/1882190972 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fda0401b3b0 con 0x7fda140b0e70 2023-10-06T04:40:20.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.696+0000 7fda10ff9700 1 --2- 172.21.15.112:0/1882190972 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fda000670e0 0x7fda00069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:20.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.696+0000 7fda10ff9700 1 -- 172.21.15.112:0/1882190972 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fda04083dd0 con 0x7fda140b0e70 2023-10-06T04:40:20.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.696+0000 7fda13fff700 1 --2- 172.21.15.112:0/1882190972 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fda000670e0 0x7fda00069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:20.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.696+0000 7fda13fff700 1 --2- 172.21.15.112:0/1882190972 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fda000670e0 0x7fda00069590 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fda080099b0 tx=0x7fda08017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:20.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.700+0000 7fda10ff9700 1 -- 172.21.15.112:0/1882190972 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda04050c60 con 0x7fda140b0e70 2023-10-06T04:40:20.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.888+0000 7fda1ae0a700 1 -- 172.21.15.112:0/1882190972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda140b1810 con 0x7fda140b0e70 2023-10-06T04:40:20.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.889+0000 7fda10ff9700 1 -- 172.21.15.112:0/1882190972 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16914 (secure 0 0 0) 0x7fda140b1810 con 0x7fda140b0e70 2023-10-06T04:40:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:20.891 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":31,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:40:07.853039+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:40:04.313893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:40:05.190449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:20.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.891+0000 7fda1ae0a700 1 -- 172.21.15.112:0/1882190972 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fda000670e0 msgr2=0x7fda00069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.891+0000 7fda1ae0a700 1 --2- 172.21.15.112:0/1882190972 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fda000670e0 0x7fda00069590 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fda080099b0 tx=0x7fda08017000 comp rx=0 tx=0).stop 2023-10-06T04:40:20.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.891+0000 7fda1ae0a700 1 -- 172.21.15.112:0/1882190972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda140b0e70 msgr2=0x7fda1414d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:20.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.891+0000 7fda1ae0a700 1 --2- 172.21.15.112:0/1882190972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda140b0e70 0x7fda1414d9e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fda0400c590 tx=0x7fda0400c950 comp rx=0 tx=0).stop 2023-10-06T04:40:20.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.891+0000 7fda1ae0a700 1 -- 172.21.15.112:0/1882190972 shutdown_connections 2023-10-06T04:40:20.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.891+0000 7fda1ae0a700 1 --2- 172.21.15.112:0/1882190972 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fda000670e0 0x7fda00069590 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.891+0000 7fda1ae0a700 1 --2- 172.21.15.112:0/1882190972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda14159d50 0x7fda1414e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.891+0000 7fda1ae0a700 1 --2- 172.21.15.112:0/1882190972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda140b0e70 0x7fda1414d9e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.891+0000 7fda1ae0a700 1 --2- 172.21.15.112:0/1882190972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda140b3040 0x7fda1415d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:20.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.891+0000 7fda1ae0a700 1 -- 172.21.15.112:0/1882190972 >> 172.21.15.112:0/1882190972 conn(0x7fda14099b60 msgr2=0x7fda14150fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:20.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.891+0000 7fda1ae0a700 1 -- 172.21.15.112:0/1882190972 shutdown_connections 2023-10-06T04:40:20.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:20.891+0000 7fda1ae0a700 1 -- 172.21.15.112:0/1882190972 wait complete. 2023-10-06T04:40:20.905 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:13.929254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:39:14.321892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:40:04.313893+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:40:05.190449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:40:20.906 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:40:21.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.021+0000 7f66d359e700 1 Processor -- start 2023-10-06T04:40:21.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.021+0000 7f66d359e700 1 -- start start 2023-10-06T04:40:21.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.022+0000 7f66d359e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f66d40d0c40 0x7f66d40c7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.022+0000 7f66d359e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d40cab40 con 0x7f66d4157220 2023-10-06T04:40:21.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.022+0000 7f66d359e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d40cceb0 con 0x7f66d40c7bd0 2023-10-06T04:40:21.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.022+0000 7f66d359e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d40cd100 con 0x7f66d40d0c40 2023-10-06T04:40:21.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.022+0000 7f66d259c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f66d4157220 0x7f66d40d0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34838/0 (socket says 172.21.15.112:34838) 2023-10-06T04:40:21.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.022+0000 7f66d259c700 1 -- 172.21.15.112:0/3425070181 learned_addr learned my addr 172.21.15.112:0/3425070181 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:21.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.022+0000 7f66d1d9b700 1 --2- 172.21.15.112:0/3425070181 >> v2:172.21.15.179:3300/0 conn(0x7f66d40d0c40 0x7f66d40c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.022+0000 7f66d159a700 1 -- 172.21.15.112:0/3425070181 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25745775 0 0) 0x7f66d40cab40 con 0x7f66d4157220 2023-10-06T04:40:21.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.022+0000 7f66d159a700 1 -- 172.21.15.112:0/3425070181 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66bc003570 con 0x7f66d4157220 2023-10-06T04:40:21.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.022+0000 7f66d159a700 1 -- 172.21.15.112:0/3425070181 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1049349537 0 0) 0x7f66bc003570 con 0x7f66d4157220 2023-10-06T04:40:21.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.022+0000 7f66d159a700 1 -- 172.21.15.112:0/3425070181 >> v2:172.21.15.179:3300/0 conn(0x7f66d40d0c40 msgr2=0x7f66d40c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:21.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.022+0000 7f66d159a700 1 --2- 172.21.15.112:0/3425070181 >> v2:172.21.15.179:3300/0 conn(0x7f66d40d0c40 0x7f66d40c7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.022+0000 7f66d159a700 1 -- 172.21.15.112:0/3425070181 >> v1:172.21.15.179:6789/0 conn(0x7f66d40c7bd0 legacy=0x7f66d40c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.022+0000 7f66d159a700 1 -- 172.21.15.112:0/3425070181 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d40cd3e0 con 0x7f66d4157220 2023-10-06T04:40:21.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.022+0000 7f66d159a700 1 -- 172.21.15.112:0/3425070181 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f66c4001470 con 0x7f66d4157220 2023-10-06T04:40:21.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.022+0000 7f66d159a700 1 -- 172.21.15.112:0/3425070181 >> v1:172.21.15.112:6789/0 conn(0x7f66d4157220 legacy=0x7f66d40d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.022+0000 7f66d159a700 1 --2- 172.21.15.112:0/3425070181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66bc003a60 0x7f66bc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.022+0000 7f66d159a700 1 --2- 172.21.15.112:0/3425070181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66bc004810 0x7f66bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.022+0000 7f66d159a700 1 --2- 172.21.15.112:0/3425070181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66bc0051c0 0x7f66bc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.023+0000 7f66d159a700 1 -- 172.21.15.112:0/3425070181 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d40cd100 con 0x7f66bc003a60 2023-10-06T04:40:21.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.023+0000 7f66d159a700 1 -- 172.21.15.112:0/3425070181 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc00c160 con 0x7f66bc004810 2023-10-06T04:40:21.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.023+0000 7f66d159a700 1 -- 172.21.15.112:0/3425070181 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc00c320 con 0x7f66bc0051c0 2023-10-06T04:40:21.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.023+0000 7f66d259c700 1 --2- 172.21.15.112:0/3425070181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66bc003a60 0x7f66bc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.023+0000 7f66d1d9b700 1 --2- 172.21.15.112:0/3425070181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66bc004810 0x7f66bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.023+0000 7f66d2d9d700 1 --2- 172.21.15.112:0/3425070181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66bc0051c0 0x7f66bc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.023+0000 7f66d259c700 1 -- 172.21.15.112:0/3425070181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66bc0051c0 msgr2=0x7f66bc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:21.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.023+0000 7f66d259c700 1 --2- 172.21.15.112:0/3425070181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66bc0051c0 0x7f66bc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.023+0000 7f66d259c700 1 -- 172.21.15.112:0/3425070181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66bc004810 msgr2=0x7f66bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:21.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.023+0000 7f66d259c700 1 --2- 172.21.15.112:0/3425070181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66bc004810 0x7f66bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.023+0000 7f66d259c700 1 -- 172.21.15.112:0/3425070181 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc003570 con 0x7f66bc003a60 2023-10-06T04:40:21.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.023+0000 7f66d2d9d700 1 -- 172.21.15.112:0/3425070181 reap_dead start 2023-10-06T04:40:21.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.023+0000 7f66d259c700 1 --2- 172.21.15.112:0/3425070181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66bc003a60 0x7f66bc003e70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f66c400c3c0 tx=0x7f66c4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6f495c08b7f953 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:21.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.023+0000 7f66d159a700 1 -- 172.21.15.112:0/3425070181 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c400cc90 con 0x7f66bc003a60 2023-10-06T04:40:21.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.023+0000 7f66d159a700 1 -- 172.21.15.112:0/3425070181 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c400cdf0 con 0x7f66bc003a60 2023-10-06T04:40:21.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.023+0000 7f66d159a700 1 -- 172.21.15.112:0/3425070181 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c4005b50 con 0x7f66bc003a60 2023-10-06T04:40:21.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.024+0000 7f66d359e700 1 -- 172.21.15.112:0/3425070181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66bc003a60 msgr2=0x7f66bc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.024+0000 7f66d359e700 1 --2- 172.21.15.112:0/3425070181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66bc003a60 0x7f66bc003e70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f66c400c3c0 tx=0x7f66c4001e50 comp rx=0 tx=0).stop 2023-10-06T04:40:21.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.024+0000 7f66d359e700 1 -- 172.21.15.112:0/3425070181 shutdown_connections 2023-10-06T04:40:21.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.024+0000 7f66d359e700 1 --2- 172.21.15.112:0/3425070181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66bc003a60 0x7f66bc003e70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.024+0000 7f66d359e700 1 -- 172.21.15.112:0/3425070181 >> 172.21.15.112:0/3425070181 conn(0x7f66d406c7d0 msgr2=0x7f66d406cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:21.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.024+0000 7f66d359e700 1 -- 172.21.15.112:0/3425070181 shutdown_connections 2023-10-06T04:40:21.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.024+0000 7f66d359e700 1 -- 172.21.15.112:0/3425070181 wait complete. 2023-10-06T04:40:21.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.025+0000 7f66d359e700 1 Processor -- start 2023-10-06T04:40:21.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.025+0000 7f66d359e700 1 -- start start 2023-10-06T04:40:21.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66d359e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66bc003a60 0x7f66d4155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66d359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66d415b600 0x7f66d415ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66d359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66d4159b20 0x7f66d4159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66d359e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d4159690 con 0x7f66bc003a60 2023-10-06T04:40:21.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66d359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d4156420 con 0x7f66d415b600 2023-10-06T04:40:21.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66d359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d4158a80 con 0x7f66d4159b20 2023-10-06T04:40:21.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66d259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66bc003a60 0x7f66d4155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66d259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66bc003a60 0x7f66d4155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51820/0 (socket says 172.21.15.112:51820) 2023-10-06T04:40:21.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66d259c700 1 -- 172.21.15.112:0/2981329659 learned_addr learned my addr 172.21.15.112:0/2981329659 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:21.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66d1d9b700 1 --2- 172.21.15.112:0/2981329659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66d415b600 0x7f66d415ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66d2d9d700 1 --2- 172.21.15.112:0/2981329659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66d4159b20 0x7f66d4159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66d259c700 1 -- 172.21.15.112:0/2981329659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66d4159b20 msgr2=0x7f66d4159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66d259c700 1 --2- 172.21.15.112:0/2981329659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66d4159b20 0x7f66d4159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66d259c700 1 -- 172.21.15.112:0/2981329659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66d415b600 msgr2=0x7f66d415ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66d259c700 1 --2- 172.21.15.112:0/2981329659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66d415b600 0x7f66d415ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66d259c700 1 -- 172.21.15.112:0/2981329659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d4158d60 con 0x7f66bc003a60 2023-10-06T04:40:21.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66d2d9d700 1 --2- 172.21.15.112:0/2981329659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66d4159b20 0x7f66d4159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:21.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66d1d9b700 1 --2- 172.21.15.112:0/2981329659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66d415b600 0x7f66d415ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:21.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66d259c700 1 --2- 172.21.15.112:0/2981329659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66bc003a60 0x7f66d4155ee0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f66bc00c130 tx=0x7f66c4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:21.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66c27fc700 1 -- 172.21.15.112:0/2981329659 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c4022070 con 0x7f66bc003a60 2023-10-06T04:40:21.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66c27fc700 1 -- 172.21.15.112:0/2981329659 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c4001500 con 0x7f66bc003a60 2023-10-06T04:40:21.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66d359e700 1 -- 172.21.15.112:0/2981329659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d4159040 con 0x7f66bc003a60 2023-10-06T04:40:21.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66c27fc700 1 -- 172.21.15.112:0/2981329659 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c4007360 con 0x7f66bc003a60 2023-10-06T04:40:21.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.026+0000 7f66d359e700 1 -- 172.21.15.112:0/2981329659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d415b190 con 0x7f66bc003a60 2023-10-06T04:40:21.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.027+0000 7f66d359e700 1 -- 172.21.15.112:0/2981329659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d405f230 con 0x7f66bc003a60 2023-10-06T04:40:21.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.028+0000 7f66c27fc700 1 -- 172.21.15.112:0/2981329659 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f66c4007710 con 0x7f66bc003a60 2023-10-06T04:40:21.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.028+0000 7f66c27fc700 1 --2- 172.21.15.112:0/2981329659 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f66b40670e0 0x7f66b4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.028+0000 7f66d1d9b700 1 --2- 172.21.15.112:0/2981329659 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f66b40670e0 0x7f66b4069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.028+0000 7f66c27fc700 1 -- 172.21.15.112:0/2981329659 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f66c4085bb0 con 0x7f66bc003a60 2023-10-06T04:40:21.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.028+0000 7f66d1d9b700 1 --2- 172.21.15.112:0/2981329659 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f66b40670e0 0x7f66b4069590 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f66c8006d00 tx=0x7f66c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:21.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.032+0000 7f66c27fc700 1 -- 172.21.15.112:0/2981329659 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66c4052b00 con 0x7f66bc003a60 2023-10-06T04:40:21.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.214+0000 7f66d359e700 1 -- 172.21.15.112:0/2981329659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f66d40d0a00 con 0x7f66bc003a60 2023-10-06T04:40:21.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.214+0000 7f66c27fc700 1 -- 172.21.15.112:0/2981329659 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f66c4017020 con 0x7f66bc003a60 2023-10-06T04:40:21.217 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-10-06T04:40:21.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.216+0000 7f66d359e700 1 -- 172.21.15.112:0/2981329659 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f66b40670e0 msgr2=0x7f66b4069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.216+0000 7f66d359e700 1 --2- 172.21.15.112:0/2981329659 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f66b40670e0 0x7f66b4069590 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f66c8006d00 tx=0x7f66c8008040 comp rx=0 tx=0).stop 2023-10-06T04:40:21.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.216+0000 7f66d359e700 1 -- 172.21.15.112:0/2981329659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66bc003a60 msgr2=0x7f66d4155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.216+0000 7f66d359e700 1 --2- 172.21.15.112:0/2981329659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66bc003a60 0x7f66d4155ee0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f66bc00c130 tx=0x7f66c4015000 comp rx=0 tx=0).stop 2023-10-06T04:40:21.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.217+0000 7f66d359e700 1 -- 172.21.15.112:0/2981329659 shutdown_connections 2023-10-06T04:40:21.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.217+0000 7f66d359e700 1 --2- 172.21.15.112:0/2981329659 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f66b40670e0 0x7f66b4069590 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.217+0000 7f66d359e700 1 --2- 172.21.15.112:0/2981329659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66d4159b20 0x7f66d4159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.217+0000 7f66d359e700 1 --2- 172.21.15.112:0/2981329659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66bc003a60 0x7f66d4155ee0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.217+0000 7f66d359e700 1 --2- 172.21.15.112:0/2981329659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66d415b600 0x7f66d415ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.217+0000 7f66d359e700 1 -- 172.21.15.112:0/2981329659 >> 172.21.15.112:0/2981329659 conn(0x7f66d406c7d0 msgr2=0x7f66d40cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:21.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.217+0000 7f66d359e700 1 -- 172.21.15.112:0/2981329659 shutdown_connections 2023-10-06T04:40:21.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.217+0000 7f66d359e700 1 -- 172.21.15.112:0/2981329659 wait complete. 2023-10-06T04:40:21.231 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:40:21.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.346+0000 7f3237167700 1 Processor -- start 2023-10-06T04:40:21.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.346+0000 7f3237167700 1 -- start start 2023-10-06T04:40:21.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.347+0000 7f3237167700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f323006d3b0 0x7f323015be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.347+0000 7f3237167700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323015af50 con 0x7f32300cbf00 2023-10-06T04:40:21.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.347+0000 7f3237167700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32300cae50 con 0x7f3230159a20 2023-10-06T04:40:21.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.347+0000 7f3237167700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32300cca70 con 0x7f323006d3b0 2023-10-06T04:40:21.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.347+0000 7f3227fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f32300cbf00 0x7f323015b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34854/0 (socket says 172.21.15.112:34854) 2023-10-06T04:40:21.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.347+0000 7f3227fff700 1 -- 172.21.15.112:0/3874243787 learned_addr learned my addr 172.21.15.112:0/3874243787 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:21.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.347+0000 7f3235704700 1 --2- 172.21.15.112:0/3874243787 >> v2:172.21.15.112:3300/0 conn(0x7f323006d3b0 0x7f323015be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.347+0000 7f3235704700 1 -- 172.21.15.112:0/3874243787 >> v1:172.21.15.179:6789/0 conn(0x7f3230159a20 legacy=0x7f32300cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:21.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.347+0000 7f3235704700 1 -- 172.21.15.112:0/3874243787 >> v1:172.21.15.112:6789/0 conn(0x7f32300cbf00 legacy=0x7f323015b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.347+0000 7f3235704700 1 -- 172.21.15.112:0/3874243787 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32300cb0f0 con 0x7f323006d3b0 2023-10-06T04:40:21.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.347+0000 7f3235704700 1 --2- 172.21.15.112:0/3874243787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323006d3b0 0x7f323015be20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3228009e60 tx=0x7f3228009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f146b4baecfabf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:21.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.347+0000 7f32277fe700 1 -- 172.21.15.112:0/3874243787 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322800e070 con 0x7f323006d3b0 2023-10-06T04:40:21.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.347+0000 7f32277fe700 1 -- 172.21.15.112:0/3874243787 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322800bbf0 con 0x7f323006d3b0 2023-10-06T04:40:21.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.347+0000 7f32277fe700 1 -- 172.21.15.112:0/3874243787 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228012430 con 0x7f323006d3b0 2023-10-06T04:40:21.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.348+0000 7f3237167700 1 -- 172.21.15.112:0/3874243787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323006d3b0 msgr2=0x7f323015be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.348+0000 7f3237167700 1 --2- 172.21.15.112:0/3874243787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323006d3b0 0x7f323015be20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3228009e60 tx=0x7f3228009780 comp rx=0 tx=0).stop 2023-10-06T04:40:21.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.348+0000 7f3237167700 1 -- 172.21.15.112:0/3874243787 shutdown_connections 2023-10-06T04:40:21.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.348+0000 7f3237167700 1 --2- 172.21.15.112:0/3874243787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323006d3b0 0x7f323015be20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.348+0000 7f3237167700 1 -- 172.21.15.112:0/3874243787 >> 172.21.15.112:0/3874243787 conn(0x7f323006cfb0 msgr2=0x7f32300d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:21.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.348+0000 7f3237167700 1 -- 172.21.15.112:0/3874243787 shutdown_connections 2023-10-06T04:40:21.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.348+0000 7f3237167700 1 -- 172.21.15.112:0/3874243787 wait complete. 2023-10-06T04:40:21.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.349+0000 7f3237167700 1 Processor -- start 2023-10-06T04:40:21.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.349+0000 7f3237167700 1 -- start start 2023-10-06T04:40:21.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.350+0000 7f3237167700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323006d3b0 0x7f3230158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.350+0000 7f3237167700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32300cbf00 0x7f323016d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.350+0000 7f3237167700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3230159a20 0x7f32300b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.350+0000 7f3237167700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3230155b80 con 0x7f323006d3b0 2023-10-06T04:40:21.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.350+0000 7f3237167700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3230159210 con 0x7f32300cbf00 2023-10-06T04:40:21.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.350+0000 7f3237167700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323016a580 con 0x7f3230159a20 2023-10-06T04:40:21.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.350+0000 7f3234f03700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323006d3b0 0x7f3230158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.350+0000 7f3234f03700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323006d3b0 0x7f3230158cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51840/0 (socket says 172.21.15.112:51840) 2023-10-06T04:40:21.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.350+0000 7f3234f03700 1 -- 172.21.15.112:0/3589357260 learned_addr learned my addr 172.21.15.112:0/3589357260 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:21.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.350+0000 7f3227fff700 1 --2- 172.21.15.112:0/3589357260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32300cbf00 0x7f323016d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.350+0000 7f3235704700 1 --2- 172.21.15.112:0/3589357260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3230159a20 0x7f32300b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.350+0000 7f3234f03700 1 -- 172.21.15.112:0/3589357260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3230159a20 msgr2=0x7f32300b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.350+0000 7f3234f03700 1 --2- 172.21.15.112:0/3589357260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3230159a20 0x7f32300b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.350+0000 7f3234f03700 1 -- 172.21.15.112:0/3589357260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32300cbf00 msgr2=0x7f323016d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.350+0000 7f3234f03700 1 --2- 172.21.15.112:0/3589357260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32300cbf00 0x7f323016d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.350+0000 7f3234f03700 1 -- 172.21.15.112:0/3589357260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3228009a20 con 0x7f323006d3b0 2023-10-06T04:40:21.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.350+0000 7f3227fff700 1 --2- 172.21.15.112:0/3589357260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32300cbf00 0x7f323016d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:21.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.350+0000 7f3234f03700 1 --2- 172.21.15.112:0/3589357260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323006d3b0 0x7f3230158cd0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f322c00c5d0 tx=0x7f322c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:21.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.351+0000 7f3224ff9700 1 -- 172.21.15.112:0/3589357260 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c011590 con 0x7f323006d3b0 2023-10-06T04:40:21.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.351+0000 7f3224ff9700 1 -- 172.21.15.112:0/3589357260 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c011710 con 0x7f323006d3b0 2023-10-06T04:40:21.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.351+0000 7f3237167700 1 -- 172.21.15.112:0/3589357260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323016a860 con 0x7f323006d3b0 2023-10-06T04:40:21.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.351+0000 7f3224ff9700 1 -- 172.21.15.112:0/3589357260 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c011ad0 con 0x7f323006d3b0 2023-10-06T04:40:21.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.351+0000 7f3237167700 1 -- 172.21.15.112:0/3589357260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323016ae20 con 0x7f323006d3b0 2023-10-06T04:40:21.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.352+0000 7f3237167700 1 -- 172.21.15.112:0/3589357260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3230155cf0 con 0x7f323006d3b0 2023-10-06T04:40:21.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.352+0000 7f3224ff9700 1 -- 172.21.15.112:0/3589357260 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f322c01c460 con 0x7f323006d3b0 2023-10-06T04:40:21.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.352+0000 7f3224ff9700 1 --2- 172.21.15.112:0/3589357260 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f321c0670e0 0x7f321c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.352+0000 7f3224ff9700 1 -- 172.21.15.112:0/3589357260 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f322c0847a0 con 0x7f323006d3b0 2023-10-06T04:40:21.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.352+0000 7f3227fff700 1 --2- 172.21.15.112:0/3589357260 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f321c0670e0 0x7f321c069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.353+0000 7f3227fff700 1 --2- 172.21.15.112:0/3589357260 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f321c0670e0 0x7f321c069590 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f32300b5320 tx=0x7f3220009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:21.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.357+0000 7f3224ff9700 1 -- 172.21.15.112:0/3589357260 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3230155cf0 con 0x7f323006d3b0 2023-10-06T04:40:21.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.540+0000 7f3237167700 1 -- 172.21.15.112:0/3589357260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3230155cf0 con 0x7f323006d3b0 2023-10-06T04:40:21.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.541+0000 7f3224ff9700 1 -- 172.21.15.112:0/3589357260 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f322c051630 con 0x7f323006d3b0 2023-10-06T04:40:21.543 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-10-06T04:40:21.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.543+0000 7f3237167700 1 -- 172.21.15.112:0/3589357260 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f321c0670e0 msgr2=0x7f321c069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.543+0000 7f3237167700 1 --2- 172.21.15.112:0/3589357260 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f321c0670e0 0x7f321c069590 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f32300b5320 tx=0x7f3220009040 comp rx=0 tx=0).stop 2023-10-06T04:40:21.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.543+0000 7f3237167700 1 -- 172.21.15.112:0/3589357260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323006d3b0 msgr2=0x7f3230158cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.543+0000 7f3237167700 1 --2- 172.21.15.112:0/3589357260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323006d3b0 0x7f3230158cd0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f322c00c5d0 tx=0x7f322c007f60 comp rx=0 tx=0).stop 2023-10-06T04:40:21.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.543+0000 7f3237167700 1 -- 172.21.15.112:0/3589357260 shutdown_connections 2023-10-06T04:40:21.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.543+0000 7f3237167700 1 --2- 172.21.15.112:0/3589357260 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f321c0670e0 0x7f321c069590 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.543+0000 7f3237167700 1 --2- 172.21.15.112:0/3589357260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3230159a20 0x7f32300b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.543+0000 7f3237167700 1 --2- 172.21.15.112:0/3589357260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323006d3b0 0x7f3230158cd0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.543+0000 7f3237167700 1 --2- 172.21.15.112:0/3589357260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32300cbf00 0x7f323016d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.543+0000 7f3237167700 1 -- 172.21.15.112:0/3589357260 >> 172.21.15.112:0/3589357260 conn(0x7f323006cfb0 msgr2=0x7f3230155290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:21.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.543+0000 7f3237167700 1 -- 172.21.15.112:0/3589357260 shutdown_connections 2023-10-06T04:40:21.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.543+0000 7f3237167700 1 -- 172.21.15.112:0/3589357260 wait complete. 2023-10-06T04:40:21.557 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:40:21.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.672+0000 7f87b0ba4700 1 Processor -- start 2023-10-06T04:40:21.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.672+0000 7f87b0ba4700 1 -- start start 2023-10-06T04:40:21.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.673+0000 7f87b0ba4700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f87ac159a20 0x7f87ac0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.673+0000 7f87b0ba4700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f87ac15c720 0x7f87ac0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.673+0000 7f87b0ba4700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ac15af50 con 0x7f87ac06d3b0 2023-10-06T04:40:21.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.673+0000 7f87b0ba4700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ac0cca70 con 0x7f87ac159a20 2023-10-06T04:40:21.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.673+0000 7f87b0ba4700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ac08a080 con 0x7f87ac15c720 2023-10-06T04:40:21.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.673+0000 7f87aa59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f87ac159a20 0x7f87ac0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.673+0000 7f87aa59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f87ac159a20 0x7f87ac0cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51850/0 (socket says 172.21.15.112:51850) 2023-10-06T04:40:21.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.673+0000 7f87aa59c700 1 -- 172.21.15.112:0/1589189013 learned_addr learned my addr 172.21.15.112:0/1589189013 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:21.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.673+0000 7f87aad9d700 1 --2- 172.21.15.112:0/1589189013 >> v2:172.21.15.179:3300/0 conn(0x7f87ac15c720 0x7f87ac0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.673+0000 7f87aa59c700 1 -- 172.21.15.112:0/1589189013 >> v2:172.21.15.179:3300/0 conn(0x7f87ac15c720 msgr2=0x7f87ac0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:21.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.673+0000 7f87aa59c700 1 --2- 172.21.15.112:0/1589189013 >> v2:172.21.15.179:3300/0 conn(0x7f87ac15c720 0x7f87ac0cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.673+0000 7f87aa59c700 1 -- 172.21.15.112:0/1589189013 >> v1:172.21.15.179:6789/0 conn(0x7f87ac06d3b0 legacy=0x7f87ac15d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:21.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.673+0000 7f87aa59c700 1 -- 172.21.15.112:0/1589189013 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac0cae50 con 0x7f87ac159a20 2023-10-06T04:40:21.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.673+0000 7f87aa59c700 1 --2- 172.21.15.112:0/1589189013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87ac159a20 0x7f87ac0cb7f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f87ac088a30 tx=0x7f87a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22643612b8a3bf6c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:21.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.673+0000 7f87a959a700 1 -- 172.21.15.112:0/1589189013 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a400e070 con 0x7f87ac159a20 2023-10-06T04:40:21.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.673+0000 7f87a959a700 1 -- 172.21.15.112:0/1589189013 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a400ba00 con 0x7f87ac159a20 2023-10-06T04:40:21.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.673+0000 7f87a959a700 1 -- 172.21.15.112:0/1589189013 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a40092e0 con 0x7f87ac159a20 2023-10-06T04:40:21.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.674+0000 7f87b0ba4700 1 -- 172.21.15.112:0/1589189013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87ac159a20 msgr2=0x7f87ac0cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.674+0000 7f87b0ba4700 1 --2- 172.21.15.112:0/1589189013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87ac159a20 0x7f87ac0cb7f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f87ac088a30 tx=0x7f87a4009840 comp rx=0 tx=0).stop 2023-10-06T04:40:21.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.674+0000 7f87b0ba4700 1 -- 172.21.15.112:0/1589189013 shutdown_connections 2023-10-06T04:40:21.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.674+0000 7f87b0ba4700 1 --2- 172.21.15.112:0/1589189013 >> v2:172.21.15.179:3300/0 conn(0x7f87ac15c720 0x7f87ac0cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.674+0000 7f87b0ba4700 1 --2- 172.21.15.112:0/1589189013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87ac159a20 0x7f87ac0cb7f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.674+0000 7f87b0ba4700 1 -- 172.21.15.112:0/1589189013 >> 172.21.15.112:0/1589189013 conn(0x7f87ac06cfb0 msgr2=0x7f87ac0d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:21.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.674+0000 7f87b0ba4700 1 -- 172.21.15.112:0/1589189013 shutdown_connections 2023-10-06T04:40:21.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.674+0000 7f87b0ba4700 1 -- 172.21.15.112:0/1589189013 wait complete. 2023-10-06T04:40:21.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.675+0000 7f87b0ba4700 1 Processor -- start 2023-10-06T04:40:21.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.675+0000 7f87b0ba4700 1 -- start start 2023-10-06T04:40:21.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87b0ba4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87ac06d3b0 0x7f87ac1589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87b0ba4700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87ac159a20 0x7f87ac16a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87b0ba4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ac15c720 0x7f87ac16a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87b0ba4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0b6770 con 0x7f87ac06d3b0 2023-10-06T04:40:21.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87b0ba4700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0b5ba0 con 0x7f87ac15c720 2023-10-06T04:40:21.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87b0ba4700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0b5e40 con 0x7f87ac159a20 2023-10-06T04:40:21.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87aa59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87ac06d3b0 0x7f87ac1589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87aa59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87ac06d3b0 0x7f87ac1589d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51852/0 (socket says 172.21.15.112:51852) 2023-10-06T04:40:21.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87aa59c700 1 -- 172.21.15.112:0/2397123054 learned_addr learned my addr 172.21.15.112:0/2397123054 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:21.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87aad9d700 1 --2- 172.21.15.112:0/2397123054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ac15c720 0x7f87ac16a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87a9d9b700 1 --2- 172.21.15.112:0/2397123054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87ac159a20 0x7f87ac16a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87aa59c700 1 -- 172.21.15.112:0/2397123054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87ac159a20 msgr2=0x7f87ac16a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87aa59c700 1 --2- 172.21.15.112:0/2397123054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87ac159a20 0x7f87ac16a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87aa59c700 1 -- 172.21.15.112:0/2397123054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ac15c720 msgr2=0x7f87ac16a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87aa59c700 1 --2- 172.21.15.112:0/2397123054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ac15c720 0x7f87ac16a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87aa59c700 1 -- 172.21.15.112:0/2397123054 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a4009ae0 con 0x7f87ac06d3b0 2023-10-06T04:40:21.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87a9d9b700 1 --2- 172.21.15.112:0/2397123054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87ac159a20 0x7f87ac16a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:21.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87aa59c700 1 --2- 172.21.15.112:0/2397123054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87ac06d3b0 0x7f87ac1589d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f87a4009880 tx=0x7f87a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:21.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87a27fc700 1 -- 172.21.15.112:0/2397123054 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4012b70 con 0x7f87ac06d3b0 2023-10-06T04:40:21.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87a27fc700 1 -- 172.21.15.112:0/2397123054 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a4012cf0 con 0x7f87ac06d3b0 2023-10-06T04:40:21.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87b0ba4700 1 -- 172.21.15.112:0/2397123054 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ac0b6120 con 0x7f87ac06d3b0 2023-10-06T04:40:21.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87a27fc700 1 -- 172.21.15.112:0/2397123054 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a401d670 con 0x7f87ac06d3b0 2023-10-06T04:40:21.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.676+0000 7f87b0ba4700 1 -- 172.21.15.112:0/2397123054 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ac0b5830 con 0x7f87ac06d3b0 2023-10-06T04:40:21.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.677+0000 7f87b0ba4700 1 -- 172.21.15.112:0/2397123054 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ac05f230 con 0x7f87ac06d3b0 2023-10-06T04:40:21.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.678+0000 7f87a27fc700 1 -- 172.21.15.112:0/2397123054 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f87a401da20 con 0x7f87ac06d3b0 2023-10-06T04:40:21.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.678+0000 7f87a27fc700 1 --2- 172.21.15.112:0/2397123054 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f878c0670e0 0x7f878c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:21.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.678+0000 7f87a27fc700 1 -- 172.21.15.112:0/2397123054 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f87a40861f0 con 0x7f87ac06d3b0 2023-10-06T04:40:21.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.678+0000 7f87a9d9b700 1 --2- 172.21.15.112:0/2397123054 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f878c0670e0 0x7f878c069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:21.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.678+0000 7f87a9d9b700 1 --2- 172.21.15.112:0/2397123054 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f878c0670e0 0x7f878c069590 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f87ac0b2da0 tx=0x7f8794009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:21.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.682+0000 7f87a27fc700 1 -- 172.21.15.112:0/2397123054 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87a4052f70 con 0x7f87ac06d3b0 2023-10-06T04:40:21.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.866+0000 7f87b0ba4700 1 -- 172.21.15.112:0/2397123054 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f87ac0cb0f0 con 0x7f87ac06d3b0 2023-10-06T04:40:21.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.866+0000 7f87a27fc700 1 -- 172.21.15.112:0/2397123054 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f87a4012e60 con 0x7f87ac06d3b0 2023-10-06T04:40:21.868 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-10-06T04:40:21.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.868+0000 7f87b0ba4700 1 -- 172.21.15.112:0/2397123054 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f878c0670e0 msgr2=0x7f878c069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.868+0000 7f87b0ba4700 1 --2- 172.21.15.112:0/2397123054 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f878c0670e0 0x7f878c069590 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f87ac0b2da0 tx=0x7f8794009040 comp rx=0 tx=0).stop 2023-10-06T04:40:21.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.868+0000 7f87b0ba4700 1 -- 172.21.15.112:0/2397123054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87ac06d3b0 msgr2=0x7f87ac1589d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:21.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.868+0000 7f87b0ba4700 1 --2- 172.21.15.112:0/2397123054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87ac06d3b0 0x7f87ac1589d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f87a4009880 tx=0x7f87a4017000 comp rx=0 tx=0).stop 2023-10-06T04:40:21.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.868+0000 7f87b0ba4700 1 -- 172.21.15.112:0/2397123054 shutdown_connections 2023-10-06T04:40:21.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.868+0000 7f87b0ba4700 1 --2- 172.21.15.112:0/2397123054 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f878c0670e0 0x7f878c069590 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.868+0000 7f87b0ba4700 1 --2- 172.21.15.112:0/2397123054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ac15c720 0x7f87ac16a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.868+0000 7f87b0ba4700 1 --2- 172.21.15.112:0/2397123054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87ac06d3b0 0x7f87ac1589d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.868+0000 7f87b0ba4700 1 --2- 172.21.15.112:0/2397123054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87ac159a20 0x7f87ac16a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:21.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.868+0000 7f87b0ba4700 1 -- 172.21.15.112:0/2397123054 >> 172.21.15.112:0/2397123054 conn(0x7f87ac06cfb0 msgr2=0x7f87ac06f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:21.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.868+0000 7f87b0ba4700 1 -- 172.21.15.112:0/2397123054 shutdown_connections 2023-10-06T04:40:21.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.868+0000 7f87b0ba4700 1 -- 172.21.15.112:0/2397123054 wait complete. 2023-10-06T04:40:21.883 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:40:21.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.997+0000 7f54c8549700 1 Processor -- start 2023-10-06T04:40:22.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.997+0000 7f54c8549700 1 -- start start 2023-10-06T04:40:22.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.998+0000 7f54c8549700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f54c0159a20 0x7f54c00cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.998+0000 7f54c8549700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c015c720 0x7f54c00cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.998+0000 7f54c8549700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c015af50 con 0x7f54c006d3b0 2023-10-06T04:40:22.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.998+0000 7f54c8549700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c00cca70 con 0x7f54c0159a20 2023-10-06T04:40:22.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.998+0000 7f54c8549700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c008a080 con 0x7f54c015c720 2023-10-06T04:40:22.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.998+0000 7f54c62e5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f54c0159a20 0x7f54c00cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.998+0000 7f54c62e5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f54c0159a20 0x7f54c00cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51854/0 (socket says 172.21.15.112:51854) 2023-10-06T04:40:22.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.998+0000 7f54c62e5700 1 -- 172.21.15.112:0/2114275755 learned_addr learned my addr 172.21.15.112:0/2114275755 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:22.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.999+0000 7f54c6ae6700 1 --2- 172.21.15.112:0/2114275755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c015c720 0x7f54c00cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.999+0000 7f54c62e5700 1 -- 172.21.15.112:0/2114275755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c015c720 msgr2=0x7f54c00cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:22.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.999+0000 7f54c62e5700 1 --2- 172.21.15.112:0/2114275755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c015c720 0x7f54c00cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.999+0000 7f54c62e5700 1 -- 172.21.15.112:0/2114275755 >> v1:172.21.15.179:6789/0 conn(0x7f54c006d3b0 legacy=0x7f54c015d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:22.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.999+0000 7f54c62e5700 1 -- 172.21.15.112:0/2114275755 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c00cae50 con 0x7f54c0159a20 2023-10-06T04:40:22.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.999+0000 7f54c62e5700 1 --2- 172.21.15.112:0/2114275755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54c0159a20 0x7f54c00cb7f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0099e0 tx=0x7f54bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290e1ab695bfc9aa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:22.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.999+0000 7f54c52e3700 1 -- 172.21.15.112:0/2114275755 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc00b7e0 con 0x7f54c0159a20 2023-10-06T04:40:22.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.999+0000 7f54c52e3700 1 -- 172.21.15.112:0/2114275755 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc00b940 con 0x7f54c0159a20 2023-10-06T04:40:22.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.999+0000 7f54c52e3700 1 -- 172.21.15.112:0/2114275755 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc00bce0 con 0x7f54c0159a20 2023-10-06T04:40:22.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.999+0000 7f54c8549700 1 -- 172.21.15.112:0/2114275755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54c0159a20 msgr2=0x7f54c00cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:21.999+0000 7f54c8549700 1 --2- 172.21.15.112:0/2114275755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54c0159a20 0x7f54c00cb7f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0099e0 tx=0x7f54bc009250 comp rx=0 tx=0).stop 2023-10-06T04:40:22.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.000+0000 7f54c8549700 1 -- 172.21.15.112:0/2114275755 shutdown_connections 2023-10-06T04:40:22.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.000+0000 7f54c8549700 1 --2- 172.21.15.112:0/2114275755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c015c720 0x7f54c00cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.000+0000 7f54c8549700 1 --2- 172.21.15.112:0/2114275755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54c0159a20 0x7f54c00cb7f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.000+0000 7f54c8549700 1 -- 172.21.15.112:0/2114275755 >> 172.21.15.112:0/2114275755 conn(0x7f54c006cfb0 msgr2=0x7f54c00d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:22.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.000+0000 7f54c8549700 1 -- 172.21.15.112:0/2114275755 shutdown_connections 2023-10-06T04:40:22.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.000+0000 7f54c8549700 1 -- 172.21.15.112:0/2114275755 wait complete. 2023-10-06T04:40:22.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.001+0000 7f54c8549700 1 Processor -- start 2023-10-06T04:40:22.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.001+0000 7f54c8549700 1 -- start start 2023-10-06T04:40:22.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.001+0000 7f54c8549700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54c006d3b0 0x7f54c00b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.001+0000 7f54c8549700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54c0159a20 0x7f54c00b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.001+0000 7f54c8549700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c015c720 0x7f54c00b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.001+0000 7f54c8549700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c00b31f0 con 0x7f54c006d3b0 2023-10-06T04:40:22.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.001+0000 7f54c8549700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c00b4460 con 0x7f54c0159a20 2023-10-06T04:40:22.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.001+0000 7f54c8549700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c016b680 con 0x7f54c015c720 2023-10-06T04:40:22.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.002+0000 7f54c62e5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54c006d3b0 0x7f54c00b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.002+0000 7f54c62e5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54c006d3b0 0x7f54c00b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51868/0 (socket says 172.21.15.112:51868) 2023-10-06T04:40:22.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.002+0000 7f54c62e5700 1 -- 172.21.15.112:0/3242418799 learned_addr learned my addr 172.21.15.112:0/3242418799 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:22.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.002+0000 7f54c62e5700 1 -- 172.21.15.112:0/3242418799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c015c720 msgr2=0x7f54c00b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.002+0000 7f54c62e5700 1 --2- 172.21.15.112:0/3242418799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c015c720 0x7f54c00b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.002+0000 7f54c62e5700 1 -- 172.21.15.112:0/3242418799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54c0159a20 msgr2=0x7f54c00b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.002+0000 7f54c62e5700 1 --2- 172.21.15.112:0/3242418799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54c0159a20 0x7f54c00b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.002+0000 7f54c62e5700 1 -- 172.21.15.112:0/3242418799 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc0094f0 con 0x7f54c006d3b0 2023-10-06T04:40:22.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.002+0000 7f54c62e5700 1 --2- 172.21.15.112:0/3242418799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54c006d3b0 0x7f54c00b2cb0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f54c0064600 tx=0x7f54bc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:22.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.002+0000 7f54b67fc700 1 -- 172.21.15.112:0/3242418799 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc011ea0 con 0x7f54c006d3b0 2023-10-06T04:40:22.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.002+0000 7f54b67fc700 1 -- 172.21.15.112:0/3242418799 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc020070 con 0x7f54c006d3b0 2023-10-06T04:40:22.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.002+0000 7f54c8549700 1 -- 172.21.15.112:0/3242418799 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c016b960 con 0x7f54c006d3b0 2023-10-06T04:40:22.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.002+0000 7f54b67fc700 1 -- 172.21.15.112:0/3242418799 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc01b6a0 con 0x7f54c006d3b0 2023-10-06T04:40:22.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.002+0000 7f54c8549700 1 -- 172.21.15.112:0/3242418799 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c00b4740 con 0x7f54c006d3b0 2023-10-06T04:40:22.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.003+0000 7f54c8549700 1 -- 172.21.15.112:0/3242418799 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c016be80 con 0x7f54c006d3b0 2023-10-06T04:40:22.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.003+0000 7f54b67fc700 1 -- 172.21.15.112:0/3242418799 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f54bc022030 con 0x7f54c006d3b0 2023-10-06T04:40:22.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.004+0000 7f54b67fc700 1 --2- 172.21.15.112:0/3242418799 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f54a40670e0 0x7f54a4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.004+0000 7f54b67fc700 1 -- 172.21.15.112:0/3242418799 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f54bc086950 con 0x7f54c006d3b0 2023-10-06T04:40:22.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.004+0000 7f54c5ae4700 1 --2- 172.21.15.112:0/3242418799 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f54a40670e0 0x7f54a4069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.004+0000 7f54c5ae4700 1 --2- 172.21.15.112:0/3242418799 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f54a40670e0 0x7f54a4069590 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f54b0007fd0 tx=0x7f54b0007b20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:22.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.008+0000 7f54b67fc700 1 -- 172.21.15.112:0/3242418799 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54c016be80 con 0x7f54c006d3b0 2023-10-06T04:40:22.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.191+0000 7f54c8549700 1 -- 172.21.15.112:0/3242418799 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f54c016be80 con 0x7f54c006d3b0 2023-10-06T04:40:22.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.191+0000 7f54b67fc700 1 -- 172.21.15.112:0/3242418799 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f54c016be80 con 0x7f54c006d3b0 2023-10-06T04:40:22.193 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-10-06T04:40:22.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.193+0000 7f54c8549700 1 -- 172.21.15.112:0/3242418799 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f54a40670e0 msgr2=0x7f54a4069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.193+0000 7f54c8549700 1 --2- 172.21.15.112:0/3242418799 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f54a40670e0 0x7f54a4069590 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f54b0007fd0 tx=0x7f54b0007b20 comp rx=0 tx=0).stop 2023-10-06T04:40:22.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.193+0000 7f54c8549700 1 -- 172.21.15.112:0/3242418799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54c006d3b0 msgr2=0x7f54c00b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.193+0000 7f54c8549700 1 --2- 172.21.15.112:0/3242418799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54c006d3b0 0x7f54c00b2cb0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f54c0064600 tx=0x7f54bc016000 comp rx=0 tx=0).stop 2023-10-06T04:40:22.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.193+0000 7f54c8549700 1 -- 172.21.15.112:0/3242418799 shutdown_connections 2023-10-06T04:40:22.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.193+0000 7f54c8549700 1 --2- 172.21.15.112:0/3242418799 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f54a40670e0 0x7f54a4069590 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.193+0000 7f54c8549700 1 --2- 172.21.15.112:0/3242418799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c015c720 0x7f54c00b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.193+0000 7f54c8549700 1 --2- 172.21.15.112:0/3242418799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54c006d3b0 0x7f54c00b2cb0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.193+0000 7f54c8549700 1 --2- 172.21.15.112:0/3242418799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54c0159a20 0x7f54c00b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.193+0000 7f54c8549700 1 -- 172.21.15.112:0/3242418799 >> 172.21.15.112:0/3242418799 conn(0x7f54c006cfb0 msgr2=0x7f54c015b710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:22.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.193+0000 7f54c8549700 1 -- 172.21.15.112:0/3242418799 shutdown_connections 2023-10-06T04:40:22.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.193+0000 7f54c8549700 1 -- 172.21.15.112:0/3242418799 wait complete. 2023-10-06T04:40:22.208 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:22.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.320+0000 7ff1d1c8f700 1 Processor -- start 2023-10-06T04:40:22.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.320+0000 7ff1d1c8f700 1 -- start start 2023-10-06T04:40:22.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.321+0000 7ff1d1c8f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff1cc159900 0x7ff1cc15d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.321+0000 7ff1d1c8f700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff1cc067eb0 0x7ff1cc0682c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.321+0000 7ff1d1c8f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc06ed60 con 0x7ff1cc06f650 2023-10-06T04:40:22.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.321+0000 7ff1d1c8f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1cc06e1c0 con 0x7ff1cc159900 2023-10-06T04:40:22.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.321+0000 7ff1d1c8f700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1cc068800 con 0x7ff1cc067eb0 2023-10-06T04:40:22.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.321+0000 7ff1cb7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff1cc159900 0x7ff1cc15d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.321+0000 7ff1caffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff1cc06f650 0x7ff1cc06e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34862/0 (socket says 172.21.15.112:34862) 2023-10-06T04:40:22.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.321+0000 7ff1caffd700 1 -- 172.21.15.112:0/3172288606 learned_addr learned my addr 172.21.15.112:0/3172288606 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:22.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.322+0000 7ff1cbfff700 1 --2- 172.21.15.112:0/3172288606 >> v2:172.21.15.179:3300/0 conn(0x7ff1cc067eb0 0x7ff1cc0682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.322+0000 7ff1cb7fe700 1 -- 172.21.15.112:0/3172288606 >> v2:172.21.15.179:3300/0 conn(0x7ff1cc067eb0 msgr2=0x7ff1cc0682c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:22.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.322+0000 7ff1cb7fe700 1 --2- 172.21.15.112:0/3172288606 >> v2:172.21.15.179:3300/0 conn(0x7ff1cc067eb0 0x7ff1cc0682c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.322+0000 7ff1cb7fe700 1 -- 172.21.15.112:0/3172288606 >> v1:172.21.15.112:6789/0 conn(0x7ff1cc06f650 legacy=0x7ff1cc06e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.322+0000 7ff1cb7fe700 1 -- 172.21.15.112:0/3172288606 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc15e2e0 con 0x7ff1cc159900 2023-10-06T04:40:22.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.322+0000 7ff1ca7fc700 1 -- 172.21.15.112:0/3172288606 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2848841110 0 0) 0x7ff1c0001110 con 0x7ff1cc06f650 2023-10-06T04:40:22.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.322+0000 7ff1cb7fe700 1 --2- 172.21.15.112:0/3172288606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc159900 0x7ff1cc15d410 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc0c2080 tx=0x7ff1bc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3cf24cfb9ba7de1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:22.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.322+0000 7ff1ca7fc700 1 -- 172.21.15.112:0/3172288606 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc00e070 con 0x7ff1cc159900 2023-10-06T04:40:22.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.322+0000 7ff1ca7fc700 1 -- 172.21.15.112:0/3172288606 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc00bc30 con 0x7ff1cc159900 2023-10-06T04:40:22.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.322+0000 7ff1ca7fc700 1 -- 172.21.15.112:0/3172288606 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc012430 con 0x7ff1cc159900 2023-10-06T04:40:22.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.322+0000 7ff1d1c8f700 1 -- 172.21.15.112:0/3172288606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc159900 msgr2=0x7ff1cc15d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.322+0000 7ff1d1c8f700 1 --2- 172.21.15.112:0/3172288606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc159900 0x7ff1cc15d410 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc0c2080 tx=0x7ff1bc009780 comp rx=0 tx=0).stop 2023-10-06T04:40:22.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.323+0000 7ff1d1c8f700 1 -- 172.21.15.112:0/3172288606 shutdown_connections 2023-10-06T04:40:22.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.323+0000 7ff1d1c8f700 1 --2- 172.21.15.112:0/3172288606 >> v2:172.21.15.179:3300/0 conn(0x7ff1cc067eb0 0x7ff1cc0682c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.323+0000 7ff1d1c8f700 1 --2- 172.21.15.112:0/3172288606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc159900 0x7ff1cc15d410 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.323+0000 7ff1d1c8f700 1 -- 172.21.15.112:0/3172288606 >> 172.21.15.112:0/3172288606 conn(0x7ff1cc0ce5e0 msgr2=0x7ff1cc0ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:22.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.323+0000 7ff1d1c8f700 1 -- 172.21.15.112:0/3172288606 shutdown_connections 2023-10-06T04:40:22.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.323+0000 7ff1d1c8f700 1 -- 172.21.15.112:0/3172288606 wait complete. 2023-10-06T04:40:22.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.324+0000 7ff1d1c8f700 1 Processor -- start 2023-10-06T04:40:22.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.324+0000 7ff1d1c8f700 1 -- start start 2023-10-06T04:40:22.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.324+0000 7ff1d1c8f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc067eb0 0x7ff1cc157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.324+0000 7ff1d1c8f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1cc06f650 0x7ff1cc0b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.325+0000 7ff1d1c8f700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1cc159900 0x7ff1cc0c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.325+0000 7ff1d1c8f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0b21c0 con 0x7ff1cc067eb0 2023-10-06T04:40:22.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.325+0000 7ff1d1c8f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0c4a70 con 0x7ff1cc06f650 2023-10-06T04:40:22.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.325+0000 7ff1d1c8f700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0b15b0 con 0x7ff1cc159900 2023-10-06T04:40:22.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.325+0000 7ff1cb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc067eb0 0x7ff1cc157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.325+0000 7ff1cb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc067eb0 0x7ff1cc157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51882/0 (socket says 172.21.15.112:51882) 2023-10-06T04:40:22.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.325+0000 7ff1cb7fe700 1 -- 172.21.15.112:0/69324495 learned_addr learned my addr 172.21.15.112:0/69324495 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:22.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.325+0000 7ff1caffd700 1 --2- 172.21.15.112:0/69324495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1cc06f650 0x7ff1cc0b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.325+0000 7ff1cbfff700 1 --2- 172.21.15.112:0/69324495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1cc159900 0x7ff1cc0c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.325+0000 7ff1cb7fe700 1 -- 172.21.15.112:0/69324495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1cc159900 msgr2=0x7ff1cc0c35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.325+0000 7ff1cb7fe700 1 --2- 172.21.15.112:0/69324495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1cc159900 0x7ff1cc0c35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.325+0000 7ff1cb7fe700 1 -- 172.21.15.112:0/69324495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1cc06f650 msgr2=0x7ff1cc0b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.325+0000 7ff1cb7fe700 1 --2- 172.21.15.112:0/69324495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1cc06f650 0x7ff1cc0b3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.325+0000 7ff1cb7fe700 1 -- 172.21.15.112:0/69324495 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc009a20 con 0x7ff1cc067eb0 2023-10-06T04:40:22.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.325+0000 7ff1cb7fe700 1 --2- 172.21.15.112:0/69324495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc067eb0 0x7ff1cc157650 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc013000 tx=0x7ff1bc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:22.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.325+0000 7ff1b37fe700 1 -- 172.21.15.112:0/69324495 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc001090 con 0x7ff1cc067eb0 2023-10-06T04:40:22.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.325+0000 7ff1b37fe700 1 -- 172.21.15.112:0/69324495 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc012e20 con 0x7ff1cc067eb0 2023-10-06T04:40:22.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.325+0000 7ff1d1c8f700 1 -- 172.21.15.112:0/69324495 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1cc0b1890 con 0x7ff1cc067eb0 2023-10-06T04:40:22.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.325+0000 7ff1b37fe700 1 -- 172.21.15.112:0/69324495 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc01d860 con 0x7ff1cc067eb0 2023-10-06T04:40:22.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.325+0000 7ff1d1c8f700 1 -- 172.21.15.112:0/69324495 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1cc0b1e50 con 0x7ff1cc067eb0 2023-10-06T04:40:22.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.326+0000 7ff1d1c8f700 1 -- 172.21.15.112:0/69324495 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1cc0b36d0 con 0x7ff1cc067eb0 2023-10-06T04:40:22.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.326+0000 7ff1b37fe700 1 -- 172.21.15.112:0/69324495 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7ff1bc024070 con 0x7ff1cc067eb0 2023-10-06T04:40:22.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.327+0000 7ff1b37fe700 1 --2- 172.21.15.112:0/69324495 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff1b80670e0 0x7ff1b8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.327+0000 7ff1b37fe700 1 -- 172.21.15.112:0/69324495 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff1bc087070 con 0x7ff1cc067eb0 2023-10-06T04:40:22.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.327+0000 7ff1caffd700 1 --2- 172.21.15.112:0/69324495 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff1b80670e0 0x7ff1b8069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.327+0000 7ff1caffd700 1 --2- 172.21.15.112:0/69324495 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff1b80670e0 0x7ff1b8069590 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc158470 tx=0x7ff1c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:22.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.331+0000 7ff1b37fe700 1 -- 172.21.15.112:0/69324495 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1bc053f00 con 0x7ff1cc067eb0 2023-10-06T04:40:22.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.560+0000 7ff1d1c8f700 1 -- 172.21.15.112:0/69324495 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1cc05f230 con 0x7ff1cc067eb0 2023-10-06T04:40:22.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.560+0000 7ff1b37fe700 1 -- 172.21.15.112:0/69324495 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4606 (secure 0 0 0) 0x7ff1bc01c3a0 con 0x7ff1cc067eb0 2023-10-06T04:40:22.563 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:22.563 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1053109253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1053109253},{"type":"v1","addr":"172.21.15.179:6835","nonce":1053109253}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4974,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3563478163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3563478163},{"type":"v1","addr":"172.21.15.112:6836","nonce":3563478163}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4977,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/925043938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":925043938},{"type":"v1","addr":"172.21.15.112:6837","nonce":925043938}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:06.223840+0000","modified":"2023-10-06T04:40:09.873795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1886371745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1886371745},{"type":"v1","addr":"172.21.15.179:6834","nonce":1886371745}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:40:22.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.562+0000 7ff1d1c8f700 1 -- 172.21.15.112:0/69324495 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff1b80670e0 msgr2=0x7ff1b8069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.562+0000 7ff1d1c8f700 1 --2- 172.21.15.112:0/69324495 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff1b80670e0 0x7ff1b8069590 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc158470 tx=0x7ff1c0009040 comp rx=0 tx=0).stop 2023-10-06T04:40:22.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.562+0000 7ff1d1c8f700 1 -- 172.21.15.112:0/69324495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc067eb0 msgr2=0x7ff1cc157650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.562+0000 7ff1d1c8f700 1 --2- 172.21.15.112:0/69324495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc067eb0 0x7ff1cc157650 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc013000 tx=0x7ff1bc019000 comp rx=0 tx=0).stop 2023-10-06T04:40:22.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.562+0000 7ff1d1c8f700 1 -- 172.21.15.112:0/69324495 shutdown_connections 2023-10-06T04:40:22.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.562+0000 7ff1d1c8f700 1 --2- 172.21.15.112:0/69324495 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7ff1b80670e0 0x7ff1b8069590 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.562+0000 7ff1d1c8f700 1 --2- 172.21.15.112:0/69324495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1cc159900 0x7ff1cc0c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.562+0000 7ff1d1c8f700 1 --2- 172.21.15.112:0/69324495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc067eb0 0x7ff1cc157650 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.562+0000 7ff1d1c8f700 1 --2- 172.21.15.112:0/69324495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1cc06f650 0x7ff1cc0b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.562+0000 7ff1d1c8f700 1 -- 172.21.15.112:0/69324495 >> 172.21.15.112:0/69324495 conn(0x7ff1cc0ce5e0 msgr2=0x7ff1cc158710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:22.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.563+0000 7ff1d1c8f700 1 -- 172.21.15.112:0/69324495 shutdown_connections 2023-10-06T04:40:22.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.563+0000 7ff1d1c8f700 1 -- 172.21.15.112:0/69324495 wait complete. 2023-10-06T04:40:22.568 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 16 2023-10-06T04:40:22.577 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:22.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.689+0000 7f42f606e700 1 Processor -- start 2023-10-06T04:40:22.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.689+0000 7f42f606e700 1 -- start start 2023-10-06T04:40:22.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.690+0000 7f42f606e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f42f006cfb0 0x7f42f015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.690+0000 7f42f606e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f00ae950 con 0x7f42f015dfa0 2023-10-06T04:40:22.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.690+0000 7f42f606e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f00ae020 con 0x7f42f015d4c0 2023-10-06T04:40:22.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.690+0000 7f42f606e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f00ae300 con 0x7f42f006cfb0 2023-10-06T04:40:22.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.690+0000 7f42eeffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f42f015dfa0 0x7f42f015b2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34864/0 (socket says 172.21.15.112:34864) 2023-10-06T04:40:22.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.690+0000 7f42eeffd700 1 -- 172.21.15.112:0/2512969465 learned_addr learned my addr 172.21.15.112:0/2512969465 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:22.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.690+0000 7f42ee7fc700 1 -- 172.21.15.112:0/2512969465 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1725726273 0 0) 0x7f42f00ae950 con 0x7f42f015dfa0 2023-10-06T04:40:22.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.690+0000 7f42effff700 1 --2- 172.21.15.112:0/2512969465 >> v2:172.21.15.179:3300/0 conn(0x7f42f006cfb0 0x7f42f015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.690+0000 7f42ee7fc700 1 -- 172.21.15.112:0/2512969465 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42dc003570 con 0x7f42f015dfa0 2023-10-06T04:40:22.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ee7fc700 1 -- 172.21.15.112:0/2512969465 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 925282395 0 0) 0x7f42dc003570 con 0x7f42f015dfa0 2023-10-06T04:40:22.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ee7fc700 1 -- 172.21.15.112:0/2512969465 >> v2:172.21.15.179:3300/0 conn(0x7f42f006cfb0 msgr2=0x7f42f015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:22.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ee7fc700 1 --2- 172.21.15.112:0/2512969465 >> v2:172.21.15.179:3300/0 conn(0x7f42f006cfb0 0x7f42f015b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ee7fc700 1 -- 172.21.15.112:0/2512969465 >> v1:172.21.15.179:6789/0 conn(0x7f42f015d4c0 legacy=0x7f42f015d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ee7fc700 1 -- 172.21.15.112:0/2512969465 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f00ae5e0 con 0x7f42f015dfa0 2023-10-06T04:40:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ee7fc700 1 -- 172.21.15.112:0/2512969465 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f42d8001470 con 0x7f42f015dfa0 2023-10-06T04:40:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ee7fc700 1 -- 172.21.15.112:0/2512969465 >> v1:172.21.15.112:6789/0 conn(0x7f42f015dfa0 legacy=0x7f42f015b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ee7fc700 1 --2- 172.21.15.112:0/2512969465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42dc003a60 0x7f42dc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ee7fc700 1 --2- 172.21.15.112:0/2512969465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42dc004810 0x7f42dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ee7fc700 1 --2- 172.21.15.112:0/2512969465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42dc0051c0 0x7f42dc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ee7fc700 1 -- 172.21.15.112:0/2512969465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f00ae300 con 0x7f42dc003a60 2023-10-06T04:40:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ee7fc700 1 -- 172.21.15.112:0/2512969465 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc00c0d0 con 0x7f42dc0051c0 2023-10-06T04:40:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ee7fc700 1 -- 172.21.15.112:0/2512969465 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc00c290 con 0x7f42dc004810 2023-10-06T04:40:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ef7fe700 1 --2- 172.21.15.112:0/2512969465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42dc003a60 0x7f42dc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42effff700 1 --2- 172.21.15.112:0/2512969465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42dc0051c0 0x7f42dc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42eeffd700 1 --2- 172.21.15.112:0/2512969465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42dc004810 0x7f42dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ef7fe700 1 -- 172.21.15.112:0/2512969465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42dc004810 msgr2=0x7f42dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:22.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ef7fe700 1 --2- 172.21.15.112:0/2512969465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42dc004810 0x7f42dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ef7fe700 1 -- 172.21.15.112:0/2512969465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42dc0051c0 msgr2=0x7f42dc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:22.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ef7fe700 1 --2- 172.21.15.112:0/2512969465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42dc0051c0 0x7f42dc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ef7fe700 1 -- 172.21.15.112:0/2512969465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42dc003570 con 0x7f42dc003a60 2023-10-06T04:40:22.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42effff700 1 -- 172.21.15.112:0/2512969465 reap_dead start 2023-10-06T04:40:22.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42eeffd700 1 --2- 172.21.15.112:0/2512969465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42dc004810 0x7f42dc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:22.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ef7fe700 1 --2- 172.21.15.112:0/2512969465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42dc003a60 0x7f42dc003e70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f42e8001fc0 tx=0x7f42e8001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d13d3988d02d4b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:22.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ee7fc700 1 -- 172.21.15.112:0/2512969465 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8001950 con 0x7f42dc003a60 2023-10-06T04:40:22.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ee7fc700 1 -- 172.21.15.112:0/2512969465 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e800c8b0 con 0x7f42dc003a60 2023-10-06T04:40:22.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.691+0000 7f42ee7fc700 1 -- 172.21.15.112:0/2512969465 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e800cc50 con 0x7f42dc003a60 2023-10-06T04:40:22.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.692+0000 7f42f606e700 1 -- 172.21.15.112:0/2512969465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42dc003a60 msgr2=0x7f42dc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.692+0000 7f42f606e700 1 --2- 172.21.15.112:0/2512969465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42dc003a60 0x7f42dc003e70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f42e8001fc0 tx=0x7f42e8001640 comp rx=0 tx=0).stop 2023-10-06T04:40:22.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.692+0000 7f42f606e700 1 -- 172.21.15.112:0/2512969465 shutdown_connections 2023-10-06T04:40:22.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.692+0000 7f42f606e700 1 --2- 172.21.15.112:0/2512969465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42dc003a60 0x7f42dc003e70 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.692+0000 7f42f606e700 1 -- 172.21.15.112:0/2512969465 >> 172.21.15.112:0/2512969465 conn(0x7f42f008a240 msgr2=0x7f42f0099b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:22.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.692+0000 7f42f606e700 1 -- 172.21.15.112:0/2512969465 shutdown_connections 2023-10-06T04:40:22.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.692+0000 7f42f606e700 1 -- 172.21.15.112:0/2512969465 wait complete. 2023-10-06T04:40:22.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.693+0000 7f42f606e700 1 Processor -- start 2023-10-06T04:40:22.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.693+0000 7f42f606e700 1 -- start start 2023-10-06T04:40:22.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.694+0000 7f42f606e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42dc003a60 0x7f42f00b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.694+0000 7f42f606e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42f014a320 0x7f42f016a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.694+0000 7f42f606e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f009dd00 0x7f42f0158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.694+0000 7f42f606e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f00b54a0 con 0x7f42f014a320 2023-10-06T04:40:22.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.694+0000 7f42f606e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f0169a90 con 0x7f42f009dd00 2023-10-06T04:40:22.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.694+0000 7f42f606e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f016a050 con 0x7f42dc003a60 2023-10-06T04:40:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.694+0000 7f42eeffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42f014a320 0x7f42f016a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.694+0000 7f42eeffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42f014a320 0x7f42f016a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51902/0 (socket says 172.21.15.112:51902) 2023-10-06T04:40:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.694+0000 7f42eeffd700 1 -- 172.21.15.112:0/3627380701 learned_addr learned my addr 172.21.15.112:0/3627380701 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.694+0000 7f42ef7fe700 1 --2- 172.21.15.112:0/3627380701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42dc003a60 0x7f42f00b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.694+0000 7f42eeffd700 1 -- 172.21.15.112:0/3627380701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42dc003a60 msgr2=0x7f42f00b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.694+0000 7f42eeffd700 1 --2- 172.21.15.112:0/3627380701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42dc003a60 0x7f42f00b5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.694+0000 7f42effff700 1 --2- 172.21.15.112:0/3627380701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f009dd00 0x7f42f0158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.694+0000 7f42eeffd700 1 -- 172.21.15.112:0/3627380701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f009dd00 msgr2=0x7f42f0158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.694+0000 7f42eeffd700 1 --2- 172.21.15.112:0/3627380701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f009dd00 0x7f42f0158fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.694+0000 7f42eeffd700 1 -- 172.21.15.112:0/3627380701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f00b4ee0 con 0x7f42f014a320 2023-10-06T04:40:22.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.694+0000 7f42eeffd700 1 --2- 172.21.15.112:0/3627380701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42f014a320 0x7f42f016a4e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f42d800e810 tx=0x7f42d8001e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:22.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.695+0000 7f42e77fe700 1 -- 172.21.15.112:0/3627380701 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d8012590 con 0x7f42f014a320 2023-10-06T04:40:22.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.695+0000 7f42e77fe700 1 -- 172.21.15.112:0/3627380701 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d80126f0 con 0x7f42f014a320 2023-10-06T04:40:22.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.695+0000 7f42f606e700 1 -- 172.21.15.112:0/3627380701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f00b51c0 con 0x7f42f014a320 2023-10-06T04:40:22.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.695+0000 7f42e77fe700 1 -- 172.21.15.112:0/3627380701 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d8012a90 con 0x7f42f014a320 2023-10-06T04:40:22.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.695+0000 7f42f606e700 1 -- 172.21.15.112:0/3627380701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f014a790 con 0x7f42f014a320 2023-10-06T04:40:22.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.696+0000 7f42f606e700 1 -- 172.21.15.112:0/3627380701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f005f230 con 0x7f42f014a320 2023-10-06T04:40:22.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.696+0000 7f42e77fe700 1 -- 172.21.15.112:0/3627380701 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f42d801d460 con 0x7f42f014a320 2023-10-06T04:40:22.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.696+0000 7f42e77fe700 1 --2- 172.21.15.112:0/3627380701 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f42d00670e0 0x7f42d0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:22.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.696+0000 7f42e77fe700 1 -- 172.21.15.112:0/3627380701 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f42d80847b0 con 0x7f42f014a320 2023-10-06T04:40:22.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.696+0000 7f42ef7fe700 1 --2- 172.21.15.112:0/3627380701 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f42d00670e0 0x7f42d0069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:22.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.697+0000 7f42ef7fe700 1 --2- 172.21.15.112:0/3627380701 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f42d00670e0 0x7f42d0069590 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f42e8001fc0 tx=0x7f42e8015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:22.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.700+0000 7f42e77fe700 1 -- 172.21.15.112:0/3627380701 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42d8051640 con 0x7f42f014a320 2023-10-06T04:40:22.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.888+0000 7f42f606e700 1 -- 172.21.15.112:0/3627380701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42f016a190 con 0x7f42f014a320 2023-10-06T04:40:22.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.889+0000 7f42e77fe700 1 -- 172.21.15.112:0/3627380701 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f42d8054c60 con 0x7f42f014a320 2023-10-06T04:40:22.892 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:22.892 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":31,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:40:07.853039+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:40:04.313893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:40:05.190449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:22.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.891+0000 7f42f606e700 1 -- 172.21.15.112:0/3627380701 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f42d00670e0 msgr2=0x7f42d0069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.891+0000 7f42f606e700 1 --2- 172.21.15.112:0/3627380701 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f42d00670e0 0x7f42d0069590 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f42e8001fc0 tx=0x7f42e8015000 comp rx=0 tx=0).stop 2023-10-06T04:40:22.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.891+0000 7f42f606e700 1 -- 172.21.15.112:0/3627380701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42f014a320 msgr2=0x7f42f016a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:22.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.891+0000 7f42f606e700 1 --2- 172.21.15.112:0/3627380701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42f014a320 0x7f42f016a4e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f42d800e810 tx=0x7f42d8001e20 comp rx=0 tx=0).stop 2023-10-06T04:40:22.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.891+0000 7f42f606e700 1 -- 172.21.15.112:0/3627380701 shutdown_connections 2023-10-06T04:40:22.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.891+0000 7f42f606e700 1 --2- 172.21.15.112:0/3627380701 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f42d00670e0 0x7f42d0069590 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.891+0000 7f42f606e700 1 --2- 172.21.15.112:0/3627380701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f009dd00 0x7f42f0158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.891+0000 7f42f606e700 1 --2- 172.21.15.112:0/3627380701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42dc003a60 0x7f42f00b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.891+0000 7f42f606e700 1 --2- 172.21.15.112:0/3627380701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42f014a320 0x7f42f016a4e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:22.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.891+0000 7f42f606e700 1 -- 172.21.15.112:0/3627380701 >> 172.21.15.112:0/3627380701 conn(0x7f42f008a240 msgr2=0x7f42f00ad900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:22.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.891+0000 7f42f606e700 1 -- 172.21.15.112:0/3627380701 shutdown_connections 2023-10-06T04:40:22.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:22.891+0000 7f42f606e700 1 -- 172.21.15.112:0/3627380701 wait complete. 2023-10-06T04:40:22.906 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:40:22.906 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:23.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.018+0000 7fcdcb59e700 1 Processor -- start 2023-10-06T04:40:23.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.018+0000 7fcdcb59e700 1 -- start start 2023-10-06T04:40:23.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.019+0000 7fcdcb59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdcc0b11a0 0x7fcdcc0d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:23.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.019+0000 7fcdcb59e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcdcc0b3810 0x7fcdcc0b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:23.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.019+0000 7fcdcb59e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdcc0afed0 con 0x7fcdcc06d3b0 2023-10-06T04:40:23.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.019+0000 7fcdcb59e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdcc0b6170 con 0x7fcdcc0b3810 2023-10-06T04:40:23.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.019+0000 7fcdcb59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc0b6450 con 0x7fcdcc0b11a0 2023-10-06T04:40:23.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.019+0000 7fcdcad9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcdcc0b3810 0x7fcdcc0b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:23.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.019+0000 7fcdc1d9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fcdcc06d3b0 0x7fcdcc0b1570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34868/0 (socket says 172.21.15.112:34868) 2023-10-06T04:40:23.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.019+0000 7fcdc1d9b700 1 -- 172.21.15.112:0/3249231369 learned_addr learned my addr 172.21.15.112:0/3249231369 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:23.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.019+0000 7fcdcad9d700 1 -- 172.21.15.112:0/3249231369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdcc0b11a0 msgr2=0x7fcdcc0d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:23.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.019+0000 7fcdca59c700 1 --2- 172.21.15.112:0/3249231369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdcc0b11a0 0x7fcdcc0d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:23.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.019+0000 7fcdcad9d700 1 --2- 172.21.15.112:0/3249231369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdcc0b11a0 0x7fcdcc0d0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.019+0000 7fcdcad9d700 1 -- 172.21.15.112:0/3249231369 >> v1:172.21.15.112:6789/0 conn(0x7fcdcc06d3b0 legacy=0x7fcdcc0b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:23.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.019+0000 7fcdcad9d700 1 -- 172.21.15.112:0/3249231369 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc0b6730 con 0x7fcdcc0b3810 2023-10-06T04:40:23.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.020+0000 7fcdcad9d700 1 --2- 172.21.15.112:0/3249231369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc0b3810 0x7fcdcc0b3cb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009e60 tx=0x7fcdc4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d21b9552d97b958 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:23.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.020+0000 7fcdc9d9b700 1 -- 172.21.15.112:0/3249231369 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc400e070 con 0x7fcdcc0b3810 2023-10-06T04:40:23.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.020+0000 7fcdc9d9b700 1 -- 172.21.15.112:0/3249231369 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc400bb30 con 0x7fcdcc0b3810 2023-10-06T04:40:23.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.020+0000 7fcdc9d9b700 1 -- 172.21.15.112:0/3249231369 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4012430 con 0x7fcdcc0b3810 2023-10-06T04:40:23.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.020+0000 7fcdcb59e700 1 -- 172.21.15.112:0/3249231369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc0b3810 msgr2=0x7fcdcc0b3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:23.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.020+0000 7fcdcb59e700 1 --2- 172.21.15.112:0/3249231369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc0b3810 0x7fcdcc0b3cb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009e60 tx=0x7fcdc4009780 comp rx=0 tx=0).stop 2023-10-06T04:40:23.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.020+0000 7fcdcb59e700 1 -- 172.21.15.112:0/3249231369 shutdown_connections 2023-10-06T04:40:23.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.020+0000 7fcdcb59e700 1 --2- 172.21.15.112:0/3249231369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc0b3810 0x7fcdcc0b3cb0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.020+0000 7fcdcb59e700 1 --2- 172.21.15.112:0/3249231369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdcc0b11a0 0x7fcdcc0d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.020+0000 7fcdcb59e700 1 -- 172.21.15.112:0/3249231369 >> 172.21.15.112:0/3249231369 conn(0x7fcdcc06cfb0 msgr2=0x7fcdcc0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:23.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.020+0000 7fcdcb59e700 1 -- 172.21.15.112:0/3249231369 shutdown_connections 2023-10-06T04:40:23.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.020+0000 7fcdcb59e700 1 -- 172.21.15.112:0/3249231369 wait complete. 2023-10-06T04:40:23.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.021+0000 7fcdcb59e700 1 Processor -- start 2023-10-06T04:40:23.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.021+0000 7fcdcb59e700 1 -- start start 2023-10-06T04:40:23.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.022+0000 7fcdcb59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc06d3b0 0x7fcdcc15cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:23.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.022+0000 7fcdcb59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdcc0b11a0 0x7fcdcc0c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:23.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.022+0000 7fcdcb59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdcc0b3810 0x7fcdcc0b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:23.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.022+0000 7fcdcb59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc0c7770 con 0x7fcdcc06d3b0 2023-10-06T04:40:23.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.022+0000 7fcdcb59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc09d5b0 con 0x7fcdcc0b3810 2023-10-06T04:40:23.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.022+0000 7fcdcb59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc0c6b60 con 0x7fcdcc0b11a0 2023-10-06T04:40:23.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.022+0000 7fcdca59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc06d3b0 0x7fcdcc15cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:23.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.022+0000 7fcdca59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc06d3b0 0x7fcdcc15cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51924/0 (socket says 172.21.15.112:51924) 2023-10-06T04:40:23.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.022+0000 7fcdca59c700 1 -- 172.21.15.112:0/1940038188 learned_addr learned my addr 172.21.15.112:0/1940038188 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:23.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.023+0000 7fcdc1d9b700 1 --2- 172.21.15.112:0/1940038188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdcc0b11a0 0x7fcdcc0c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:23.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.023+0000 7fcdcad9d700 1 --2- 172.21.15.112:0/1940038188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdcc0b3810 0x7fcdcc0b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:23.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.023+0000 7fcdca59c700 1 -- 172.21.15.112:0/1940038188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdcc0b11a0 msgr2=0x7fcdcc0c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:23.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.023+0000 7fcdca59c700 1 --2- 172.21.15.112:0/1940038188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdcc0b11a0 0x7fcdcc0c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.023+0000 7fcdca59c700 1 -- 172.21.15.112:0/1940038188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdcc0b3810 msgr2=0x7fcdcc0b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:23.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.023+0000 7fcdca59c700 1 --2- 172.21.15.112:0/1940038188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdcc0b3810 0x7fcdcc0b4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.023+0000 7fcdca59c700 1 -- 172.21.15.112:0/1940038188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc4009a20 con 0x7fcdcc06d3b0 2023-10-06T04:40:23.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.023+0000 7fcdca59c700 1 --2- 172.21.15.112:0/1940038188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc06d3b0 0x7fcdcc15cca0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00c880 tx=0x7fcdbc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:23.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.023+0000 7fcdc2ffd700 1 -- 172.21.15.112:0/1940038188 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc011600 con 0x7fcdcc06d3b0 2023-10-06T04:40:23.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.023+0000 7fcdc2ffd700 1 -- 172.21.15.112:0/1940038188 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdbc011780 con 0x7fcdcc06d3b0 2023-10-06T04:40:23.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.023+0000 7fcdcb59e700 1 -- 172.21.15.112:0/1940038188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdcc0c6e40 con 0x7fcdcc06d3b0 2023-10-06T04:40:23.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.023+0000 7fcdc2ffd700 1 -- 172.21.15.112:0/1940038188 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc011b40 con 0x7fcdcc06d3b0 2023-10-06T04:40:23.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.023+0000 7fcdcb59e700 1 -- 172.21.15.112:0/1940038188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdcc0c7400 con 0x7fcdcc06d3b0 2023-10-06T04:40:23.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.024+0000 7fcdcb59e700 1 -- 172.21.15.112:0/1940038188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdcc05f230 con 0x7fcdcc06d3b0 2023-10-06T04:40:23.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.024+0000 7fcdc2ffd700 1 -- 172.21.15.112:0/1940038188 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fcdbc018360 con 0x7fcdcc06d3b0 2023-10-06T04:40:23.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.024+0000 7fcdc2ffd700 1 --2- 172.21.15.112:0/1940038188 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcdac0670e0 0x7fcdac069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:23.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.025+0000 7fcdc2ffd700 1 -- 172.21.15.112:0/1940038188 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcdbc0847c0 con 0x7fcdcc06d3b0 2023-10-06T04:40:23.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.025+0000 7fcdc1d9b700 1 --2- 172.21.15.112:0/1940038188 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcdac0670e0 0x7fcdac069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:23.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.025+0000 7fcdc1d9b700 1 --2- 172.21.15.112:0/1940038188 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcdac0670e0 0x7fcdac069590 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40058d0 tx=0x7fcdb4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:23.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.029+0000 7fcdc2ffd700 1 -- 172.21.15.112:0/1940038188 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcdbc054fd0 con 0x7fcdcc06d3b0 2023-10-06T04:40:23.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.254+0000 7fcdcb59e700 1 -- 172.21.15.112:0/1940038188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcdcc08a050 con 0x7fcdcc06d3b0 2023-10-06T04:40:23.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.255+0000 7fcdc2ffd700 1 -- 172.21.15.112:0/1940038188 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4606 (secure 0 0 0) 0x7fcdbc054b60 con 0x7fcdcc06d3b0 2023-10-06T04:40:23.257 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:23.257 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1053109253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1053109253},{"type":"v1","addr":"172.21.15.179:6835","nonce":1053109253}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4974,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3563478163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3563478163},{"type":"v1","addr":"172.21.15.112:6836","nonce":3563478163}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4977,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/925043938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":925043938},{"type":"v1","addr":"172.21.15.112:6837","nonce":925043938}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:06.223840+0000","modified":"2023-10-06T04:40:09.873795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1886371745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1886371745},{"type":"v1","addr":"172.21.15.179:6834","nonce":1886371745}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:40:23.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.257+0000 7fcdcb59e700 1 -- 172.21.15.112:0/1940038188 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcdac0670e0 msgr2=0x7fcdac069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:23.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.257+0000 7fcdcb59e700 1 --2- 172.21.15.112:0/1940038188 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcdac0670e0 0x7fcdac069590 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40058d0 tx=0x7fcdb4009040 comp rx=0 tx=0).stop 2023-10-06T04:40:23.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.257+0000 7fcdcb59e700 1 -- 172.21.15.112:0/1940038188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc06d3b0 msgr2=0x7fcdcc15cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:23.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.257+0000 7fcdcb59e700 1 --2- 172.21.15.112:0/1940038188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc06d3b0 0x7fcdcc15cca0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00c880 tx=0x7fcdbc008040 comp rx=0 tx=0).stop 2023-10-06T04:40:23.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.257+0000 7fcdcb59e700 1 -- 172.21.15.112:0/1940038188 shutdown_connections 2023-10-06T04:40:23.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.257+0000 7fcdcb59e700 1 --2- 172.21.15.112:0/1940038188 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcdac0670e0 0x7fcdac069590 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.257+0000 7fcdcb59e700 1 --2- 172.21.15.112:0/1940038188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdcc0b3810 0x7fcdcc0b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.257+0000 7fcdcb59e700 1 --2- 172.21.15.112:0/1940038188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc06d3b0 0x7fcdcc15cca0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.257+0000 7fcdcb59e700 1 --2- 172.21.15.112:0/1940038188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdcc0b11a0 0x7fcdcc0c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.257+0000 7fcdcb59e700 1 -- 172.21.15.112:0/1940038188 >> 172.21.15.112:0/1940038188 conn(0x7fcdcc06cfb0 msgr2=0x7fcdcc06ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:23.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.257+0000 7fcdcb59e700 1 -- 172.21.15.112:0/1940038188 shutdown_connections 2023-10-06T04:40:23.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.257+0000 7fcdcb59e700 1 -- 172.21.15.112:0/1940038188 wait complete. 2023-10-06T04:40:23.260 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 16 2023-10-06T04:40:23.271 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:23.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.382+0000 7f894d0cf700 1 Processor -- start 2023-10-06T04:40:23.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.382+0000 7f894d0cf700 1 -- start start 2023-10-06T04:40:23.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.383+0000 7f894d0cf700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f89480b11a0 0x7f89480d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:23.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.383+0000 7f894d0cf700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f894806d3b0 0x7f89480b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:23.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.383+0000 7f894d0cf700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89480b3810 0x7f89480b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:23.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.383+0000 7f894d0cf700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89480afed0 con 0x7f894806d3b0 2023-10-06T04:40:23.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.383+0000 7f894d0cf700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89480b1ab0 con 0x7f89480b11a0 2023-10-06T04:40:23.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.383+0000 7f894d0cf700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89480b6170 con 0x7f89480b3810 2023-10-06T04:40:23.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.383+0000 7f89477fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f894806d3b0 0x7f89480b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:23.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.383+0000 7f89477fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f894806d3b0 0x7f89480b1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51932/0 (socket says 172.21.15.112:51932) 2023-10-06T04:40:23.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.383+0000 7f89477fe700 1 -- 172.21.15.112:0/2496066231 learned_addr learned my addr 172.21.15.112:0/2496066231 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:23.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.383+0000 7f8947fff700 1 --2- 172.21.15.112:0/2496066231 >> v2:172.21.15.179:3300/0 conn(0x7f89480b11a0 0x7f89480d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:23.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.383+0000 7f894c8ce700 1 --2- 172.21.15.112:0/2496066231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89480b3810 0x7f89480b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:23.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.384+0000 7f89477fe700 1 -- 172.21.15.112:0/2496066231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89480b3810 msgr2=0x7f89480b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:23.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.384+0000 7f89477fe700 1 --2- 172.21.15.112:0/2496066231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89480b3810 0x7f89480b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.384+0000 7f89477fe700 1 -- 172.21.15.112:0/2496066231 >> v2:172.21.15.179:3300/0 conn(0x7f89480b11a0 msgr2=0x7f89480d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:23.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.384+0000 7f89477fe700 1 --2- 172.21.15.112:0/2496066231 >> v2:172.21.15.179:3300/0 conn(0x7f89480b11a0 0x7f89480d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.384+0000 7f89477fe700 1 -- 172.21.15.112:0/2496066231 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89480b6450 con 0x7f894806d3b0 2023-10-06T04:40:23.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.384+0000 7f89477fe700 1 --2- 172.21.15.112:0/2496066231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f894806d3b0 0x7f89480b1570 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8948088ee0 tx=0x7f893c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b1dab15c55798c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:23.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.384+0000 7f8946ffd700 1 -- 172.21.15.112:0/2496066231 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c00b860 con 0x7f894806d3b0 2023-10-06T04:40:23.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.384+0000 7f8946ffd700 1 -- 172.21.15.112:0/2496066231 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c00b9c0 con 0x7f894806d3b0 2023-10-06T04:40:23.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.384+0000 7f8946ffd700 1 -- 172.21.15.112:0/2496066231 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c00bd60 con 0x7f894806d3b0 2023-10-06T04:40:23.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.384+0000 7f894d0cf700 1 -- 172.21.15.112:0/2496066231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f894806d3b0 msgr2=0x7f89480b1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:23.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.384+0000 7f894d0cf700 1 --2- 172.21.15.112:0/2496066231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f894806d3b0 0x7f89480b1570 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8948088ee0 tx=0x7f893c009250 comp rx=0 tx=0).stop 2023-10-06T04:40:23.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.384+0000 7f894d0cf700 1 -- 172.21.15.112:0/2496066231 shutdown_connections 2023-10-06T04:40:23.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.384+0000 7f894d0cf700 1 --2- 172.21.15.112:0/2496066231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89480b3810 0x7f89480b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.384+0000 7f894d0cf700 1 --2- 172.21.15.112:0/2496066231 >> v2:172.21.15.179:3300/0 conn(0x7f89480b11a0 0x7f89480d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.384+0000 7f894d0cf700 1 --2- 172.21.15.112:0/2496066231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f894806d3b0 0x7f89480b1570 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.384+0000 7f894d0cf700 1 -- 172.21.15.112:0/2496066231 >> 172.21.15.112:0/2496066231 conn(0x7f894806cfb0 msgr2=0x7f89480d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:23.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.384+0000 7f894d0cf700 1 -- 172.21.15.112:0/2496066231 shutdown_connections 2023-10-06T04:40:23.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.385+0000 7f894d0cf700 1 -- 172.21.15.112:0/2496066231 wait complete. 2023-10-06T04:40:23.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.386+0000 7f894d0cf700 1 Processor -- start 2023-10-06T04:40:23.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.386+0000 7f894d0cf700 1 -- start start 2023-10-06T04:40:23.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.386+0000 7f894d0cf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f894806d3b0 0x7f89481596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:23.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.386+0000 7f894d0cf700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89480b11a0 0x7f894809df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:23.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.386+0000 7f894d0cf700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89480b3810 0x7f894816ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:23.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.386+0000 7f894d0cf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8948159f80 con 0x7f894806d3b0 2023-10-06T04:40:23.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.386+0000 7f894d0cf700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894816a040 con 0x7f89480b11a0 2023-10-06T04:40:23.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.386+0000 7f894d0cf700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894816a320 con 0x7f89480b3810 2023-10-06T04:40:23.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.387+0000 7f8947fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f894806d3b0 0x7f89481596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:23.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.387+0000 7f8947fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f894806d3b0 0x7f89481596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51946/0 (socket says 172.21.15.112:51946) 2023-10-06T04:40:23.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.387+0000 7f8947fff700 1 -- 172.21.15.112:0/774849483 learned_addr learned my addr 172.21.15.112:0/774849483 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:23.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.387+0000 7f8947fff700 1 -- 172.21.15.112:0/774849483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89480b3810 msgr2=0x7f894816ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:23.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.387+0000 7f8947fff700 1 --2- 172.21.15.112:0/774849483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89480b3810 0x7f894816ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.387+0000 7f8947fff700 1 -- 172.21.15.112:0/774849483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89480b11a0 msgr2=0x7f894809df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:23.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.387+0000 7f8947fff700 1 --2- 172.21.15.112:0/774849483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89480b11a0 0x7f894809df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.387+0000 7f8947fff700 1 -- 172.21.15.112:0/774849483 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c0094f0 con 0x7f894806d3b0 2023-10-06T04:40:23.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.387+0000 7f8947fff700 1 --2- 172.21.15.112:0/774849483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f894806d3b0 0x7f89481596f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f893800d860 tx=0x7f8938008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:23.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.387+0000 7f892ffff700 1 -- 172.21.15.112:0/774849483 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8938009610 con 0x7f894806d3b0 2023-10-06T04:40:23.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.387+0000 7f892ffff700 1 -- 172.21.15.112:0/774849483 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8938009770 con 0x7f894806d3b0 2023-10-06T04:40:23.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.387+0000 7f894d0cf700 1 -- 172.21.15.112:0/774849483 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894816a600 con 0x7f894806d3b0 2023-10-06T04:40:23.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.387+0000 7f892ffff700 1 -- 172.21.15.112:0/774849483 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8938009b30 con 0x7f894806d3b0 2023-10-06T04:40:23.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.387+0000 7f894d0cf700 1 -- 172.21.15.112:0/774849483 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f894816abc0 con 0x7f894806d3b0 2023-10-06T04:40:23.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.388+0000 7f894d0cf700 1 -- 172.21.15.112:0/774849483 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89480899e0 con 0x7f894806d3b0 2023-10-06T04:40:23.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.388+0000 7f892ffff700 1 -- 172.21.15.112:0/774849483 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f893801e460 con 0x7f894806d3b0 2023-10-06T04:40:23.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.389+0000 7f892ffff700 1 --2- 172.21.15.112:0/774849483 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f89340670e0 0x7f8934069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:23.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.389+0000 7f89477fe700 1 --2- 172.21.15.112:0/774849483 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f89340670e0 0x7f8934069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:23.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.389+0000 7f892ffff700 1 -- 172.21.15.112:0/774849483 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8938085010 con 0x7f894806d3b0 2023-10-06T04:40:23.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.389+0000 7f89477fe700 1 --2- 172.21.15.112:0/774849483 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f89340670e0 0x7f8934069590 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8948088ee0 tx=0x7f893c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:23.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.393+0000 7f892ffff700 1 -- 172.21.15.112:0/774849483 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8938051ea0 con 0x7f894806d3b0 2023-10-06T04:40:23.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.620+0000 7f894d0cf700 1 -- 172.21.15.112:0/774849483 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f894805f230 con 0x7f894806d3b0 2023-10-06T04:40:23.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.621+0000 7f892ffff700 1 -- 172.21.15.112:0/774849483 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f89380554c0 con 0x7f894806d3b0 2023-10-06T04:40:23.623 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:23.624 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1053109253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1053109253},{"type":"v1","addr":"172.21.15.179:6835","nonce":1053109253}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4974,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3563478163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3563478163},{"type":"v1","addr":"172.21.15.112:6836","nonce":3563478163}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4977,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/925043938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":925043938},{"type":"v1","addr":"172.21.15.112:6837","nonce":925043938}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:40:06.223840+0000","modified":"2023-10-06T04:40:09.873795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1886371745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1886371745},{"type":"v1","addr":"172.21.15.179:6834","nonce":1886371745}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:40:23.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.623+0000 7f894d0cf700 1 -- 172.21.15.112:0/774849483 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f89340670e0 msgr2=0x7f8934069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:23.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.623+0000 7f894d0cf700 1 --2- 172.21.15.112:0/774849483 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f89340670e0 0x7f8934069590 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8948088ee0 tx=0x7f893c017000 comp rx=0 tx=0).stop 2023-10-06T04:40:23.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.623+0000 7f894d0cf700 1 -- 172.21.15.112:0/774849483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f894806d3b0 msgr2=0x7f89481596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:23.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.623+0000 7f894d0cf700 1 --2- 172.21.15.112:0/774849483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f894806d3b0 0x7f89481596f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f893800d860 tx=0x7f8938008040 comp rx=0 tx=0).stop 2023-10-06T04:40:23.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.623+0000 7f894d0cf700 1 -- 172.21.15.112:0/774849483 shutdown_connections 2023-10-06T04:40:23.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.623+0000 7f894d0cf700 1 --2- 172.21.15.112:0/774849483 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f89340670e0 0x7f8934069590 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.623+0000 7f894d0cf700 1 --2- 172.21.15.112:0/774849483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89480b3810 0x7f894816ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.623+0000 7f894d0cf700 1 --2- 172.21.15.112:0/774849483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f894806d3b0 0x7f89481596f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.623+0000 7f894d0cf700 1 --2- 172.21.15.112:0/774849483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89480b11a0 0x7f894809df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.623+0000 7f894d0cf700 1 -- 172.21.15.112:0/774849483 >> 172.21.15.112:0/774849483 conn(0x7f894806cfb0 msgr2=0x7f89480d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:23.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.623+0000 7f894d0cf700 1 -- 172.21.15.112:0/774849483 shutdown_connections 2023-10-06T04:40:23.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.623+0000 7f894d0cf700 1 -- 172.21.15.112:0/774849483 wait complete. 2023-10-06T04:40:23.627 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 16 2023-10-06T04:40:23.637 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:23.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.749+0000 7fe6ecb5c700 1 Processor -- start 2023-10-06T04:40:23.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.749+0000 7fe6ecb5c700 1 -- start start 2023-10-06T04:40:23.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.750+0000 7fe6ecb5c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80b11a0 0x7fe6e80d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:23.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.750+0000 7fe6ecb5c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e80afed0 con 0x7fe6e80b3810 2023-10-06T04:40:23.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.750+0000 7fe6ecb5c700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e80b6170 con 0x7fe6e806d3b0 2023-10-06T04:40:23.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.750+0000 7fe6ecb5c700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80b6450 con 0x7fe6e80b11a0 2023-10-06T04:40:23.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.750+0000 7fe6e7fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe6e80b3810 0x7fe6e80b3cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34884/0 (socket says 172.21.15.112:34884) 2023-10-06T04:40:23.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.750+0000 7fe6e7fff700 1 -- 172.21.15.112:0/2608220999 learned_addr learned my addr 172.21.15.112:0/2608220999 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:23.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.750+0000 7fe6e77fe700 1 --2- 172.21.15.112:0/2608220999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80b11a0 0x7fe6e80d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:23.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.750+0000 7fe6e67fc700 1 -- 172.21.15.112:0/2608220999 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359959575 0 0) 0x7fe6e80afed0 con 0x7fe6e80b3810 2023-10-06T04:40:23.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.750+0000 7fe6e67fc700 1 -- 172.21.15.112:0/2608220999 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d0003570 con 0x7fe6e80b3810 2023-10-06T04:40:23.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.751+0000 7fe6e67fc700 1 -- 172.21.15.112:0/2608220999 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088824670 0 0) 0x7fe6e80b6170 con 0x7fe6e806d3b0 2023-10-06T04:40:23.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.751+0000 7fe6e67fc700 1 -- 172.21.15.112:0/2608220999 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6e80afed0 con 0x7fe6e806d3b0 2023-10-06T04:40:23.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.751+0000 7fe6e77fe700 1 -- 172.21.15.112:0/2608220999 >> v1:172.21.15.179:6789/0 conn(0x7fe6e806d3b0 legacy=0x7fe6e80b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:23.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.751+0000 7fe6e77fe700 1 -- 172.21.15.112:0/2608220999 >> v1:172.21.15.112:6789/0 conn(0x7fe6e80b3810 legacy=0x7fe6e80b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:23.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.751+0000 7fe6e67fc700 1 -- 172.21.15.112:0/2608220999 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2888735494 0 0) 0x7fe6d0003570 con 0x7fe6e80b3810 2023-10-06T04:40:23.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.751+0000 7fe6e77fe700 1 -- 172.21.15.112:0/2608220999 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e80b6730 con 0x7fe6e80b11a0 2023-10-06T04:40:23.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.751+0000 7fe6e77fe700 1 --2- 172.21.15.112:0/2608220999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80b11a0 0x7fe6e80d0250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009e90 tx=0x7fe6d8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=843a2e56fe8a3d53 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:23.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.751+0000 7fe6e67fc700 1 -- 172.21.15.112:0/2608220999 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d800e070 con 0x7fe6e80b11a0 2023-10-06T04:40:23.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.751+0000 7fe6e67fc700 1 -- 172.21.15.112:0/2608220999 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d800b870 con 0x7fe6e80b11a0 2023-10-06T04:40:23.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.751+0000 7fe6e67fc700 1 -- 172.21.15.112:0/2608220999 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0001470 con 0x7fe6e80b11a0 2023-10-06T04:40:23.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.752+0000 7fe6ecb5c700 1 -- 172.21.15.112:0/2608220999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80b11a0 msgr2=0x7fe6e80d0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:23.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.752+0000 7fe6ecb5c700 1 --2- 172.21.15.112:0/2608220999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80b11a0 0x7fe6e80d0250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009e90 tx=0x7fe6d8009780 comp rx=0 tx=0).stop 2023-10-06T04:40:23.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.752+0000 7fe6ecb5c700 1 -- 172.21.15.112:0/2608220999 shutdown_connections 2023-10-06T04:40:23.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.752+0000 7fe6ecb5c700 1 --2- 172.21.15.112:0/2608220999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80b11a0 0x7fe6e80d0250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.752+0000 7fe6ecb5c700 1 -- 172.21.15.112:0/2608220999 >> 172.21.15.112:0/2608220999 conn(0x7fe6e806cfb0 msgr2=0x7fe6e80d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:23.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.752+0000 7fe6ecb5c700 1 -- 172.21.15.112:0/2608220999 shutdown_connections 2023-10-06T04:40:23.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.752+0000 7fe6ecb5c700 1 -- 172.21.15.112:0/2608220999 wait complete. 2023-10-06T04:40:23.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.753+0000 7fe6ecb5c700 1 Processor -- start 2023-10-06T04:40:23.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.753+0000 7fe6ecb5c700 1 -- start start 2023-10-06T04:40:23.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6ecb5c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6e806d3b0 0x7fe6e815cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:23.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6ecb5c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80b11a0 0x7fe6e816af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:23.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6ecb5c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6e80b3810 0x7fe6e80c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:23.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6ecb5c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80c63d0 con 0x7fe6e80b3810 2023-10-06T04:40:23.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6ecb5c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80c57c0 con 0x7fe6e806d3b0 2023-10-06T04:40:23.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6ecb5c700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80c5aa0 con 0x7fe6e80b11a0 2023-10-06T04:40:23.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6e7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6e80b3810 0x7fe6e80c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:23.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6e7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6e80b3810 0x7fe6e80c7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51960/0 (socket says 172.21.15.112:51960) 2023-10-06T04:40:23.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6e7fff700 1 -- 172.21.15.112:0/34379457 learned_addr learned my addr 172.21.15.112:0/34379457 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:23.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6e77fe700 1 --2- 172.21.15.112:0/34379457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6e806d3b0 0x7fe6e815cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:23.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6e6ffd700 1 --2- 172.21.15.112:0/34379457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80b11a0 0x7fe6e816af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:23.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6e7fff700 1 -- 172.21.15.112:0/34379457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80b11a0 msgr2=0x7fe6e816af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:23.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6e7fff700 1 --2- 172.21.15.112:0/34379457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80b11a0 0x7fe6e816af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6e7fff700 1 -- 172.21.15.112:0/34379457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6e806d3b0 msgr2=0x7fe6e815cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:23.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6e7fff700 1 --2- 172.21.15.112:0/34379457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6e806d3b0 0x7fe6e815cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6e7fff700 1 -- 172.21.15.112:0/34379457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d8009a20 con 0x7fe6e80b3810 2023-10-06T04:40:23.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6e7fff700 1 --2- 172.21.15.112:0/34379457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6e80b3810 0x7fe6e80c7e50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe6e000cb90 tx=0x7fe6e0001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:23.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6cf7fe700 1 -- 172.21.15.112:0/34379457 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0007150 con 0x7fe6e80b3810 2023-10-06T04:40:23.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6cf7fe700 1 -- 172.21.15.112:0/34379457 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e00072d0 con 0x7fe6e80b3810 2023-10-06T04:40:23.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6ecb5c700 1 -- 172.21.15.112:0/34379457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e80c5d80 con 0x7fe6e80b3810 2023-10-06T04:40:23.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6cf7fe700 1 -- 172.21.15.112:0/34379457 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0007690 con 0x7fe6e80b3810 2023-10-06T04:40:23.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.754+0000 7fe6ecb5c700 1 -- 172.21.15.112:0/34379457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e815d4a0 con 0x7fe6e80b3810 2023-10-06T04:40:23.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.755+0000 7fe6ecb5c700 1 -- 172.21.15.112:0/34379457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e80c6580 con 0x7fe6e80b3810 2023-10-06T04:40:23.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.756+0000 7fe6cf7fe700 1 -- 172.21.15.112:0/34379457 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fe6e0004a40 con 0x7fe6e80b3810 2023-10-06T04:40:23.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.756+0000 7fe6cf7fe700 1 --2- 172.21.15.112:0/34379457 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe6d40670e0 0x7fe6d4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:23.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.756+0000 7fe6e77fe700 1 --2- 172.21.15.112:0/34379457 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe6d40670e0 0x7fe6d4069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:23.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.756+0000 7fe6cf7fe700 1 -- 172.21.15.112:0/34379457 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe6e00840a0 con 0x7fe6e80b3810 2023-10-06T04:40:23.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.756+0000 7fe6e77fe700 1 --2- 172.21.15.112:0/34379457 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe6d40670e0 0x7fe6d4069590 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009de0 tx=0x7fe6d8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:23.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.760+0000 7fe6cf7fe700 1 -- 172.21.15.112:0/34379457 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6e0054a40 con 0x7fe6e80b3810 2023-10-06T04:40:23.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.943+0000 7fe6ecb5c700 1 -- 172.21.15.112:0/34379457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6e805f230 con 0x7fe6e80b3810 2023-10-06T04:40:23.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.943+0000 7fe6cf7fe700 1 -- 172.21.15.112:0/34379457 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16914 (secure 0 0 0) 0x7fe6e00545d0 con 0x7fe6e80b3810 2023-10-06T04:40:23.946 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:23.946 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":31,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:40:07.853039+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:40:04.313893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:40:05.190449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:23.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.945+0000 7fe6ecb5c700 1 -- 172.21.15.112:0/34379457 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe6d40670e0 msgr2=0x7fe6d4069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:23.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.946+0000 7fe6ecb5c700 1 --2- 172.21.15.112:0/34379457 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe6d40670e0 0x7fe6d4069590 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009de0 tx=0x7fe6d8017000 comp rx=0 tx=0).stop 2023-10-06T04:40:23.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.946+0000 7fe6ecb5c700 1 -- 172.21.15.112:0/34379457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6e80b3810 msgr2=0x7fe6e80c7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:23.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.946+0000 7fe6ecb5c700 1 --2- 172.21.15.112:0/34379457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6e80b3810 0x7fe6e80c7e50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe6e000cb90 tx=0x7fe6e0001a20 comp rx=0 tx=0).stop 2023-10-06T04:40:23.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.946+0000 7fe6ecb5c700 1 -- 172.21.15.112:0/34379457 shutdown_connections 2023-10-06T04:40:23.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.946+0000 7fe6ecb5c700 1 --2- 172.21.15.112:0/34379457 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fe6d40670e0 0x7fe6d4069590 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.946+0000 7fe6ecb5c700 1 --2- 172.21.15.112:0/34379457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6e80b3810 0x7fe6e80c7e50 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.946+0000 7fe6ecb5c700 1 --2- 172.21.15.112:0/34379457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6e806d3b0 0x7fe6e815cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.946+0000 7fe6ecb5c700 1 --2- 172.21.15.112:0/34379457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80b11a0 0x7fe6e816af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:23.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.946+0000 7fe6ecb5c700 1 -- 172.21.15.112:0/34379457 >> 172.21.15.112:0/34379457 conn(0x7fe6e806cfb0 msgr2=0x7fe6e80b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:23.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.946+0000 7fe6ecb5c700 1 -- 172.21.15.112:0/34379457 shutdown_connections 2023-10-06T04:40:23.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:23.946+0000 7fe6ecb5c700 1 -- 172.21.15.112:0/34379457 wait complete. 2023-10-06T04:40:23.960 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T04:40:24.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.073+0000 7f886359e700 1 Processor -- start 2023-10-06T04:40:24.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.073+0000 7f886359e700 1 -- start start 2023-10-06T04:40:24.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.074+0000 7f886359e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f886406e0b0 0x7f88640b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:24.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.074+0000 7f886359e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f88640cd100 0x7f8864159e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:24.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.074+0000 7f886359e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886415a360 con 0x7f8864143270 2023-10-06T04:40:24.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.074+0000 7f886359e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8864143640 con 0x7f88640cd100 2023-10-06T04:40:24.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.074+0000 7f886359e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88640cd650 con 0x7f886406e0b0 2023-10-06T04:40:24.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.074+0000 7f8862d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f88640cd100 0x7f8864159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:24.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.074+0000 7f886259c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8864143270 0x7f886406d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34898/0 (socket says 172.21.15.112:34898) 2023-10-06T04:40:24.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.074+0000 7f886259c700 1 -- 172.21.15.112:0/2536444336 learned_addr learned my addr 172.21.15.112:0/2536444336 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:24.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.074+0000 7f8862d9d700 1 -- 172.21.15.112:0/2536444336 >> v2:172.21.15.179:3300/0 conn(0x7f886406e0b0 msgr2=0x7f88640b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:24.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.074+0000 7f8862d9d700 1 --2- 172.21.15.112:0/2536444336 >> v2:172.21.15.179:3300/0 conn(0x7f886406e0b0 0x7f88640b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:24.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.074+0000 7f8862d9d700 1 -- 172.21.15.112:0/2536444336 >> v1:172.21.15.112:6789/0 conn(0x7f8864143270 legacy=0x7f886406d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:24.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.074+0000 7f8862d9d700 1 -- 172.21.15.112:0/2536444336 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88640b4350 con 0x7f88640cd100 2023-10-06T04:40:24.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.074+0000 7f886159a700 1 -- 172.21.15.112:0/2536444336 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315986656 0 0) 0x7f886415a360 con 0x7f8864143270 2023-10-06T04:40:24.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.074+0000 7f8862d9d700 1 --2- 172.21.15.112:0/2536444336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88640cd100 0x7f8864159e20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f88640b5e30 tx=0x7f8854009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302049adef0a0af6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:24.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.075+0000 7f886159a700 1 -- 172.21.15.112:0/2536444336 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885400e070 con 0x7f88640cd100 2023-10-06T04:40:24.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.075+0000 7f886159a700 1 -- 172.21.15.112:0/2536444336 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885400bc30 con 0x7f88640cd100 2023-10-06T04:40:24.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.075+0000 7f886159a700 1 -- 172.21.15.112:0/2536444336 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854012430 con 0x7f88640cd100 2023-10-06T04:40:24.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.075+0000 7f886359e700 1 -- 172.21.15.112:0/2536444336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88640cd100 msgr2=0x7f8864159e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:24.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.075+0000 7f886359e700 1 --2- 172.21.15.112:0/2536444336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88640cd100 0x7f8864159e20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f88640b5e30 tx=0x7f8854009780 comp rx=0 tx=0).stop 2023-10-06T04:40:24.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.075+0000 7f886359e700 1 -- 172.21.15.112:0/2536444336 shutdown_connections 2023-10-06T04:40:24.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.075+0000 7f886359e700 1 --2- 172.21.15.112:0/2536444336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88640cd100 0x7f8864159e20 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:24.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.075+0000 7f886359e700 1 --2- 172.21.15.112:0/2536444336 >> v2:172.21.15.179:3300/0 conn(0x7f886406e0b0 0x7f88640b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:24.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.075+0000 7f886359e700 1 -- 172.21.15.112:0/2536444336 >> 172.21.15.112:0/2536444336 conn(0x7f886406d2a0 msgr2=0x7f88640b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:24.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.075+0000 7f886359e700 1 -- 172.21.15.112:0/2536444336 shutdown_connections 2023-10-06T04:40:24.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.075+0000 7f886359e700 1 -- 172.21.15.112:0/2536444336 wait complete. 2023-10-06T04:40:24.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.076+0000 7f886359e700 1 Processor -- start 2023-10-06T04:40:24.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.076+0000 7f886359e700 1 -- start start 2023-10-06T04:40:24.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.077+0000 7f886359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f886406e0b0 0x7f88640c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:24.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.077+0000 7f886359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88640cd100 0x7f8864158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:24.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.077+0000 7f886359e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8864143270 0x7f8864159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:24.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.077+0000 7f886359e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88641597a0 con 0x7f8864143270 2023-10-06T04:40:24.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.077+0000 7f886359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88640c6b30 con 0x7f88640cd100 2023-10-06T04:40:24.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.077+0000 7f886359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88640c6200 con 0x7f886406e0b0 2023-10-06T04:40:24.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.077+0000 7f8862d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8864143270 0x7f8864159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:24.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.077+0000 7f8862d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8864143270 0x7f8864159260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51984/0 (socket says 172.21.15.112:51984) 2023-10-06T04:40:24.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.077+0000 7f8862d9d700 1 -- 172.21.15.112:0/3625391651 learned_addr learned my addr 172.21.15.112:0/3625391651 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:24.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.077+0000 7f886259c700 1 --2- 172.21.15.112:0/3625391651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f886406e0b0 0x7f88640c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:24.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.077+0000 7f8861d9b700 1 --2- 172.21.15.112:0/3625391651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88640cd100 0x7f8864158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:24.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.077+0000 7f8862d9d700 1 -- 172.21.15.112:0/3625391651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f886406e0b0 msgr2=0x7f88640c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:24.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.077+0000 7f8862d9d700 1 --2- 172.21.15.112:0/3625391651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f886406e0b0 0x7f88640c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:24.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.077+0000 7f8862d9d700 1 -- 172.21.15.112:0/3625391651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88640cd100 msgr2=0x7f8864158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:24.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.077+0000 7f8862d9d700 1 --2- 172.21.15.112:0/3625391651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88640cd100 0x7f8864158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:24.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.077+0000 7f8862d9d700 1 -- 172.21.15.112:0/3625391651 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8854009a20 con 0x7f8864143270 2023-10-06T04:40:24.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.078+0000 7f8862d9d700 1 --2- 172.21.15.112:0/3625391651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8864143270 0x7f8864159260 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8854013000 tx=0x7f8854019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:24.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.078+0000 7f88527fc700 1 -- 172.21.15.112:0/3625391651 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885401d630 con 0x7f8864143270 2023-10-06T04:40:24.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.078+0000 7f88527fc700 1 -- 172.21.15.112:0/3625391651 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885401d790 con 0x7f8864143270 2023-10-06T04:40:24.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.078+0000 7f88527fc700 1 -- 172.21.15.112:0/3625391651 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885401db30 con 0x7f8864143270 2023-10-06T04:40:24.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.078+0000 7f886359e700 1 -- 172.21.15.112:0/3625391651 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88640c64e0 con 0x7f8864143270 2023-10-06T04:40:24.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.078+0000 7f886359e700 1 -- 172.21.15.112:0/3625391651 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88640c9180 con 0x7f8864143270 2023-10-06T04:40:24.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.079+0000 7f886359e700 1 -- 172.21.15.112:0/3625391651 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88640c93a0 con 0x7f8864143270 2023-10-06T04:40:24.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.079+0000 7f88527fc700 1 -- 172.21.15.112:0/3625391651 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f8854024070 con 0x7f8864143270 2023-10-06T04:40:24.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.079+0000 7f88527fc700 1 --2- 172.21.15.112:0/3625391651 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f88440670e0 0x7f8844069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:24.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.079+0000 7f88527fc700 1 -- 172.21.15.112:0/3625391651 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8854087220 con 0x7f8864143270 2023-10-06T04:40:24.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.079+0000 7f886259c700 1 --2- 172.21.15.112:0/3625391651 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f88440670e0 0x7f8844069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:24.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.080+0000 7f886259c700 1 --2- 172.21.15.112:0/3625391651 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f88440670e0 0x7f8844069590 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f885c0011e0 tx=0x7f885c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:24.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.083+0000 7f88527fc700 1 -- 172.21.15.112:0/3625391651 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88540540b0 con 0x7f8864143270 2023-10-06T04:40:24.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.310+0000 7f886359e700 1 -- 172.21.15.112:0/3625391651 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f886405f230 con 0x7f8864143270 2023-10-06T04:40:24.313 INFO:tasks.ceph.mon.a.smithi112.stderr:2023-10-06T04:40:24.311+0000 7f1d6056f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T04:40:24.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.317+0000 7f88527fc700 1 -- 172.21.15.112:0/3625391651 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f88540576d0 con 0x7f8864143270 2023-10-06T04:40:24.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.319+0000 7f886359e700 1 -- 172.21.15.112:0/3625391651 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f88440670e0 msgr2=0x7f8844069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:24.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.319+0000 7f886359e700 1 --2- 172.21.15.112:0/3625391651 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f88440670e0 0x7f8844069590 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f885c0011e0 tx=0x7f885c009040 comp rx=0 tx=0).stop 2023-10-06T04:40:24.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.319+0000 7f886359e700 1 -- 172.21.15.112:0/3625391651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8864143270 msgr2=0x7f8864159260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:24.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.319+0000 7f886359e700 1 --2- 172.21.15.112:0/3625391651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8864143270 0x7f8864159260 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8854013000 tx=0x7f8854019000 comp rx=0 tx=0).stop 2023-10-06T04:40:24.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.319+0000 7f886359e700 1 -- 172.21.15.112:0/3625391651 shutdown_connections 2023-10-06T04:40:24.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.319+0000 7f886359e700 1 --2- 172.21.15.112:0/3625391651 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f88440670e0 0x7f8844069590 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:24.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.319+0000 7f886359e700 1 --2- 172.21.15.112:0/3625391651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8864143270 0x7f8864159260 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:24.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.319+0000 7f886359e700 1 --2- 172.21.15.112:0/3625391651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f886406e0b0 0x7f88640c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:24.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.319+0000 7f886359e700 1 --2- 172.21.15.112:0/3625391651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88640cd100 0x7f8864158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:24.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.319+0000 7f886359e700 1 -- 172.21.15.112:0/3625391651 >> 172.21.15.112:0/3625391651 conn(0x7f886406d2a0 msgr2=0x7f8864141880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:24.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.319+0000 7f886359e700 1 -- 172.21.15.112:0/3625391651 shutdown_connections 2023-10-06T04:40:24.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.319+0000 7f886359e700 1 -- 172.21.15.112:0/3625391651 wait complete. 2023-10-06T04:40:24.323 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T04:40:24.334 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T04:40:24.354 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-06T04:40:24.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.448+0000 7fb591785700 1 Processor -- start 2023-10-06T04:40:24.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.448+0000 7fb591785700 1 -- start start 2023-10-06T04:40:24.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.449+0000 7fb591785700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb58c0cad90 0x7fb58c0cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:24.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.449+0000 7fb591785700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb58c0cf610 con 0x7fb58c0ad850 2023-10-06T04:40:24.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.449+0000 7fb591785700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb58c0cf8f0 con 0x7fb58c15ce60 2023-10-06T04:40:24.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.449+0000 7fb591785700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58c0cb770 con 0x7fb58c0cad90 2023-10-06T04:40:24.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.449+0000 7fb5827fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb58c0cad90 0x7fb58c0cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:24.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.449+0000 7fb58b7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb58c0ad850 0x7fb58c0adcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34904/0 (socket says 172.21.15.112:34904) 2023-10-06T04:40:24.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.449+0000 7fb5827fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb58c0cad90 0x7fb58c0cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51998/0 (socket says 172.21.15.112:51998) 2023-10-06T04:40:24.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.449+0000 7fb58b7fe700 1 -- 172.21.15.112:0/18640889 learned_addr learned my addr 172.21.15.112:0/18640889 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:24.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.449+0000 7fb5827fc700 1 -- 172.21.15.112:0/18640889 >> v1:172.21.15.179:6789/0 conn(0x7fb58c15ce60 legacy=0x7fb58c0d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:24.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.449+0000 7fb5827fc700 1 -- 172.21.15.112:0/18640889 >> v1:172.21.15.112:6789/0 conn(0x7fb58c0ad850 legacy=0x7fb58c0adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:24.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.449+0000 7fb58a7fc700 1 -- 172.21.15.112:0/18640889 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1526931833 0 0) 0x7fb58c0cf610 con 0x7fb58c0ad850 2023-10-06T04:40:24.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.449+0000 7fb5827fc700 1 -- 172.21.15.112:0/18640889 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c0cfbd0 con 0x7fb58c0cad90 2023-10-06T04:40:24.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.449+0000 7fb5827fc700 1 --2- 172.21.15.112:0/18640889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c0cad90 0x7fb58c0cb230 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb5740098e0 tx=0x7fb5740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361c2b680e5f160 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:24.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.449+0000 7fb58a7fc700 1 -- 172.21.15.112:0/18640889 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb574009e80 con 0x7fb58c0cad90 2023-10-06T04:40:24.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.449+0000 7fb58a7fc700 1 -- 172.21.15.112:0/18640889 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57400b820 con 0x7fb58c0cad90 2023-10-06T04:40:24.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.449+0000 7fb58a7fc700 1 -- 172.21.15.112:0/18640889 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57400bba0 con 0x7fb58c0cad90 2023-10-06T04:40:24.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.450+0000 7fb591785700 1 -- 172.21.15.112:0/18640889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c0cad90 msgr2=0x7fb58c0cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:24.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.450+0000 7fb591785700 1 --2- 172.21.15.112:0/18640889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c0cad90 0x7fb58c0cb230 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb5740098e0 tx=0x7fb5740091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:24.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.450+0000 7fb591785700 1 -- 172.21.15.112:0/18640889 shutdown_connections 2023-10-06T04:40:24.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.450+0000 7fb591785700 1 --2- 172.21.15.112:0/18640889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c0cad90 0x7fb58c0cb230 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:24.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.450+0000 7fb591785700 1 -- 172.21.15.112:0/18640889 >> 172.21.15.112:0/18640889 conn(0x7fb58c06cfb0 msgr2=0x7fb58c0d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:24.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.450+0000 7fb591785700 1 -- 172.21.15.112:0/18640889 shutdown_connections 2023-10-06T04:40:24.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.450+0000 7fb591785700 1 -- 172.21.15.112:0/18640889 wait complete. 2023-10-06T04:40:24.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.451+0000 7fb591785700 1 Processor -- start 2023-10-06T04:40:24.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.451+0000 7fb591785700 1 -- start start 2023-10-06T04:40:24.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.452+0000 7fb591785700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb58c0ad850 0x7fb58c14fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:24.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.452+0000 7fb591785700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c0cad90 0x7fb58c0c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:24.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.452+0000 7fb591785700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb58c15ce60 0x7fb58c0c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:24.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.452+0000 7fb591785700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c0c8350 con 0x7fb58c0cad90 2023-10-06T04:40:24.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.452+0000 7fb591785700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c0c8630 con 0x7fb58c0ad850 2023-10-06T04:40:24.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.452+0000 7fb591785700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c0c8910 con 0x7fb58c15ce60 2023-10-06T04:40:24.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.452+0000 7fb5827fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c0cad90 0x7fb58c0c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:24.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.452+0000 7fb5827fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c0cad90 0x7fb58c0c7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52012/0 (socket says 172.21.15.112:52012) 2023-10-06T04:40:24.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.452+0000 7fb5827fc700 1 -- 172.21.15.112:0/2540991840 learned_addr learned my addr 172.21.15.112:0/2540991840 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:24.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.452+0000 7fb58b7fe700 1 --2- 172.21.15.112:0/2540991840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb58c15ce60 0x7fb58c0c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:24.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.452+0000 7fb58affd700 1 --2- 172.21.15.112:0/2540991840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb58c0ad850 0x7fb58c14fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:24.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.452+0000 7fb5827fc700 1 -- 172.21.15.112:0/2540991840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb58c15ce60 msgr2=0x7fb58c0c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:24.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.452+0000 7fb5827fc700 1 --2- 172.21.15.112:0/2540991840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb58c15ce60 0x7fb58c0c7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:24.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.452+0000 7fb5827fc700 1 -- 172.21.15.112:0/2540991840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb58c0ad850 msgr2=0x7fb58c14fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:24.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.452+0000 7fb5827fc700 1 --2- 172.21.15.112:0/2540991840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb58c0ad850 0x7fb58c14fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:24.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.452+0000 7fb5827fc700 1 -- 172.21.15.112:0/2540991840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb574009420 con 0x7fb58c0cad90 2023-10-06T04:40:24.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.452+0000 7fb58affd700 1 --2- 172.21.15.112:0/2540991840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb58c0ad850 0x7fb58c14fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:24.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.453+0000 7fb5827fc700 1 --2- 172.21.15.112:0/2540991840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c0cad90 0x7fb58c0c7800 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb5740030c0 tx=0x7fb574016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:24.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.453+0000 7fb5837fe700 1 -- 172.21.15.112:0/2540991840 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57400b990 con 0x7fb58c0cad90 2023-10-06T04:40:24.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.453+0000 7fb5837fe700 1 -- 172.21.15.112:0/2540991840 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb574020070 con 0x7fb58c0cad90 2023-10-06T04:40:24.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.453+0000 7fb591785700 1 -- 172.21.15.112:0/2540991840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58c0c8bf0 con 0x7fb58c0cad90 2023-10-06T04:40:24.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.453+0000 7fb5837fe700 1 -- 172.21.15.112:0/2540991840 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57401b6a0 con 0x7fb58c0cad90 2023-10-06T04:40:24.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.453+0000 7fb591785700 1 -- 172.21.15.112:0/2540991840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58c156610 con 0x7fb58c0cad90 2023-10-06T04:40:24.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.454+0000 7fb591785700 1 -- 172.21.15.112:0/2540991840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb58c0c9110 con 0x7fb58c0cad90 2023-10-06T04:40:24.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.454+0000 7fb5837fe700 1 -- 172.21.15.112:0/2540991840 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fb574022030 con 0x7fb58c0cad90 2023-10-06T04:40:24.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.454+0000 7fb5837fe700 1 --2- 172.21.15.112:0/2540991840 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb56c0670e0 0x7fb56c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:24.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.454+0000 7fb5837fe700 1 -- 172.21.15.112:0/2540991840 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fb5740868b0 con 0x7fb58c0cad90 2023-10-06T04:40:24.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.455+0000 7fb58affd700 1 --2- 172.21.15.112:0/2540991840 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb56c0670e0 0x7fb56c069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:24.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.455+0000 7fb58affd700 1 --2- 172.21.15.112:0/2540991840 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb56c0670e0 0x7fb56c069590 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb57c007fd0 tx=0x7fb57c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:24.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.459+0000 7fb5837fe700 1 -- 172.21.15.112:0/2540991840 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb58c0c9110 con 0x7fb58c0cad90 2023-10-06T04:40:24.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:24.684+0000 7fb591785700 1 -- 172.21.15.112:0/2540991840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb58c0c9110 con 0x7fb58c0cad90 2023-10-06T04:40:25.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.315+0000 7fb5837fe700 1 -- 172.21.15.112:0/2540991840 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb58c0c9110 con 0x7fb58c0cad90 2023-10-06T04:40:25.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.318+0000 7fb591785700 1 -- 172.21.15.112:0/2540991840 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb56c0670e0 msgr2=0x7fb56c069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:25.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.318+0000 7fb591785700 1 --2- 172.21.15.112:0/2540991840 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb56c0670e0 0x7fb56c069590 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb57c007fd0 tx=0x7fb57c009040 comp rx=0 tx=0).stop 2023-10-06T04:40:25.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.318+0000 7fb591785700 1 -- 172.21.15.112:0/2540991840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c0cad90 msgr2=0x7fb58c0c7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:25.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.318+0000 7fb591785700 1 --2- 172.21.15.112:0/2540991840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c0cad90 0x7fb58c0c7800 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb5740030c0 tx=0x7fb574016000 comp rx=0 tx=0).stop 2023-10-06T04:40:25.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.318+0000 7fb591785700 1 -- 172.21.15.112:0/2540991840 shutdown_connections 2023-10-06T04:40:25.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.318+0000 7fb591785700 1 --2- 172.21.15.112:0/2540991840 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb56c0670e0 0x7fb56c069590 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:25.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.318+0000 7fb591785700 1 --2- 172.21.15.112:0/2540991840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb58c15ce60 0x7fb58c0c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:25.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.318+0000 7fb591785700 1 --2- 172.21.15.112:0/2540991840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb58c0ad850 0x7fb58c14fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:25.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.318+0000 7fb591785700 1 --2- 172.21.15.112:0/2540991840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c0cad90 0x7fb58c0c7800 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:25.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.318+0000 7fb591785700 1 -- 172.21.15.112:0/2540991840 >> 172.21.15.112:0/2540991840 conn(0x7fb58c06cfb0 msgr2=0x7fb58c150ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:25.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.318+0000 7fb591785700 1 -- 172.21.15.112:0/2540991840 shutdown_connections 2023-10-06T04:40:25.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.318+0000 7fb591785700 1 -- 172.21.15.112:0/2540991840 wait complete. 2023-10-06T04:40:25.333 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T04:40:25.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.448+0000 7f284731f700 1 Processor -- start 2023-10-06T04:40:25.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.449+0000 7f284731f700 1 -- start start 2023-10-06T04:40:25.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.449+0000 7f284731f700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f284006e8f0 0x7f2840067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:25.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.449+0000 7f284731f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f28400cab70 0x7f28400684e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:25.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.449+0000 7f284731f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284015e060 con 0x7f28400cdb90 2023-10-06T04:40:25.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.449+0000 7f284731f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284015d450 con 0x7f28400cab70 2023-10-06T04:40:25.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.449+0000 7f284731f700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284015d730 con 0x7f284006e8f0 2023-10-06T04:40:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.450+0000 7f28450bb700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f28400cdb90 0x7f284006a030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34918/0 (socket says 172.21.15.112:34918) 2023-10-06T04:40:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.450+0000 7f28458bc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f28400cab70 0x7f28400684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.450+0000 7f28450bb700 1 -- 172.21.15.112:0/1068418629 learned_addr learned my addr 172.21.15.112:0/1068418629 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.450+0000 7f28448ba700 1 --2- 172.21.15.112:0/1068418629 >> v2:172.21.15.179:3300/0 conn(0x7f284006e8f0 0x7f2840067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.450+0000 7f2837fff700 1 -- 172.21.15.112:0/1068418629 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253501828 0 0) 0x7f284015e060 con 0x7f28400cdb90 2023-10-06T04:40:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.450+0000 7f2837fff700 1 -- 172.21.15.112:0/1068418629 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f282c003570 con 0x7f28400cdb90 2023-10-06T04:40:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.450+0000 7f28458bc700 1 -- 172.21.15.112:0/1068418629 >> v2:172.21.15.179:3300/0 conn(0x7f284006e8f0 msgr2=0x7f2840067fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.450+0000 7f28458bc700 1 --2- 172.21.15.112:0/1068418629 >> v2:172.21.15.179:3300/0 conn(0x7f284006e8f0 0x7f2840067fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.450+0000 7f28458bc700 1 -- 172.21.15.112:0/1068418629 >> v1:172.21.15.112:6789/0 conn(0x7f28400cdb90 legacy=0x7f284006a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.450+0000 7f28458bc700 1 -- 172.21.15.112:0/1068418629 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284015da10 con 0x7f28400cab70 2023-10-06T04:40:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.450+0000 7f28458bc700 1 --2- 172.21.15.112:0/1068418629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28400cab70 0x7f28400684e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f28400b01a0 tx=0x7f28380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35873abdac5dcff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.450+0000 7f2837fff700 1 -- 172.21.15.112:0/1068418629 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2838011630 con 0x7f28400cab70 2023-10-06T04:40:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.450+0000 7f2837fff700 1 -- 172.21.15.112:0/1068418629 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2838011790 con 0x7f28400cab70 2023-10-06T04:40:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.450+0000 7f2837fff700 1 -- 172.21.15.112:0/1068418629 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2838011b30 con 0x7f28400cab70 2023-10-06T04:40:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.451+0000 7f284731f700 1 -- 172.21.15.112:0/1068418629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28400cab70 msgr2=0x7f28400684e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.451+0000 7f284731f700 1 --2- 172.21.15.112:0/1068418629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28400cab70 0x7f28400684e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f28400b01a0 tx=0x7f28380091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.451+0000 7f284731f700 1 -- 172.21.15.112:0/1068418629 shutdown_connections 2023-10-06T04:40:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.451+0000 7f284731f700 1 --2- 172.21.15.112:0/1068418629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28400cab70 0x7f28400684e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.451+0000 7f284731f700 1 --2- 172.21.15.112:0/1068418629 >> v2:172.21.15.179:3300/0 conn(0x7f284006e8f0 0x7f2840067fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.451+0000 7f284731f700 1 -- 172.21.15.112:0/1068418629 >> 172.21.15.112:0/1068418629 conn(0x7f28400631f0 msgr2=0x7f28400635f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.451+0000 7f284731f700 1 -- 172.21.15.112:0/1068418629 shutdown_connections 2023-10-06T04:40:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.451+0000 7f284731f700 1 -- 172.21.15.112:0/1068418629 wait complete. 2023-10-06T04:40:25.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.452+0000 7f284731f700 1 Processor -- start 2023-10-06T04:40:25.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.452+0000 7f284731f700 1 -- start start 2023-10-06T04:40:25.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.453+0000 7f284731f700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f284006e8f0 0x7f28400c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:25.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.453+0000 7f284731f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28400cab70 0x7f2840169ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:25.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.453+0000 7f284731f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28400cdb90 0x7f28400aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:25.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.453+0000 7f284731f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284015a7e0 con 0x7f28400cdb90 2023-10-06T04:40:25.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.453+0000 7f284731f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2840156fe0 con 0x7f28400cab70 2023-10-06T04:40:25.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.453+0000 7f284731f700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28400af2a0 con 0x7f284006e8f0 2023-10-06T04:40:25.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.453+0000 7f28458bc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28400cdb90 0x7f28400aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:25.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.453+0000 7f28458bc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28400cdb90 0x7f28400aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52032/0 (socket says 172.21.15.112:52032) 2023-10-06T04:40:25.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.453+0000 7f28458bc700 1 -- 172.21.15.112:0/3921833776 learned_addr learned my addr 172.21.15.112:0/3921833776 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:25.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.453+0000 7f28448ba700 1 --2- 172.21.15.112:0/3921833776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28400cab70 0x7f2840169ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:25.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.453+0000 7f28450bb700 1 --2- 172.21.15.112:0/3921833776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f284006e8f0 0x7f28400c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:25.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.453+0000 7f28458bc700 1 -- 172.21.15.112:0/3921833776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f284006e8f0 msgr2=0x7f28400c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:25.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.453+0000 7f28458bc700 1 --2- 172.21.15.112:0/3921833776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f284006e8f0 0x7f28400c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:25.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.453+0000 7f28458bc700 1 -- 172.21.15.112:0/3921833776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28400cab70 msgr2=0x7f2840169ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:25.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.453+0000 7f28458bc700 1 --2- 172.21.15.112:0/3921833776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28400cab70 0x7f2840169ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:25.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.453+0000 7f28458bc700 1 -- 172.21.15.112:0/3921833776 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2838009420 con 0x7f28400cdb90 2023-10-06T04:40:25.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.453+0000 7f28458bc700 1 --2- 172.21.15.112:0/3921833776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28400cdb90 0x7f28400aed60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2838009f50 tx=0x7f2838017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:25.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.453+0000 7f28357fa700 1 -- 172.21.15.112:0/3921833776 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2838011ad0 con 0x7f28400cdb90 2023-10-06T04:40:25.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.454+0000 7f28357fa700 1 -- 172.21.15.112:0/3921833776 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28380195c0 con 0x7f28400cdb90 2023-10-06T04:40:25.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.454+0000 7f284731f700 1 -- 172.21.15.112:0/3921833776 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28400c9f70 con 0x7f28400cdb90 2023-10-06T04:40:25.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.454+0000 7f28357fa700 1 -- 172.21.15.112:0/3921833776 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2838019980 con 0x7f28400cdb90 2023-10-06T04:40:25.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.454+0000 7f284731f700 1 -- 172.21.15.112:0/3921833776 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28400ca530 con 0x7f28400cdb90 2023-10-06T04:40:25.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.454+0000 7f284731f700 1 -- 172.21.15.112:0/3921833776 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2840157150 con 0x7f28400cdb90 2023-10-06T04:40:25.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.455+0000 7f28357fa700 1 -- 172.21.15.112:0/3921833776 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f2838019d30 con 0x7f28400cdb90 2023-10-06T04:40:25.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.455+0000 7f28357fa700 1 --2- 172.21.15.112:0/3921833776 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f28240670e0 0x7f2824069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:25.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.455+0000 7f28357fa700 1 -- 172.21.15.112:0/3921833776 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f2838086550 con 0x7f28400cdb90 2023-10-06T04:40:25.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.455+0000 7f28450bb700 1 --2- 172.21.15.112:0/3921833776 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f28240670e0 0x7f2824069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:25.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.456+0000 7f28450bb700 1 --2- 172.21.15.112:0/3921833776 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f28240670e0 0x7f2824069590 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f283c0016e0 tx=0x7f283c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:25.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.460+0000 7f28357fa700 1 -- 172.21.15.112:0/3921833776 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2840157150 con 0x7f28400cdb90 2023-10-06T04:40:25.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:25.645+0000 7f284731f700 1 -- 172.21.15.112:0/3921833776 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2840157150 con 0x7f28400cdb90 2023-10-06T04:40:26.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.578+0000 7f28357fa700 1 -- 172.21.15.112:0/3921833776 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2840157150 con 0x7f28400cdb90 2023-10-06T04:40:26.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.583+0000 7f284731f700 1 -- 172.21.15.112:0/3921833776 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f28240670e0 msgr2=0x7f2824069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:26.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.583+0000 7f284731f700 1 --2- 172.21.15.112:0/3921833776 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f28240670e0 0x7f2824069590 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f283c0016e0 tx=0x7f283c009040 comp rx=0 tx=0).stop 2023-10-06T04:40:26.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.583+0000 7f284731f700 1 -- 172.21.15.112:0/3921833776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28400cdb90 msgr2=0x7f28400aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:26.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.583+0000 7f284731f700 1 --2- 172.21.15.112:0/3921833776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28400cdb90 0x7f28400aed60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2838009f50 tx=0x7f2838017000 comp rx=0 tx=0).stop 2023-10-06T04:40:26.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.583+0000 7f284731f700 1 -- 172.21.15.112:0/3921833776 shutdown_connections 2023-10-06T04:40:26.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.583+0000 7f284731f700 1 --2- 172.21.15.112:0/3921833776 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f28240670e0 0x7f2824069590 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:26.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.583+0000 7f284731f700 1 --2- 172.21.15.112:0/3921833776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28400cdb90 0x7f28400aed60 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:26.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.583+0000 7f284731f700 1 --2- 172.21.15.112:0/3921833776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f284006e8f0 0x7f28400c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:26.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.583+0000 7f284731f700 1 --2- 172.21.15.112:0/3921833776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28400cab70 0x7f2840169ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:26.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.583+0000 7f284731f700 1 -- 172.21.15.112:0/3921833776 >> 172.21.15.112:0/3921833776 conn(0x7f28400631f0 msgr2=0x7f28400b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:26.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.583+0000 7f284731f700 1 -- 172.21.15.112:0/3921833776 shutdown_connections 2023-10-06T04:40:26.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.583+0000 7f284731f700 1 -- 172.21.15.112:0/3921833776 wait complete. 2023-10-06T04:40:26.587 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2023-10-06T04:40:26.597 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T04:40:26.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.712+0000 7fdeb01f5700 1 Processor -- start 2023-10-06T04:40:26.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.713+0000 7fdeb01f5700 1 -- start start 2023-10-06T04:40:26.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.713+0000 7fdeb01f5700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdea806d3b0 0x7fdea815be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:26.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.713+0000 7fdeb01f5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea815af50 con 0x7fdea80cbf00 2023-10-06T04:40:26.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.713+0000 7fdeb01f5700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea80cae50 con 0x7fdea8159a20 2023-10-06T04:40:26.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.713+0000 7fdeb01f5700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea80cca70 con 0x7fdea806d3b0 2023-10-06T04:40:26.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.714+0000 7fdead790700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fdea80cbf00 0x7fdea815b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34926/0 (socket says 172.21.15.112:34926) 2023-10-06T04:40:26.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.714+0000 7fdead790700 1 -- 172.21.15.112:0/3089085309 learned_addr learned my addr 172.21.15.112:0/3089085309 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:26.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.714+0000 7fdeacf8f700 1 -- 172.21.15.112:0/3089085309 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487671951 0 0) 0x7fdea815af50 con 0x7fdea80cbf00 2023-10-06T04:40:26.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.714+0000 7fdeae792700 1 --2- 172.21.15.112:0/3089085309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdea806d3b0 0x7fdea815be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:26.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.714+0000 7fdeacf8f700 1 -- 172.21.15.112:0/3089085309 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde94003570 con 0x7fdea80cbf00 2023-10-06T04:40:26.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.714+0000 7fdeacf8f700 1 -- 172.21.15.112:0/3089085309 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2399098752 0 0) 0x7fde94003570 con 0x7fdea80cbf00 2023-10-06T04:40:26.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.714+0000 7fdeacf8f700 1 -- 172.21.15.112:0/3089085309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdea806d3b0 msgr2=0x7fdea815be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:26.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.714+0000 7fdeacf8f700 1 --2- 172.21.15.112:0/3089085309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdea806d3b0 0x7fdea815be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:26.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.714+0000 7fdeacf8f700 1 -- 172.21.15.112:0/3089085309 >> v1:172.21.15.179:6789/0 conn(0x7fdea8159a20 legacy=0x7fdea80cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:26.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.714+0000 7fdeacf8f700 1 -- 172.21.15.112:0/3089085309 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea80cb0f0 con 0x7fdea80cbf00 2023-10-06T04:40:26.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.714+0000 7fdeacf8f700 1 -- 172.21.15.112:0/3089085309 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7fde98001470 con 0x7fdea80cbf00 2023-10-06T04:40:26.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.714+0000 7fdeacf8f700 1 -- 172.21.15.112:0/3089085309 >> v1:172.21.15.112:6789/0 conn(0x7fdea80cbf00 legacy=0x7fdea815b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:26.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.714+0000 7fdeacf8f700 1 --2- 172.21.15.112:0/3089085309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdea806d3b0 0x7fde94003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:26.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.714+0000 7fdeacf8f700 1 --2- 172.21.15.112:0/3089085309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde94004010 0x7fde94004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:26.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.714+0000 7fdeacf8f700 1 --2- 172.21.15.112:0/3089085309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde94004d50 0x7fde940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:26.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.714+0000 7fdeacf8f700 1 -- 172.21.15.112:0/3089085309 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea80cca70 con 0x7fde94004d50 2023-10-06T04:40:26.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.714+0000 7fdeacf8f700 1 -- 172.21.15.112:0/3089085309 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9400bbf0 con 0x7fde94004010 2023-10-06T04:40:26.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.714+0000 7fdeacf8f700 1 -- 172.21.15.112:0/3089085309 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9400bdb0 con 0x7fdea806d3b0 2023-10-06T04:40:26.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.714+0000 7fdeae792700 1 --2- 172.21.15.112:0/3089085309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde94004d50 0x7fde940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:26.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.714+0000 7fdead790700 1 --2- 172.21.15.112:0/3089085309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde94004010 0x7fde94004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:26.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.714+0000 7fdeadf91700 1 --2- 172.21.15.112:0/3089085309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdea806d3b0 0x7fde94003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:26.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.715+0000 7fdeae792700 1 -- 172.21.15.112:0/3089085309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdea806d3b0 msgr2=0x7fde94003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:26.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.715+0000 7fdeae792700 1 --2- 172.21.15.112:0/3089085309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdea806d3b0 0x7fde94003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:26.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.715+0000 7fdeae792700 1 -- 172.21.15.112:0/3089085309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde94004010 msgr2=0x7fde94004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:26.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.715+0000 7fdeae792700 1 --2- 172.21.15.112:0/3089085309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde94004010 0x7fde94004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:26.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.715+0000 7fdeae792700 1 -- 172.21.15.112:0/3089085309 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde94003570 con 0x7fde94004d50 2023-10-06T04:40:26.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.715+0000 7fdeae792700 1 --2- 172.21.15.112:0/3089085309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde94004d50 0x7fde940051c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdea0006f00 tx=0x7fdea00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eec07e1b844554b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:26.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.715+0000 7fdeacf8f700 1 -- 172.21.15.112:0/3089085309 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea000e6e0 con 0x7fde94004d50 2023-10-06T04:40:26.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.715+0000 7fdeacf8f700 1 -- 172.21.15.112:0/3089085309 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea000e840 con 0x7fde94004d50 2023-10-06T04:40:26.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.715+0000 7fdeacf8f700 1 -- 172.21.15.112:0/3089085309 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea000ebe0 con 0x7fde94004d50 2023-10-06T04:40:26.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.715+0000 7fdeb01f5700 1 -- 172.21.15.112:0/3089085309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde94004d50 msgr2=0x7fde940051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:26.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.715+0000 7fdeb01f5700 1 --2- 172.21.15.112:0/3089085309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde94004d50 0x7fde940051c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdea0006f00 tx=0x7fdea00091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:26.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.715+0000 7fdeae792700 1 -- 172.21.15.112:0/3089085309 reap_dead start 2023-10-06T04:40:26.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.715+0000 7fdeb01f5700 1 -- 172.21.15.112:0/3089085309 shutdown_connections 2023-10-06T04:40:26.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.715+0000 7fdeb01f5700 1 -- 172.21.15.112:0/3089085309 >> 172.21.15.112:0/3089085309 conn(0x7fdea806cfb0 msgr2=0x7fdea80d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:26.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.715+0000 7fdeb01f5700 1 -- 172.21.15.112:0/3089085309 shutdown_connections 2023-10-06T04:40:26.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.716+0000 7fdeb01f5700 1 -- 172.21.15.112:0/3089085309 wait complete. 2023-10-06T04:40:26.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.717+0000 7fdeb01f5700 1 Processor -- start 2023-10-06T04:40:26.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.717+0000 7fdeb01f5700 1 -- start start 2023-10-06T04:40:26.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.717+0000 7fdeb01f5700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdea80b6260 0x7fdea80b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:26.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.717+0000 7fdeb01f5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdea8156ed0 0x7fdea8152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:26.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.717+0000 7fdeb01f5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea8153090 0x7fdea8155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:26.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.717+0000 7fdeb01f5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea8153530 con 0x7fdea8153090 2023-10-06T04:40:26.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.717+0000 7fdeb01f5700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea80b2990 con 0x7fdea8156ed0 2023-10-06T04:40:26.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.717+0000 7fdeb01f5700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea8157490 con 0x7fdea80b6260 2023-10-06T04:40:26.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.717+0000 7fdeae792700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea8153090 0x7fdea8155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:26.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.717+0000 7fdeae792700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea8153090 0x7fdea8155cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52048/0 (socket says 172.21.15.112:52048) 2023-10-06T04:40:26.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.717+0000 7fdeae792700 1 -- 172.21.15.112:0/743045470 learned_addr learned my addr 172.21.15.112:0/743045470 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:26.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.718+0000 7fdeae792700 1 -- 172.21.15.112:0/743045470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdea80b6260 msgr2=0x7fdea80b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:26.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.718+0000 7fdeae792700 1 --2- 172.21.15.112:0/743045470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdea80b6260 0x7fdea80b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:26.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.718+0000 7fdeae792700 1 -- 172.21.15.112:0/743045470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdea8156ed0 msgr2=0x7fdea8152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:26.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.718+0000 7fdeae792700 1 --2- 172.21.15.112:0/743045470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdea8156ed0 0x7fdea8152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:26.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.718+0000 7fdeae792700 1 -- 172.21.15.112:0/743045470 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea8157770 con 0x7fdea8153090 2023-10-06T04:40:26.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.718+0000 7fdeae792700 1 --2- 172.21.15.112:0/743045470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea8153090 0x7fdea8155cb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fde940057d0 tx=0x7fdea001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:26.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.718+0000 7fde9dffb700 1 -- 172.21.15.112:0/743045470 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea0022070 con 0x7fdea8153090 2023-10-06T04:40:26.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.718+0000 7fde9dffb700 1 -- 172.21.15.112:0/743045470 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea000ebc0 con 0x7fdea8153090 2023-10-06T04:40:26.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.718+0000 7fdeb01f5700 1 -- 172.21.15.112:0/743045470 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea8157a50 con 0x7fdea8153090 2023-10-06T04:40:26.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.718+0000 7fde9dffb700 1 -- 172.21.15.112:0/743045470 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea000e6e0 con 0x7fdea8153090 2023-10-06T04:40:26.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.718+0000 7fdeb01f5700 1 -- 172.21.15.112:0/743045470 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea8158010 con 0x7fdea8153090 2023-10-06T04:40:26.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.719+0000 7fdeb01f5700 1 -- 172.21.15.112:0/743045470 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea805f230 con 0x7fdea8153090 2023-10-06T04:40:26.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.719+0000 7fde9dffb700 1 -- 172.21.15.112:0/743045470 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fdea001c8f0 con 0x7fdea8153090 2023-10-06T04:40:26.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.720+0000 7fde9dffb700 1 --2- 172.21.15.112:0/743045470 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fde8c0670e0 0x7fde8c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:26.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.720+0000 7fde9dffb700 1 -- 172.21.15.112:0/743045470 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fdea0000e40 con 0x7fdea8153090 2023-10-06T04:40:26.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.720+0000 7fdeadf91700 1 --2- 172.21.15.112:0/743045470 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fde8c0670e0 0x7fde8c069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:26.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.720+0000 7fdeadf91700 1 --2- 172.21.15.112:0/743045470 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fde8c0670e0 0x7fde8c069590 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdea4004290 tx=0x7fdea4001640 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:26.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.724+0000 7fde9dffb700 1 -- 172.21.15.112:0/743045470 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdea0052f70 con 0x7fdea8153090 2023-10-06T04:40:26.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:26.909+0000 7fdeb01f5700 1 -- 172.21.15.112:0/743045470 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdea809e400 con 0x7fdea8153090 2023-10-06T04:40:27.029 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:40:27.031 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:40:27.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.579+0000 7fde9dffb700 1 -- 172.21.15.112:0/743045470 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdea0056590 con 0x7fdea8153090 2023-10-06T04:40:27.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.582+0000 7fdeb01f5700 1 -- 172.21.15.112:0/743045470 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fde8c0670e0 msgr2=0x7fde8c069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:27.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.582+0000 7fdeb01f5700 1 --2- 172.21.15.112:0/743045470 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fde8c0670e0 0x7fde8c069590 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdea4004290 tx=0x7fdea4001640 comp rx=0 tx=0).stop 2023-10-06T04:40:27.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.582+0000 7fdeb01f5700 1 -- 172.21.15.112:0/743045470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea8153090 msgr2=0x7fdea8155cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:27.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.582+0000 7fdeb01f5700 1 --2- 172.21.15.112:0/743045470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea8153090 0x7fdea8155cb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fde940057d0 tx=0x7fdea001a000 comp rx=0 tx=0).stop 2023-10-06T04:40:27.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.582+0000 7fdeb01f5700 1 -- 172.21.15.112:0/743045470 shutdown_connections 2023-10-06T04:40:27.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.582+0000 7fdeb01f5700 1 --2- 172.21.15.112:0/743045470 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fde8c0670e0 0x7fde8c069590 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:27.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.582+0000 7fdeb01f5700 1 --2- 172.21.15.112:0/743045470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea8153090 0x7fdea8155cb0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:27.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.582+0000 7fdeb01f5700 1 --2- 172.21.15.112:0/743045470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdea80b6260 0x7fdea80b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:27.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.582+0000 7fdeb01f5700 1 --2- 172.21.15.112:0/743045470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdea8156ed0 0x7fdea8152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:27.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.582+0000 7fdeb01f5700 1 -- 172.21.15.112:0/743045470 >> 172.21.15.112:0/743045470 conn(0x7fdea806cfb0 msgr2=0x7fdea80cd990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:27.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.583+0000 7fdeb01f5700 1 -- 172.21.15.112:0/743045470 shutdown_connections 2023-10-06T04:40:27.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.583+0000 7fdeb01f5700 1 -- 172.21.15.112:0/743045470 wait complete. 2023-10-06T04:40:27.587 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2023-10-06T04:40:27.599 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T04:40:27.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.712+0000 7f6a1ae1c700 1 Processor -- start 2023-10-06T04:40:27.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.712+0000 7f6a1ae1c700 1 -- start start 2023-10-06T04:40:27.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.713+0000 7f6a1ae1c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6a1415ce60 0x7f6a140d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:27.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.713+0000 7f6a1ae1c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a140cf610 con 0x7f6a140d13a0 2023-10-06T04:40:27.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.713+0000 7f6a1ae1c700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a140cf8f0 con 0x7f6a140cb4a0 2023-10-06T04:40:27.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.713+0000 7f6a1ae1c700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a140cfbd0 con 0x7f6a1415ce60 2023-10-06T04:40:27.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.713+0000 7f6a18bb8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6a1415ce60 0x7f6a140d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:27.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.713+0000 7f6a0bfff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6a140d13a0 0x7f6a140cad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34942/0 (socket says 172.21.15.112:34942) 2023-10-06T04:40:27.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.713+0000 7f6a0bfff700 1 -- 172.21.15.112:0/1718260348 learned_addr learned my addr 172.21.15.112:0/1718260348 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:27.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.714+0000 7f6a18bb8700 1 -- 172.21.15.112:0/1718260348 >> v1:172.21.15.179:6789/0 conn(0x7f6a140cb4a0 legacy=0x7f6a140ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:27.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.714+0000 7f6a18bb8700 1 -- 172.21.15.112:0/1718260348 >> v1:172.21.15.112:6789/0 conn(0x7f6a140d13a0 legacy=0x7f6a140cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:27.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.714+0000 7f6a18bb8700 1 -- 172.21.15.112:0/1718260348 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a140cfeb0 con 0x7f6a1415ce60 2023-10-06T04:40:27.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.714+0000 7f6a0b7fe700 1 -- 172.21.15.112:0/1718260348 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207853536 0 0) 0x7f6a140cf610 con 0x7f6a140d13a0 2023-10-06T04:40:27.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.714+0000 7f6a18bb8700 1 --2- 172.21.15.112:0/1718260348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a1415ce60 0x7f6a140d0e60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6a10009e60 tx=0x7f6a10009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30bfb62d31a4654f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:27.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.714+0000 7f6a0b7fe700 1 -- 172.21.15.112:0/1718260348 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1000e070 con 0x7f6a1415ce60 2023-10-06T04:40:27.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.714+0000 7f6a0b7fe700 1 -- 172.21.15.112:0/1718260348 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1000bbf0 con 0x7f6a1415ce60 2023-10-06T04:40:27.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.714+0000 7f6a0b7fe700 1 -- 172.21.15.112:0/1718260348 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a10012430 con 0x7f6a1415ce60 2023-10-06T04:40:27.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.714+0000 7f6a1ae1c700 1 -- 172.21.15.112:0/1718260348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a1415ce60 msgr2=0x7f6a140d0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:27.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.714+0000 7f6a1ae1c700 1 --2- 172.21.15.112:0/1718260348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a1415ce60 0x7f6a140d0e60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6a10009e60 tx=0x7f6a10009780 comp rx=0 tx=0).stop 2023-10-06T04:40:27.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.715+0000 7f6a1ae1c700 1 -- 172.21.15.112:0/1718260348 shutdown_connections 2023-10-06T04:40:27.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.715+0000 7f6a1ae1c700 1 --2- 172.21.15.112:0/1718260348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a1415ce60 0x7f6a140d0e60 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:27.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.715+0000 7f6a1ae1c700 1 -- 172.21.15.112:0/1718260348 >> 172.21.15.112:0/1718260348 conn(0x7f6a1406cfb0 msgr2=0x7f6a140d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:27.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.715+0000 7f6a1ae1c700 1 -- 172.21.15.112:0/1718260348 shutdown_connections 2023-10-06T04:40:27.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.715+0000 7f6a1ae1c700 1 -- 172.21.15.112:0/1718260348 wait complete. 2023-10-06T04:40:27.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.716+0000 7f6a1ae1c700 1 Processor -- start 2023-10-06T04:40:27.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.716+0000 7f6a1ae1c700 1 -- start start 2023-10-06T04:40:27.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.717+0000 7f6a1ae1c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a140cb4a0 0x7f6a1414e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:27.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.717+0000 7f6a1ae1c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a140d13a0 0x7f6a1415b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:27.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.717+0000 7f6a1ae1c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a1415ce60 0x7f6a1415b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:27.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.717+0000 7f6a1ae1c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a14150d40 con 0x7f6a140d13a0 2023-10-06T04:40:27.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.717+0000 7f6a1ae1c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1413d2e0 con 0x7f6a1415ce60 2023-10-06T04:40:27.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.717+0000 7f6a1ae1c700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a140c8430 con 0x7f6a140cb4a0 2023-10-06T04:40:27.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.717+0000 7f6a0bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a140d13a0 0x7f6a1415b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:27.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.717+0000 7f6a0bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a140d13a0 0x7f6a1415b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52066/0 (socket says 172.21.15.112:52066) 2023-10-06T04:40:27.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.717+0000 7f6a0bfff700 1 -- 172.21.15.112:0/712659594 learned_addr learned my addr 172.21.15.112:0/712659594 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:27.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.717+0000 7f6a18bb8700 1 --2- 172.21.15.112:0/712659594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a140cb4a0 0x7f6a1414e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:27.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.717+0000 7f6a0bfff700 1 -- 172.21.15.112:0/712659594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a140cb4a0 msgr2=0x7f6a1414e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:27.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.717+0000 7f6a0bfff700 1 --2- 172.21.15.112:0/712659594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a140cb4a0 0x7f6a1414e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:27.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.717+0000 7f6a0bfff700 1 -- 172.21.15.112:0/712659594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a1415ce60 msgr2=0x7f6a1415b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:27.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.717+0000 7f6a0bfff700 1 --2- 172.21.15.112:0/712659594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a1415ce60 0x7f6a1415b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:27.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.717+0000 7f6a0bfff700 1 -- 172.21.15.112:0/712659594 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a10009a20 con 0x7f6a140d13a0 2023-10-06T04:40:27.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.717+0000 7f6a0bfff700 1 --2- 172.21.15.112:0/712659594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a140d13a0 0x7f6a1415b3f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400c7e0 tx=0x7f6a04007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:27.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.717+0000 7f6a08ff9700 1 -- 172.21.15.112:0/712659594 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04005b30 con 0x7f6a140d13a0 2023-10-06T04:40:27.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.717+0000 7f6a08ff9700 1 -- 172.21.15.112:0/712659594 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a04005c90 con 0x7f6a140d13a0 2023-10-06T04:40:27.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.717+0000 7f6a1ae1c700 1 -- 172.21.15.112:0/712659594 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a140c86d0 con 0x7f6a140d13a0 2023-10-06T04:40:27.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.717+0000 7f6a08ff9700 1 -- 172.21.15.112:0/712659594 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04007300 con 0x7f6a140d13a0 2023-10-06T04:40:27.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.717+0000 7f6a1ae1c700 1 -- 172.21.15.112:0/712659594 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a140c8c90 con 0x7f6a140d13a0 2023-10-06T04:40:27.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.718+0000 7f6a1ae1c700 1 -- 172.21.15.112:0/712659594 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a140c8eb0 con 0x7f6a140d13a0 2023-10-06T04:40:27.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.719+0000 7f6a08ff9700 1 -- 172.21.15.112:0/712659594 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f6a0401b400 con 0x7f6a140d13a0 2023-10-06T04:40:27.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.719+0000 7f6a08ff9700 1 --2- 172.21.15.112:0/712659594 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6a000670e0 0x7f6a00069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:27.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.719+0000 7f6a08ff9700 1 -- 172.21.15.112:0/712659594 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f6a04084150 con 0x7f6a140d13a0 2023-10-06T04:40:27.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.719+0000 7f6a18bb8700 1 --2- 172.21.15.112:0/712659594 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6a000670e0 0x7f6a00069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:27.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.719+0000 7f6a18bb8700 1 --2- 172.21.15.112:0/712659594 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6a000670e0 0x7f6a00069590 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6a100099f0 tx=0x7f6a10018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:27.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.723+0000 7f6a08ff9700 1 -- 172.21.15.112:0/712659594 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a04051360 con 0x7f6a140d13a0 2023-10-06T04:40:27.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.917+0000 7f6a1ae1c700 1 -- 172.21.15.112:0/712659594 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6a1405f230 con 0x7f6a140d13a0 2023-10-06T04:40:27.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.920+0000 7f6a08ff9700 1 -- 172.21.15.112:0/712659594 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6a04054980 con 0x7f6a140d13a0 2023-10-06T04:40:27.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.923+0000 7f6a1ae1c700 1 -- 172.21.15.112:0/712659594 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6a000670e0 msgr2=0x7f6a00069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:27.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.923+0000 7f6a1ae1c700 1 --2- 172.21.15.112:0/712659594 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6a000670e0 0x7f6a00069590 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6a100099f0 tx=0x7f6a10018000 comp rx=0 tx=0).stop 2023-10-06T04:40:27.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.923+0000 7f6a1ae1c700 1 -- 172.21.15.112:0/712659594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a140d13a0 msgr2=0x7f6a1415b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:27.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.923+0000 7f6a1ae1c700 1 --2- 172.21.15.112:0/712659594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a140d13a0 0x7f6a1415b3f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400c7e0 tx=0x7f6a04007df0 comp rx=0 tx=0).stop 2023-10-06T04:40:27.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.923+0000 7f6a1ae1c700 1 -- 172.21.15.112:0/712659594 shutdown_connections 2023-10-06T04:40:27.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.923+0000 7f6a1ae1c700 1 --2- 172.21.15.112:0/712659594 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6a000670e0 0x7f6a00069590 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:27.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.923+0000 7f6a1ae1c700 1 --2- 172.21.15.112:0/712659594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a1415ce60 0x7f6a1415b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:27.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.923+0000 7f6a1ae1c700 1 --2- 172.21.15.112:0/712659594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a140cb4a0 0x7f6a1414e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:27.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.923+0000 7f6a1ae1c700 1 --2- 172.21.15.112:0/712659594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a140d13a0 0x7f6a1415b3f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:27.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.923+0000 7f6a1ae1c700 1 -- 172.21.15.112:0/712659594 >> 172.21.15.112:0/712659594 conn(0x7f6a1406cfb0 msgr2=0x7f6a140caad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:27.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.923+0000 7f6a1ae1c700 1 -- 172.21.15.112:0/712659594 shutdown_connections 2023-10-06T04:40:27.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:27.923+0000 7f6a1ae1c700 1 -- 172.21.15.112:0/712659594 wait complete. 2023-10-06T04:40:27.937 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2023-10-06T04:40:28.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.049+0000 7fd148ad8700 1 Processor -- start 2023-10-06T04:40:28.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.049+0000 7fd148ad8700 1 -- start start 2023-10-06T04:40:28.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.049+0000 7fd148ad8700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1440d0250 0x7fd1440b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:28.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.049+0000 7fd148ad8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1440afed0 con 0x7fd1440b11a0 2023-10-06T04:40:28.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.049+0000 7fd148ad8700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1440b6170 con 0x7fd14406d3b0 2023-10-06T04:40:28.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.049+0000 7fd148ad8700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1440b6450 con 0x7fd1440d0250 2023-10-06T04:40:28.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1437fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd1440b11a0 0x7fd1440b1570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34948/0 (socket says 172.21.15.112:34948) 2023-10-06T04:40:28.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1437fe700 1 -- 172.21.15.112:0/747394408 learned_addr learned my addr 172.21.15.112:0/747394408 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:28.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1427fc700 1 -- 172.21.15.112:0/747394408 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475225175 0 0) 0x7fd1440afed0 con 0x7fd1440b11a0 2023-10-06T04:40:28.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1427fc700 1 -- 172.21.15.112:0/747394408 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd12c003570 con 0x7fd1440b11a0 2023-10-06T04:40:28.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd143fff700 1 --2- 172.21.15.112:0/747394408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1440d0250 0x7fd1440b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:28.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1427fc700 1 -- 172.21.15.112:0/747394408 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3563166945 0 0) 0x7fd12c003570 con 0x7fd1440b11a0 2023-10-06T04:40:28.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1427fc700 1 -- 172.21.15.112:0/747394408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1440d0250 msgr2=0x7fd1440b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:28.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1427fc700 1 --2- 172.21.15.112:0/747394408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1440d0250 0x7fd1440b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:28.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1427fc700 1 -- 172.21.15.112:0/747394408 >> v1:172.21.15.179:6789/0 conn(0x7fd14406d3b0 legacy=0x7fd1440b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:28.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1427fc700 1 -- 172.21.15.112:0/747394408 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1440b6730 con 0x7fd1440b11a0 2023-10-06T04:40:28.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1427fc700 1 -- 172.21.15.112:0/747394408 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7fd134001470 con 0x7fd1440b11a0 2023-10-06T04:40:28.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1427fc700 1 -- 172.21.15.112:0/747394408 >> v1:172.21.15.112:6789/0 conn(0x7fd1440b11a0 legacy=0x7fd1440b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:28.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1427fc700 1 --2- 172.21.15.112:0/747394408 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd12c003a90 0x7fd12c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:28.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1427fc700 1 --2- 172.21.15.112:0/747394408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1440d0250 0x7fd12c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:28.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1427fc700 1 --2- 172.21.15.112:0/747394408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd12c004d50 0x7fd12c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:28.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1427fc700 1 -- 172.21.15.112:0/747394408 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1440b6450 con 0x7fd12c003a90 2023-10-06T04:40:28.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1427fc700 1 -- 172.21.15.112:0/747394408 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c00bba0 con 0x7fd12c004d50 2023-10-06T04:40:28.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1427fc700 1 -- 172.21.15.112:0/747394408 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c00bd60 con 0x7fd1440d0250 2023-10-06T04:40:28.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1437fe700 1 --2- 172.21.15.112:0/747394408 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd12c003a90 0x7fd12c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:28.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd142ffd700 1 --2- 172.21.15.112:0/747394408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1440d0250 0x7fd12c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:28.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd143fff700 1 --2- 172.21.15.112:0/747394408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd12c004d50 0x7fd12c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:28.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1437fe700 1 -- 172.21.15.112:0/747394408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1440d0250 msgr2=0x7fd12c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:28.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1437fe700 1 --2- 172.21.15.112:0/747394408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1440d0250 0x7fd12c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:28.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1437fe700 1 -- 172.21.15.112:0/747394408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd12c004d50 msgr2=0x7fd12c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:28.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1437fe700 1 --2- 172.21.15.112:0/747394408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd12c004d50 0x7fd12c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:28.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.050+0000 7fd1437fe700 1 -- 172.21.15.112:0/747394408 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c003570 con 0x7fd12c003a90 2023-10-06T04:40:28.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.051+0000 7fd1437fe700 1 --2- 172.21.15.112:0/747394408 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd12c003a90 0x7fd12c003ea0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c3c0 tx=0x7fd134001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310474f47323a1c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:28.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.051+0000 7fd1427fc700 1 -- 172.21.15.112:0/747394408 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13400cc90 con 0x7fd12c003a90 2023-10-06T04:40:28.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.051+0000 7fd1427fc700 1 -- 172.21.15.112:0/747394408 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13400cdf0 con 0x7fd12c003a90 2023-10-06T04:40:28.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.051+0000 7fd1427fc700 1 -- 172.21.15.112:0/747394408 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd134005b70 con 0x7fd12c003a90 2023-10-06T04:40:28.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.051+0000 7fd148ad8700 1 -- 172.21.15.112:0/747394408 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd12c003a90 msgr2=0x7fd12c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:28.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.051+0000 7fd148ad8700 1 --2- 172.21.15.112:0/747394408 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd12c003a90 0x7fd12c003ea0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c3c0 tx=0x7fd134001e50 comp rx=0 tx=0).stop 2023-10-06T04:40:28.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.051+0000 7fd143fff700 1 -- 172.21.15.112:0/747394408 reap_dead start 2023-10-06T04:40:28.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.051+0000 7fd148ad8700 1 -- 172.21.15.112:0/747394408 shutdown_connections 2023-10-06T04:40:28.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.051+0000 7fd148ad8700 1 -- 172.21.15.112:0/747394408 >> 172.21.15.112:0/747394408 conn(0x7fd14406cfb0 msgr2=0x7fd1440d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:28.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.051+0000 7fd148ad8700 1 -- 172.21.15.112:0/747394408 shutdown_connections 2023-10-06T04:40:28.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.051+0000 7fd148ad8700 1 -- 172.21.15.112:0/747394408 wait complete. 2023-10-06T04:40:28.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.053+0000 7fd148ad8700 1 Processor -- start 2023-10-06T04:40:28.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.053+0000 7fd148ad8700 1 -- start start 2023-10-06T04:40:28.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.053+0000 7fd148ad8700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd12c003a90 0x7fd14415cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:28.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.053+0000 7fd148ad8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1440c6700 0x7fd1440c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:28.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.053+0000 7fd148ad8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd14416ae50 0x7fd14416b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:28.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.053+0000 7fd148ad8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14409c340 con 0x7fd1440c6700 2023-10-06T04:40:28.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.053+0000 7fd148ad8700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14409c620 con 0x7fd14416ae50 2023-10-06T04:40:28.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.053+0000 7fd148ad8700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14409c900 con 0x7fd12c003a90 2023-10-06T04:40:28.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.053+0000 7fd142ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1440c6700 0x7fd1440c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:28.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.053+0000 7fd142ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1440c6700 0x7fd1440c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52074/0 (socket says 172.21.15.112:52074) 2023-10-06T04:40:28.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.053+0000 7fd142ffd700 1 -- 172.21.15.112:0/3888792764 learned_addr learned my addr 172.21.15.112:0/3888792764 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:28.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.053+0000 7fd1437fe700 1 --2- 172.21.15.112:0/3888792764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd12c003a90 0x7fd14415cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:28.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.054+0000 7fd143fff700 1 --2- 172.21.15.112:0/3888792764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd14416ae50 0x7fd14416b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:28.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.054+0000 7fd142ffd700 1 -- 172.21.15.112:0/3888792764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd12c003a90 msgr2=0x7fd14415cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:28.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.054+0000 7fd142ffd700 1 --2- 172.21.15.112:0/3888792764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd12c003a90 0x7fd14415cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:28.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.054+0000 7fd142ffd700 1 -- 172.21.15.112:0/3888792764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd14416ae50 msgr2=0x7fd14416b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:28.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.054+0000 7fd142ffd700 1 --2- 172.21.15.112:0/3888792764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd14416ae50 0x7fd14416b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:28.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.054+0000 7fd142ffd700 1 -- 172.21.15.112:0/3888792764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14409cbe0 con 0x7fd1440c6700 2023-10-06T04:40:28.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.054+0000 7fd142ffd700 1 --2- 172.21.15.112:0/3888792764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1440c6700 0x7fd1440c6b70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd13800e840 tx=0x7fd138009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:28.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.054+0000 7fd12b7fe700 1 -- 172.21.15.112:0/3888792764 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd138012590 con 0x7fd1440c6700 2023-10-06T04:40:28.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.054+0000 7fd12b7fe700 1 -- 172.21.15.112:0/3888792764 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1380126f0 con 0x7fd1440c6700 2023-10-06T04:40:28.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.054+0000 7fd148ad8700 1 -- 172.21.15.112:0/3888792764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd14409cec0 con 0x7fd1440c6700 2023-10-06T04:40:28.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.054+0000 7fd12b7fe700 1 -- 172.21.15.112:0/3888792764 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd138012ab0 con 0x7fd1440c6700 2023-10-06T04:40:28.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.054+0000 7fd148ad8700 1 -- 172.21.15.112:0/3888792764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14415d420 con 0x7fd1440c6700 2023-10-06T04:40:28.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.055+0000 7fd148ad8700 1 -- 172.21.15.112:0/3888792764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd14409d360 con 0x7fd1440c6700 2023-10-06T04:40:28.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.056+0000 7fd12b7fe700 1 -- 172.21.15.112:0/3888792764 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fd13801d460 con 0x7fd1440c6700 2023-10-06T04:40:28.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.056+0000 7fd12b7fe700 1 --2- 172.21.15.112:0/3888792764 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd1300670e0 0x7fd130069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:28.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.056+0000 7fd12b7fe700 1 -- 172.21.15.112:0/3888792764 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fd138084680 con 0x7fd1440c6700 2023-10-06T04:40:28.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.056+0000 7fd1437fe700 1 --2- 172.21.15.112:0/3888792764 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd1300670e0 0x7fd130069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:28.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.056+0000 7fd1437fe700 1 --2- 172.21.15.112:0/3888792764 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd1300670e0 0x7fd130069590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd134001e90 tx=0x7fd134015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:28.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.060+0000 7fd12b7fe700 1 -- 172.21.15.112:0/3888792764 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd138051810 con 0x7fd1440c6700 2023-10-06T04:40:28.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.316+0000 7fd148ad8700 1 -- 172.21.15.112:0/3888792764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) v1 -- 0x7fd14409d510 con 0x7fd1440c6700 2023-10-06T04:40:28.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.587+0000 7fd12b7fe700 1 -- 172.21.15.112:0/3888792764 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v84) v1 ==== 167+0+0 (secure 0 0 0) 0x7fd138054e30 con 0x7fd1440c6700 2023-10-06T04:40:28.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.590+0000 7fd148ad8700 1 -- 172.21.15.112:0/3888792764 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd1300670e0 msgr2=0x7fd130069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:28.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.590+0000 7fd148ad8700 1 --2- 172.21.15.112:0/3888792764 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd1300670e0 0x7fd130069590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd134001e90 tx=0x7fd134015000 comp rx=0 tx=0).stop 2023-10-06T04:40:28.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.590+0000 7fd148ad8700 1 -- 172.21.15.112:0/3888792764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1440c6700 msgr2=0x7fd1440c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:28.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.590+0000 7fd148ad8700 1 --2- 172.21.15.112:0/3888792764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1440c6700 0x7fd1440c6b70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd13800e840 tx=0x7fd138009040 comp rx=0 tx=0).stop 2023-10-06T04:40:28.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.590+0000 7fd148ad8700 1 -- 172.21.15.112:0/3888792764 shutdown_connections 2023-10-06T04:40:28.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.590+0000 7fd148ad8700 1 --2- 172.21.15.112:0/3888792764 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd1300670e0 0x7fd130069590 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:28.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.590+0000 7fd148ad8700 1 --2- 172.21.15.112:0/3888792764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd14416ae50 0x7fd14416b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:28.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.590+0000 7fd148ad8700 1 --2- 172.21.15.112:0/3888792764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd12c003a90 0x7fd14415cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:28.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.590+0000 7fd148ad8700 1 --2- 172.21.15.112:0/3888792764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1440c6700 0x7fd1440c6b70 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:28.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.590+0000 7fd148ad8700 1 -- 172.21.15.112:0/3888792764 >> 172.21.15.112:0/3888792764 conn(0x7fd14406cfb0 msgr2=0x7fd1440b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:28.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.590+0000 7fd148ad8700 1 -- 172.21.15.112:0/3888792764 shutdown_connections 2023-10-06T04:40:28.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.590+0000 7fd148ad8700 1 -- 172.21.15.112:0/3888792764 wait complete. 2023-10-06T04:40:28.604 INFO:tasks.cephfs_test_runner:test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) ... ok 2023-10-06T04:40:28.604 INFO:tasks.cephfs_test_runner: 2023-10-06T04:40:28.604 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T04:40:28.604 INFO:tasks.cephfs_test_runner:Ran 1 test in 38.809s 2023-10-06T04:40:28.605 INFO:tasks.cephfs_test_runner: 2023-10-06T04:40:28.605 INFO:tasks.cephfs_test_runner:OK 2023-10-06T04:40:28.605 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T04:40:28.615 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-10-06T04:40:28.722 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:28.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.834+0000 7f4041e31700 1 Processor -- start 2023-10-06T04:40:28.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.834+0000 7f4041e31700 1 -- start start 2023-10-06T04:40:28.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.835+0000 7f4041e31700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f403c159d50 0x7f403c0b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:28.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.835+0000 7f4041e31700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f403c0b0e70 0x7f403c0b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:28.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.835+0000 7f4041e31700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f403c0cd740 con 0x7f403c15a120 2023-10-06T04:40:28.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.835+0000 7f4041e31700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f403c0b1830 con 0x7f403c0b0e70 2023-10-06T04:40:28.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.835+0000 7f4041e31700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f403c0ccb30 con 0x7f403c159d50 2023-10-06T04:40:28.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.835+0000 7f403bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f403c0b0e70 0x7f403c0b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:28.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.835+0000 7f403bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f403c0b0e70 0x7f403c0b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54572/0 (socket says 172.21.15.112:54572) 2023-10-06T04:40:28.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.835+0000 7f403affd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f403c15a120 0x7f403c0cdbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45628/0 (socket says 172.21.15.112:45628) 2023-10-06T04:40:28.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.835+0000 7f403bfff700 1 -- 172.21.15.112:0/1058820833 learned_addr learned my addr 172.21.15.112:0/1058820833 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:28.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.836+0000 7f403b7fe700 1 --2- 172.21.15.112:0/1058820833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f403c159d50 0x7f403c0b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:28.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.836+0000 7f403bfff700 1 -- 172.21.15.112:0/1058820833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f403c159d50 msgr2=0x7f403c0b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:28.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.836+0000 7f403bfff700 1 --2- 172.21.15.112:0/1058820833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f403c159d50 0x7f403c0b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:28.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.836+0000 7f403bfff700 1 -- 172.21.15.112:0/1058820833 >> v1:172.21.15.112:6789/0 conn(0x7f403c15a120 legacy=0x7f403c0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:28.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.836+0000 7f403bfff700 1 -- 172.21.15.112:0/1058820833 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403c0cce10 con 0x7f403c0b0e70 2023-10-06T04:40:28.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.836+0000 7f403a7fc700 1 -- 172.21.15.112:0/1058820833 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069328220 0 0) 0x7f403c0cd740 con 0x7f403c15a120 2023-10-06T04:40:28.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.836+0000 7f403bfff700 1 --2- 172.21.15.112:0/1058820833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f403c0b0e70 0x7f403c0b12f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f40340099b0 tx=0x7f4034009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2c3df29c80119 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:28.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.836+0000 7f403a7fc700 1 -- 172.21.15.112:0/1058820833 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403400b860 con 0x7f403c0b0e70 2023-10-06T04:40:28.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.836+0000 7f403a7fc700 1 -- 172.21.15.112:0/1058820833 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403400b9c0 con 0x7f403c0b0e70 2023-10-06T04:40:28.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.836+0000 7f403a7fc700 1 -- 172.21.15.112:0/1058820833 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403400bd60 con 0x7f403c0b0e70 2023-10-06T04:40:28.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.836+0000 7f4041e31700 1 -- 172.21.15.112:0/1058820833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f403c0b0e70 msgr2=0x7f403c0b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:28.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.836+0000 7f4041e31700 1 --2- 172.21.15.112:0/1058820833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f403c0b0e70 0x7f403c0b12f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f40340099b0 tx=0x7f4034009250 comp rx=0 tx=0).stop 2023-10-06T04:40:28.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.836+0000 7f4041e31700 1 -- 172.21.15.112:0/1058820833 shutdown_connections 2023-10-06T04:40:28.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.836+0000 7f4041e31700 1 --2- 172.21.15.112:0/1058820833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f403c0b0e70 0x7f403c0b12f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:28.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.836+0000 7f4041e31700 1 --2- 172.21.15.112:0/1058820833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f403c159d50 0x7f403c0b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:28.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.836+0000 7f4041e31700 1 -- 172.21.15.112:0/1058820833 >> 172.21.15.112:0/1058820833 conn(0x7f403c099b60 msgr2=0x7f403c06cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:28.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.837+0000 7f4041e31700 1 -- 172.21.15.112:0/1058820833 shutdown_connections 2023-10-06T04:40:28.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.837+0000 7f4041e31700 1 -- 172.21.15.112:0/1058820833 wait complete. 2023-10-06T04:40:28.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.838+0000 7f4041e31700 1 Processor -- start 2023-10-06T04:40:28.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.838+0000 7f4041e31700 1 -- start start 2023-10-06T04:40:28.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.838+0000 7f4041e31700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f403c0b0e70 0x7f403c0a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:28.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.838+0000 7f4041e31700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f403c159d50 0x7f403c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:28.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.838+0000 7f4041e31700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f403c15a120 0x7f403c0a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:28.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.838+0000 7f4041e31700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c16d7c0 con 0x7f403c0b0e70 2023-10-06T04:40:28.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.838+0000 7f4041e31700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c16d4c0 con 0x7f403c159d50 2023-10-06T04:40:28.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.838+0000 7f4041e31700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f403c0b61a0 con 0x7f403c15a120 2023-10-06T04:40:28.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.839+0000 7f403b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f403c0b0e70 0x7f403c0a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:28.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.839+0000 7f403b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f403c0b0e70 0x7f403c0a1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54586/0 (socket says 172.21.15.112:54586) 2023-10-06T04:40:28.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.839+0000 7f403b7fe700 1 -- 172.21.15.112:0/2334967478 learned_addr learned my addr 172.21.15.112:0/2334967478 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:28.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.839+0000 7f403bfff700 1 --2- 172.21.15.112:0/2334967478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f403c15a120 0x7f403c0a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:28.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.839+0000 7f403affd700 1 --2- 172.21.15.112:0/2334967478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f403c159d50 0x7f403c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:28.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.839+0000 7f403b7fe700 1 -- 172.21.15.112:0/2334967478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f403c15a120 msgr2=0x7f403c0a04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.839+0000 7f403b7fe700 1 --2- 172.21.15.112:0/2334967478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f403c15a120 0x7f403c0a04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.839+0000 7f403b7fe700 1 -- 172.21.15.112:0/2334967478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f403c159d50 msgr2=0x7f403c0b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.839+0000 7f403b7fe700 1 --2- 172.21.15.112:0/2334967478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f403c159d50 0x7f403c0b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.839+0000 7f403b7fe700 1 -- 172.21.15.112:0/2334967478 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40340094f0 con 0x7f403c0b0e70 2023-10-06T04:40:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.839+0000 7f403bfff700 1 --2- 172.21.15.112:0/2334967478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f403c15a120 0x7f403c0a04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.839+0000 7f403affd700 1 --2- 172.21.15.112:0/2334967478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f403c159d50 0x7f403c0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.839+0000 7f403b7fe700 1 --2- 172.21.15.112:0/2334967478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f403c0b0e70 0x7f403c0a1390 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f402c00e1c0 tx=0x7f402c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.839+0000 7f40237fe700 1 -- 172.21.15.112:0/2334967478 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c00ee60 con 0x7f403c0b0e70 2023-10-06T04:40:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.839+0000 7f40237fe700 1 -- 172.21.15.112:0/2334967478 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402c014420 con 0x7f403c0b0e70 2023-10-06T04:40:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.839+0000 7f40237fe700 1 -- 172.21.15.112:0/2334967478 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c0147e0 con 0x7f403c0b0e70 2023-10-06T04:40:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.839+0000 7f4041e31700 1 -- 172.21.15.112:0/2334967478 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f403c0b6480 con 0x7f403c0b0e70 2023-10-06T04:40:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.839+0000 7f4041e31700 1 -- 172.21.15.112:0/2334967478 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403c0a0a30 con 0x7f403c0b0e70 2023-10-06T04:40:28.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.840+0000 7f4041e31700 1 -- 172.21.15.112:0/2334967478 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f403c05f230 con 0x7f403c0b0e70 2023-10-06T04:40:28.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.841+0000 7f40237fe700 1 -- 172.21.15.112:0/2334967478 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f402c014b90 con 0x7f403c0b0e70 2023-10-06T04:40:28.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.841+0000 7f40237fe700 1 --2- 172.21.15.112:0/2334967478 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f40280670e0 0x7f4028069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:28.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.841+0000 7f40237fe700 1 -- 172.21.15.112:0/2334967478 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f402c084f00 con 0x7f403c0b0e70 2023-10-06T04:40:28.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.841+0000 7f403affd700 1 --2- 172.21.15.112:0/2334967478 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f40280670e0 0x7f4028069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:28.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.841+0000 7f403affd700 1 --2- 172.21.15.112:0/2334967478 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f40280670e0 0x7f4028069590 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f403c09ed10 tx=0x7f4030007c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:28.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:28.845+0000 7f40237fe700 1 -- 172.21.15.112:0/2334967478 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f402c052090 con 0x7f403c0b0e70 2023-10-06T04:40:29.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.029+0000 7f4041e31700 1 -- 172.21.15.112:0/2334967478 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f403c08a910 con 0x7f403c0b0e70 2023-10-06T04:40:29.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.030+0000 7f40237fe700 1 -- 172.21.15.112:0/2334967478 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13829 (secure 0 0 0) 0x7f402c009a60 con 0x7f403c0b0e70 2023-10-06T04:40:29.032 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:29.032 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":34,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:40:27.576548+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6834/1886371745":"2023-10-07T04:40:24.312231+0000","172.21.15.179:6832/1886371745":"2023-10-07T04:40:24.312231+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:29.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.032+0000 7f4041e31700 1 -- 172.21.15.112:0/2334967478 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f40280670e0 msgr2=0x7f4028069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:29.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.032+0000 7f4041e31700 1 --2- 172.21.15.112:0/2334967478 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f40280670e0 0x7f4028069590 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f403c09ed10 tx=0x7f4030007c90 comp rx=0 tx=0).stop 2023-10-06T04:40:29.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.032+0000 7f4041e31700 1 -- 172.21.15.112:0/2334967478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f403c0b0e70 msgr2=0x7f403c0a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:29.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.032+0000 7f4041e31700 1 --2- 172.21.15.112:0/2334967478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f403c0b0e70 0x7f403c0a1390 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f402c00e1c0 tx=0x7f402c009920 comp rx=0 tx=0).stop 2023-10-06T04:40:29.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.032+0000 7f4041e31700 1 -- 172.21.15.112:0/2334967478 shutdown_connections 2023-10-06T04:40:29.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.032+0000 7f4041e31700 1 --2- 172.21.15.112:0/2334967478 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f40280670e0 0x7f4028069590 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.032+0000 7f4041e31700 1 --2- 172.21.15.112:0/2334967478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f403c15a120 0x7f403c0a04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.032+0000 7f4041e31700 1 --2- 172.21.15.112:0/2334967478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f403c0b0e70 0x7f403c0a1390 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.032+0000 7f4041e31700 1 --2- 172.21.15.112:0/2334967478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f403c159d50 0x7f403c0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.032+0000 7f4041e31700 1 -- 172.21.15.112:0/2334967478 >> 172.21.15.112:0/2334967478 conn(0x7f403c099b60 msgr2=0x7f403c1554f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:29.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.032+0000 7f4041e31700 1 -- 172.21.15.112:0/2334967478 shutdown_connections 2023-10-06T04:40:29.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.032+0000 7f4041e31700 1 -- 172.21.15.112:0/2334967478 wait complete. 2023-10-06T04:40:29.046 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:39:13.929254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:39:14.321892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T04:40:29.047 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:40:29.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.161+0000 7f42c6f3c700 1 Processor -- start 2023-10-06T04:40:29.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.161+0000 7f42c6f3c700 1 -- start start 2023-10-06T04:40:29.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.162+0000 7f42c6f3c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f42c0157220 0x7f42c00d0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:29.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.162+0000 7f42c6f3c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f42c00c7da0 0x7f42c00c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:29.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.162+0000 7f42c6f3c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c00cab40 con 0x7f42c00d0a70 2023-10-06T04:40:29.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.162+0000 7f42c6f3c700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c00c81a0 con 0x7f42c00c7da0 2023-10-06T04:40:29.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.162+0000 7f42c6f3c700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c00cceb0 con 0x7f42c0157220 2023-10-06T04:40:29.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.162+0000 7f42c673b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f42c00c7da0 0x7f42c00c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:29.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.162+0000 7f42c5739700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f42c00d0a70 0x7f42c00c7690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45642/0 (socket says 172.21.15.112:45642) 2023-10-06T04:40:29.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.162+0000 7f42c5739700 1 -- 172.21.15.112:0/369368542 learned_addr learned my addr 172.21.15.112:0/369368542 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:29.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.162+0000 7f42c673b700 1 -- 172.21.15.112:0/369368542 >> v2:172.21.15.179:3300/0 conn(0x7f42c0157220 msgr2=0x7f42c00d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:29.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.162+0000 7f42c5f3a700 1 --2- 172.21.15.112:0/369368542 >> v2:172.21.15.179:3300/0 conn(0x7f42c0157220 0x7f42c00d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:29.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.162+0000 7f42c4f38700 1 -- 172.21.15.112:0/369368542 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609128905 0 0) 0x7f42c00cab40 con 0x7f42c00d0a70 2023-10-06T04:40:29.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.162+0000 7f42c673b700 1 --2- 172.21.15.112:0/369368542 >> v2:172.21.15.179:3300/0 conn(0x7f42c0157220 0x7f42c00d0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.163+0000 7f42c673b700 1 -- 172.21.15.112:0/369368542 >> v1:172.21.15.112:6789/0 conn(0x7f42c00d0a70 legacy=0x7f42c00c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:29.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.163+0000 7f42c673b700 1 -- 172.21.15.112:0/369368542 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c00d0ee0 con 0x7f42c00c7da0 2023-10-06T04:40:29.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.163+0000 7f42c5f3a700 1 --2- 172.21.15.112:0/369368542 >> v2:172.21.15.179:3300/0 conn(0x7f42c0157220 0x7f42c00d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:29.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.163+0000 7f42c673b700 1 --2- 172.21.15.112:0/369368542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c00c7da0 0x7f42c00c97a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f42c0089850 tx=0x7f42b8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a9801e77921c47 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:29.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.163+0000 7f42c4f38700 1 -- 172.21.15.112:0/369368542 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b800e070 con 0x7f42c00c7da0 2023-10-06T04:40:29.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.163+0000 7f42c4f38700 1 -- 172.21.15.112:0/369368542 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b800bc30 con 0x7f42c00c7da0 2023-10-06T04:40:29.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.163+0000 7f42c4f38700 1 -- 172.21.15.112:0/369368542 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8012430 con 0x7f42c00c7da0 2023-10-06T04:40:29.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.163+0000 7f42c6f3c700 1 -- 172.21.15.112:0/369368542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c00c7da0 msgr2=0x7f42c00c97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:29.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.163+0000 7f42c6f3c700 1 --2- 172.21.15.112:0/369368542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c00c7da0 0x7f42c00c97a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f42c0089850 tx=0x7f42b8009780 comp rx=0 tx=0).stop 2023-10-06T04:40:29.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.163+0000 7f42c6f3c700 1 -- 172.21.15.112:0/369368542 shutdown_connections 2023-10-06T04:40:29.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.163+0000 7f42c6f3c700 1 --2- 172.21.15.112:0/369368542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c00c7da0 0x7f42c00c97a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.163+0000 7f42c6f3c700 1 --2- 172.21.15.112:0/369368542 >> v2:172.21.15.179:3300/0 conn(0x7f42c0157220 0x7f42c00d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.163+0000 7f42c6f3c700 1 -- 172.21.15.112:0/369368542 >> 172.21.15.112:0/369368542 conn(0x7f42c006c7d0 msgr2=0x7f42c006cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:29.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.163+0000 7f42c6f3c700 1 -- 172.21.15.112:0/369368542 shutdown_connections 2023-10-06T04:40:29.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.163+0000 7f42c6f3c700 1 -- 172.21.15.112:0/369368542 wait complete. 2023-10-06T04:40:29.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.164+0000 7f42c6f3c700 1 Processor -- start 2023-10-06T04:40:29.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.164+0000 7f42c6f3c700 1 -- start start 2023-10-06T04:40:29.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.165+0000 7f42c6f3c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c00c7da0 0x7f42c00b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:29.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.165+0000 7f42c6f3c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42c00d0a70 0x7f42c00ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:29.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.165+0000 7f42c6f3c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42c0157220 0x7f42c00cae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:29.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.165+0000 7f42c6f3c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c016df10 con 0x7f42c00c7da0 2023-10-06T04:40:29.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.165+0000 7f42c6f3c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c016cf40 con 0x7f42c00d0a70 2023-10-06T04:40:29.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.165+0000 7f42c6f3c700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c016d150 con 0x7f42c0157220 2023-10-06T04:40:29.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.165+0000 7f42c5f3a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c00c7da0 0x7f42c00b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:29.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.165+0000 7f42c5f3a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c00c7da0 0x7f42c00b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54602/0 (socket says 172.21.15.112:54602) 2023-10-06T04:40:29.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.165+0000 7f42c5f3a700 1 -- 172.21.15.112:0/2976781200 learned_addr learned my addr 172.21.15.112:0/2976781200 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:29.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.166+0000 7f42c5739700 1 --2- 172.21.15.112:0/2976781200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42c00d0a70 0x7f42c00ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:29.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.166+0000 7f42c673b700 1 --2- 172.21.15.112:0/2976781200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42c0157220 0x7f42c00cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:29.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.166+0000 7f42c5f3a700 1 -- 172.21.15.112:0/2976781200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42c0157220 msgr2=0x7f42c00cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:29.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.166+0000 7f42c5f3a700 1 --2- 172.21.15.112:0/2976781200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42c0157220 0x7f42c00cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.166+0000 7f42c5f3a700 1 -- 172.21.15.112:0/2976781200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42c00d0a70 msgr2=0x7f42c00ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:29.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.166+0000 7f42c5f3a700 1 --2- 172.21.15.112:0/2976781200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42c00d0a70 0x7f42c00ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.166+0000 7f42c5f3a700 1 -- 172.21.15.112:0/2976781200 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b8009a20 con 0x7f42c00c7da0 2023-10-06T04:40:29.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.166+0000 7f42c5f3a700 1 --2- 172.21.15.112:0/2976781200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c00c7da0 0x7f42c00b5db0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00c850 tx=0x7f42bc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:29.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.166+0000 7f42b5ffb700 1 -- 172.21.15.112:0/2976781200 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc011600 con 0x7f42c00c7da0 2023-10-06T04:40:29.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.166+0000 7f42b5ffb700 1 -- 172.21.15.112:0/2976781200 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc011760 con 0x7f42c00c7da0 2023-10-06T04:40:29.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.166+0000 7f42c6f3c700 1 -- 172.21.15.112:0/2976781200 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c016d430 con 0x7f42c00c7da0 2023-10-06T04:40:29.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.166+0000 7f42b5ffb700 1 -- 172.21.15.112:0/2976781200 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc011b00 con 0x7f42c00c7da0 2023-10-06T04:40:29.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.166+0000 7f42c6f3c700 1 -- 172.21.15.112:0/2976781200 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c016d9f0 con 0x7f42c00c7da0 2023-10-06T04:40:29.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.167+0000 7f42c6f3c700 1 -- 172.21.15.112:0/2976781200 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c005f230 con 0x7f42c00c7da0 2023-10-06T04:40:29.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.167+0000 7f42b5ffb700 1 -- 172.21.15.112:0/2976781200 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f42bc0073b0 con 0x7f42c00c7da0 2023-10-06T04:40:29.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.167+0000 7f42b5ffb700 1 --2- 172.21.15.112:0/2976781200 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f42a40670e0 0x7f42a4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:29.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.168+0000 7f42b5ffb700 1 -- 172.21.15.112:0/2976781200 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f42bc0847b0 con 0x7f42c00c7da0 2023-10-06T04:40:29.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.168+0000 7f42c5739700 1 --2- 172.21.15.112:0/2976781200 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f42a40670e0 0x7f42a4069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:29.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.168+0000 7f42c5739700 1 --2- 172.21.15.112:0/2976781200 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f42a40670e0 0x7f42a4069590 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f42b0001730 tx=0x7f42b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:29.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.172+0000 7f42b5ffb700 1 -- 172.21.15.112:0/2976781200 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42bc0552c0 con 0x7f42c00c7da0 2023-10-06T04:40:29.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.352+0000 7f42c6f3c700 1 -- 172.21.15.112:0/2976781200 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f42c00af820 con 0x7f42c00c7da0 2023-10-06T04:40:29.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.353+0000 7f42b5ffb700 1 -- 172.21.15.112:0/2976781200 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v34) v1 ==== 92+0+10 (secure 0 0 0) 0x7f42bc054e50 con 0x7f42c00c7da0 2023-10-06T04:40:29.356 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-10-06T04:40:29.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.355+0000 7f42c6f3c700 1 -- 172.21.15.112:0/2976781200 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f42a40670e0 msgr2=0x7f42a4069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:29.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.355+0000 7f42c6f3c700 1 --2- 172.21.15.112:0/2976781200 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f42a40670e0 0x7f42a4069590 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f42b0001730 tx=0x7f42b0009040 comp rx=0 tx=0).stop 2023-10-06T04:40:29.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.355+0000 7f42c6f3c700 1 -- 172.21.15.112:0/2976781200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c00c7da0 msgr2=0x7f42c00b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:29.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.355+0000 7f42c6f3c700 1 --2- 172.21.15.112:0/2976781200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c00c7da0 0x7f42c00b5db0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00c850 tx=0x7f42bc008040 comp rx=0 tx=0).stop 2023-10-06T04:40:29.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.355+0000 7f42c6f3c700 1 -- 172.21.15.112:0/2976781200 shutdown_connections 2023-10-06T04:40:29.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.355+0000 7f42c6f3c700 1 --2- 172.21.15.112:0/2976781200 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f42a40670e0 0x7f42a4069590 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.355+0000 7f42c6f3c700 1 --2- 172.21.15.112:0/2976781200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42c0157220 0x7f42c00cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.355+0000 7f42c6f3c700 1 --2- 172.21.15.112:0/2976781200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c00c7da0 0x7f42c00b5db0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.355+0000 7f42c6f3c700 1 --2- 172.21.15.112:0/2976781200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42c00d0a70 0x7f42c00ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.355+0000 7f42c6f3c700 1 -- 172.21.15.112:0/2976781200 >> 172.21.15.112:0/2976781200 conn(0x7f42c006c7d0 msgr2=0x7f42c00cebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:29.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.355+0000 7f42c6f3c700 1 -- 172.21.15.112:0/2976781200 shutdown_connections 2023-10-06T04:40:29.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.355+0000 7f42c6f3c700 1 -- 172.21.15.112:0/2976781200 wait complete. 2023-10-06T04:40:29.369 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:40:29.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.483+0000 7f16d1743700 1 Processor -- start 2023-10-06T04:40:29.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.483+0000 7f16d1743700 1 -- start start 2023-10-06T04:40:29.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.484+0000 7f16d1743700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16cc0cbf00 0x7f16cc15b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:29.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.484+0000 7f16d1743700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16cc15af50 con 0x7f16cc06d3b0 2023-10-06T04:40:29.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.484+0000 7f16d1743700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16cc0cae50 con 0x7f16cc159a20 2023-10-06T04:40:29.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.484+0000 7f16d1743700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc0cca70 con 0x7f16cc0cbf00 2023-10-06T04:40:29.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.484+0000 7f16cb7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f16cc06d3b0 0x7f16cc15bc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45646/0 (socket says 172.21.15.112:45646) 2023-10-06T04:40:29.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.484+0000 7f16cb7fe700 1 -- 172.21.15.112:0/4038102564 learned_addr learned my addr 172.21.15.112:0/4038102564 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:29.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.484+0000 7f16c27fc700 1 --2- 172.21.15.112:0/4038102564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16cc0cbf00 0x7f16cc15b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:29.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.484+0000 7f16ca7fc700 1 -- 172.21.15.112:0/4038102564 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052736996 0 0) 0x7f16cc15af50 con 0x7f16cc06d3b0 2023-10-06T04:40:29.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.484+0000 7f16ca7fc700 1 -- 172.21.15.112:0/4038102564 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16b8003570 con 0x7f16cc06d3b0 2023-10-06T04:40:29.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16ca7fc700 1 -- 172.21.15.112:0/4038102564 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2409669733 0 0) 0x7f16b8003570 con 0x7f16cc06d3b0 2023-10-06T04:40:29.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16ca7fc700 1 -- 172.21.15.112:0/4038102564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16cc0cbf00 msgr2=0x7f16cc15b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:29.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16ca7fc700 1 --2- 172.21.15.112:0/4038102564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16cc0cbf00 0x7f16cc15b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16ca7fc700 1 -- 172.21.15.112:0/4038102564 >> v1:172.21.15.179:6789/0 conn(0x7f16cc159a20 legacy=0x7f16cc0cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:29.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16ca7fc700 1 -- 172.21.15.112:0/4038102564 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc0cb0f0 con 0x7f16cc06d3b0 2023-10-06T04:40:29.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16ca7fc700 1 -- 172.21.15.112:0/4038102564 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f16c40017f0 con 0x7f16cc06d3b0 2023-10-06T04:40:29.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16ca7fc700 1 -- 172.21.15.112:0/4038102564 >> v1:172.21.15.112:6789/0 conn(0x7f16cc06d3b0 legacy=0x7f16cc15bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:29.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16ca7fc700 1 --2- 172.21.15.112:0/4038102564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16cc0cbf00 0x7f16b8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:29.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16ca7fc700 1 --2- 172.21.15.112:0/4038102564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16b8003fd0 0x7f16b8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:29.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16ca7fc700 1 --2- 172.21.15.112:0/4038102564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16b8004d50 0x7f16b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:29.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16ca7fc700 1 -- 172.21.15.112:0/4038102564 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc0cca70 con 0x7f16b8004d50 2023-10-06T04:40:29.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16ca7fc700 1 -- 172.21.15.112:0/4038102564 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b800bb40 con 0x7f16b8003fd0 2023-10-06T04:40:29.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16ca7fc700 1 -- 172.21.15.112:0/4038102564 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b800bd00 con 0x7f16cc0cbf00 2023-10-06T04:40:29.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16cb7fe700 1 --2- 172.21.15.112:0/4038102564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16b8004d50 0x7f16b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:29.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16caffd700 1 --2- 172.21.15.112:0/4038102564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16cc0cbf00 0x7f16b8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:29.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16c27fc700 1 --2- 172.21.15.112:0/4038102564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16b8003fd0 0x7f16b8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:29.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16cb7fe700 1 -- 172.21.15.112:0/4038102564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16cc0cbf00 msgr2=0x7f16b8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:29.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16cb7fe700 1 --2- 172.21.15.112:0/4038102564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16cc0cbf00 0x7f16b8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16cb7fe700 1 -- 172.21.15.112:0/4038102564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16b8003fd0 msgr2=0x7f16b8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:29.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16cb7fe700 1 --2- 172.21.15.112:0/4038102564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16b8003fd0 0x7f16b8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16cb7fe700 1 -- 172.21.15.112:0/4038102564 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b8003570 con 0x7f16b8004d50 2023-10-06T04:40:29.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16cb7fe700 1 --2- 172.21.15.112:0/4038102564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16b8004d50 0x7f16b80051c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f16cc08ac20 tx=0x7f16c40021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8f791a8a744205 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:29.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16ca7fc700 1 -- 172.21.15.112:0/4038102564 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c40070d0 con 0x7f16b8004d50 2023-10-06T04:40:29.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16ca7fc700 1 -- 172.21.15.112:0/4038102564 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c4007230 con 0x7f16b8004d50 2023-10-06T04:40:29.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.485+0000 7f16ca7fc700 1 -- 172.21.15.112:0/4038102564 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c40075f0 con 0x7f16b8004d50 2023-10-06T04:40:29.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.486+0000 7f16d1743700 1 -- 172.21.15.112:0/4038102564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16b8004d50 msgr2=0x7f16b80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:29.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.486+0000 7f16d1743700 1 --2- 172.21.15.112:0/4038102564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16b8004d50 0x7f16b80051c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f16cc08ac20 tx=0x7f16c40021f0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.486+0000 7f16cb7fe700 1 -- 172.21.15.112:0/4038102564 reap_dead start 2023-10-06T04:40:29.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.486+0000 7f16d1743700 1 -- 172.21.15.112:0/4038102564 shutdown_connections 2023-10-06T04:40:29.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.486+0000 7f16d1743700 1 -- 172.21.15.112:0/4038102564 >> 172.21.15.112:0/4038102564 conn(0x7f16cc06cfb0 msgr2=0x7f16cc0d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:29.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.486+0000 7f16d1743700 1 -- 172.21.15.112:0/4038102564 shutdown_connections 2023-10-06T04:40:29.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.486+0000 7f16d1743700 1 -- 172.21.15.112:0/4038102564 wait complete. 2023-10-06T04:40:29.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.487+0000 7f16d1743700 1 Processor -- start 2023-10-06T04:40:29.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.487+0000 7f16d1743700 1 -- start start 2023-10-06T04:40:29.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.488+0000 7f16d1743700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16cc14be00 0x7f16cc1505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:29.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.488+0000 7f16d1743700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16cc150b20 0x7f16cc0cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:29.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.488+0000 7f16d1743700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16cc14c1d0 0x7f16cc0cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:29.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.488+0000 7f16d1743700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc150f40 con 0x7f16cc14be00 2023-10-06T04:40:29.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.488+0000 7f16d1743700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc14f070 con 0x7f16cc14c1d0 2023-10-06T04:40:29.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.488+0000 7f16d1743700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc14eab0 con 0x7f16cc150b20 2023-10-06T04:40:29.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.488+0000 7f16caffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16cc14be00 0x7f16cc1505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:29.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.488+0000 7f16caffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16cc14be00 0x7f16cc1505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54624/0 (socket says 172.21.15.112:54624) 2023-10-06T04:40:29.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.488+0000 7f16caffd700 1 -- 172.21.15.112:0/3422509016 learned_addr learned my addr 172.21.15.112:0/3422509016 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:29.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.488+0000 7f16c27fc700 1 --2- 172.21.15.112:0/3422509016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16cc150b20 0x7f16cc0cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:29.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.488+0000 7f16caffd700 1 -- 172.21.15.112:0/3422509016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16cc150b20 msgr2=0x7f16cc0cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:29.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.488+0000 7f16caffd700 1 --2- 172.21.15.112:0/3422509016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16cc150b20 0x7f16cc0cd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.488+0000 7f16caffd700 1 -- 172.21.15.112:0/3422509016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16cc14c1d0 msgr2=0x7f16cc0cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:29.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.488+0000 7f16cb7fe700 1 --2- 172.21.15.112:0/3422509016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16cc14c1d0 0x7f16cc0cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:29.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.488+0000 7f16caffd700 1 --2- 172.21.15.112:0/3422509016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16cc14c1d0 0x7f16cc0cd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.488+0000 7f16caffd700 1 -- 172.21.15.112:0/3422509016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc14ed90 con 0x7f16cc14be00 2023-10-06T04:40:29.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.488+0000 7f16caffd700 1 --2- 172.21.15.112:0/3422509016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16cc14be00 0x7f16cc1505e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f16bc002b00 tx=0x7f16bc007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:29.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.489+0000 7f16c37fe700 1 -- 172.21.15.112:0/3422509016 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc00f9a0 con 0x7f16cc14be00 2023-10-06T04:40:29.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.489+0000 7f16c37fe700 1 -- 172.21.15.112:0/3422509016 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc00fb40 con 0x7f16cc14be00 2023-10-06T04:40:29.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.489+0000 7f16c37fe700 1 -- 172.21.15.112:0/3422509016 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0133f0 con 0x7f16cc14be00 2023-10-06T04:40:29.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.489+0000 7f16d1743700 1 -- 172.21.15.112:0/3422509016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16cc0b4e50 con 0x7f16cc14be00 2023-10-06T04:40:29.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.489+0000 7f16d1743700 1 -- 172.21.15.112:0/3422509016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16cc14e570 con 0x7f16cc14be00 2023-10-06T04:40:29.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.490+0000 7f16d1743700 1 -- 172.21.15.112:0/3422509016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16cc0b5370 con 0x7f16cc14be00 2023-10-06T04:40:29.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.490+0000 7f16c37fe700 1 -- 172.21.15.112:0/3422509016 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f16bc013760 con 0x7f16cc14be00 2023-10-06T04:40:29.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.490+0000 7f16c37fe700 1 --2- 172.21.15.112:0/3422509016 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f16ac0670e0 0x7f16ac069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:29.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.491+0000 7f16c27fc700 1 --2- 172.21.15.112:0/3422509016 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f16ac0670e0 0x7f16ac069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:29.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.491+0000 7f16c37fe700 1 -- 172.21.15.112:0/3422509016 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f16bc084760 con 0x7f16cc14be00 2023-10-06T04:40:29.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.491+0000 7f16c27fc700 1 --2- 172.21.15.112:0/3422509016 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f16ac0670e0 0x7f16ac069590 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f16cc150ef0 tx=0x7f16b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:29.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.495+0000 7f16c37fe700 1 -- 172.21.15.112:0/3422509016 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16cc0b5370 con 0x7f16cc14be00 2023-10-06T04:40:29.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.676+0000 7f16d1743700 1 -- 172.21.15.112:0/3422509016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f16cc0b5370 con 0x7f16cc14be00 2023-10-06T04:40:29.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.676+0000 7f16c37fe700 1 -- 172.21.15.112:0/3422509016 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f16cc0b5370 con 0x7f16cc14be00 2023-10-06T04:40:29.679 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-10-06T04:40:29.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.678+0000 7f16d1743700 1 -- 172.21.15.112:0/3422509016 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f16ac0670e0 msgr2=0x7f16ac069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:29.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.678+0000 7f16d1743700 1 --2- 172.21.15.112:0/3422509016 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f16ac0670e0 0x7f16ac069590 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f16cc150ef0 tx=0x7f16b4008040 comp rx=0 tx=0).stop 2023-10-06T04:40:29.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.678+0000 7f16d1743700 1 -- 172.21.15.112:0/3422509016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16cc14be00 msgr2=0x7f16cc1505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:29.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.678+0000 7f16d1743700 1 --2- 172.21.15.112:0/3422509016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16cc14be00 0x7f16cc1505e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f16bc002b00 tx=0x7f16bc007d10 comp rx=0 tx=0).stop 2023-10-06T04:40:29.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.678+0000 7f16d1743700 1 -- 172.21.15.112:0/3422509016 shutdown_connections 2023-10-06T04:40:29.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.678+0000 7f16d1743700 1 --2- 172.21.15.112:0/3422509016 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f16ac0670e0 0x7f16ac069590 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.678+0000 7f16d1743700 1 --2- 172.21.15.112:0/3422509016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16cc14c1d0 0x7f16cc0cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.678+0000 7f16d1743700 1 --2- 172.21.15.112:0/3422509016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16cc14be00 0x7f16cc1505e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.678+0000 7f16d1743700 1 --2- 172.21.15.112:0/3422509016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16cc150b20 0x7f16cc0cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.678+0000 7f16d1743700 1 -- 172.21.15.112:0/3422509016 >> 172.21.15.112:0/3422509016 conn(0x7f16cc06cfb0 msgr2=0x7f16cc0aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:29.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.678+0000 7f16d1743700 1 -- 172.21.15.112:0/3422509016 shutdown_connections 2023-10-06T04:40:29.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.678+0000 7f16d1743700 1 -- 172.21.15.112:0/3422509016 wait complete. 2023-10-06T04:40:29.693 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-10-06T04:40:29.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.804+0000 7f4082382700 1 Processor -- start 2023-10-06T04:40:29.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.804+0000 7f4082382700 1 -- start start 2023-10-06T04:40:29.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.805+0000 7f4082382700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f407c159d50 0x7f407c0b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:29.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.805+0000 7f4082382700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f407c0b0e70 0x7f407c0b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:29.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.805+0000 7f4082382700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f407c0cd740 con 0x7f407c15a120 2023-10-06T04:40:29.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.805+0000 7f4082382700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f407c0b1830 con 0x7f407c0b0e70 2023-10-06T04:40:29.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.805+0000 7f4082382700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407c0ccb30 con 0x7f407c159d50 2023-10-06T04:40:29.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.805+0000 7f408091f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f407c0b0e70 0x7f407c0b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:29.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.805+0000 7f408091f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f407c0b0e70 0x7f407c0b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54640/0 (socket says 172.21.15.112:54640) 2023-10-06T04:40:29.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.805+0000 7f408091f700 1 -- 172.21.15.112:0/204155180 learned_addr learned my addr 172.21.15.112:0/204155180 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:29.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.805+0000 7f408091f700 1 -- 172.21.15.112:0/204155180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f407c159d50 msgr2=0x7f407c0b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:29.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.805+0000 7f407bfff700 1 --2- 172.21.15.112:0/204155180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f407c159d50 0x7f407c0b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:29.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.806+0000 7f408091f700 1 --2- 172.21.15.112:0/204155180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f407c159d50 0x7f407c0b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.806+0000 7f408091f700 1 -- 172.21.15.112:0/204155180 >> v1:172.21.15.179:6789/0 conn(0x7f407c15a120 legacy=0x7f407c0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:29.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.806+0000 7f408091f700 1 -- 172.21.15.112:0/204155180 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407c0cce10 con 0x7f407c0b0e70 2023-10-06T04:40:29.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.806+0000 7f408091f700 1 --2- 172.21.15.112:0/204155180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f407c0b0e70 0x7f407c0b12f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4074009f20 tx=0x7f4074009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afbbd0cfe83a045 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:29.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.806+0000 7f407affd700 1 -- 172.21.15.112:0/204155180 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407400e070 con 0x7f407c0b0e70 2023-10-06T04:40:29.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.806+0000 7f407affd700 1 -- 172.21.15.112:0/204155180 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407400ba40 con 0x7f407c0b0e70 2023-10-06T04:40:29.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.806+0000 7f407affd700 1 -- 172.21.15.112:0/204155180 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40740092e0 con 0x7f407c0b0e70 2023-10-06T04:40:29.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.806+0000 7f4082382700 1 -- 172.21.15.112:0/204155180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f407c0b0e70 msgr2=0x7f407c0b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:29.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.806+0000 7f4082382700 1 --2- 172.21.15.112:0/204155180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f407c0b0e70 0x7f407c0b12f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4074009f20 tx=0x7f4074009840 comp rx=0 tx=0).stop 2023-10-06T04:40:29.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.806+0000 7f4082382700 1 -- 172.21.15.112:0/204155180 shutdown_connections 2023-10-06T04:40:29.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.806+0000 7f4082382700 1 --2- 172.21.15.112:0/204155180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f407c0b0e70 0x7f407c0b12f0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.806+0000 7f4082382700 1 --2- 172.21.15.112:0/204155180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f407c159d50 0x7f407c0b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.806+0000 7f4082382700 1 -- 172.21.15.112:0/204155180 >> 172.21.15.112:0/204155180 conn(0x7f407c099b60 msgr2=0x7f407c06cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:29.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.806+0000 7f4082382700 1 -- 172.21.15.112:0/204155180 shutdown_connections 2023-10-06T04:40:29.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.806+0000 7f4082382700 1 -- 172.21.15.112:0/204155180 wait complete. 2023-10-06T04:40:29.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.807+0000 7f4082382700 1 Processor -- start 2023-10-06T04:40:29.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.808+0000 7f4082382700 1 -- start start 2023-10-06T04:40:29.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.808+0000 7f4082382700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f407c0b0e70 0x7f407c14e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:29.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.808+0000 7f4082382700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f407c159d50 0x7f407c0a02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:29.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.808+0000 7f4082382700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f407c15a120 0x7f407c0a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:29.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.808+0000 7f4082382700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c16aed0 con 0x7f407c0b0e70 2023-10-06T04:40:29.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.808+0000 7f4082382700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c14f130 con 0x7f407c159d50 2023-10-06T04:40:29.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.808+0000 7f4082382700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407c16dd40 con 0x7f407c15a120 2023-10-06T04:40:29.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.808+0000 7f407bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f407c0b0e70 0x7f407c14e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:29.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.809+0000 7f407bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f407c0b0e70 0x7f407c14e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54656/0 (socket says 172.21.15.112:54656) 2023-10-06T04:40:29.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.809+0000 7f407bfff700 1 -- 172.21.15.112:0/2159577809 learned_addr learned my addr 172.21.15.112:0/2159577809 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:29.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.809+0000 7f408091f700 1 --2- 172.21.15.112:0/2159577809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f407c15a120 0x7f407c0a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:29.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.809+0000 7f407b7fe700 1 --2- 172.21.15.112:0/2159577809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f407c159d50 0x7f407c0a02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:29.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.809+0000 7f407bfff700 1 -- 172.21.15.112:0/2159577809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f407c15a120 msgr2=0x7f407c0a0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:29.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.809+0000 7f407bfff700 1 --2- 172.21.15.112:0/2159577809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f407c15a120 0x7f407c0a0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.809+0000 7f407bfff700 1 -- 172.21.15.112:0/2159577809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f407c159d50 msgr2=0x7f407c0a02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:29.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.809+0000 7f407bfff700 1 --2- 172.21.15.112:0/2159577809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f407c159d50 0x7f407c0a02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:29.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.809+0000 7f407bfff700 1 -- 172.21.15.112:0/2159577809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4074009ae0 con 0x7f407c0b0e70 2023-10-06T04:40:29.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.809+0000 7f407b7fe700 1 --2- 172.21.15.112:0/2159577809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f407c159d50 0x7f407c0a02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:29.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.809+0000 7f408091f700 1 --2- 172.21.15.112:0/2159577809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f407c15a120 0x7f407c0a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:29.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.809+0000 7f407bfff700 1 --2- 172.21.15.112:0/2159577809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f407c0b0e70 0x7f407c14e570 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f406c00c800 tx=0x7f406c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:29.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.809+0000 7f4063fff700 1 -- 172.21.15.112:0/2159577809 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c011600 con 0x7f407c0b0e70 2023-10-06T04:40:29.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.809+0000 7f4063fff700 1 -- 172.21.15.112:0/2159577809 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406c011760 con 0x7f407c0b0e70 2023-10-06T04:40:29.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.809+0000 7f4082382700 1 -- 172.21.15.112:0/2159577809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407c16abf0 con 0x7f407c0b0e70 2023-10-06T04:40:29.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.809+0000 7f4063fff700 1 -- 172.21.15.112:0/2159577809 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c011b20 con 0x7f407c0b0e70 2023-10-06T04:40:29.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.809+0000 7f4082382700 1 -- 172.21.15.112:0/2159577809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407c16d9d0 con 0x7f407c0b0e70 2023-10-06T04:40:29.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.810+0000 7f4082382700 1 -- 172.21.15.112:0/2159577809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407c16d550 con 0x7f407c0b0e70 2023-10-06T04:40:29.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.811+0000 7f4063fff700 1 -- 172.21.15.112:0/2159577809 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f406c0193f0 con 0x7f407c0b0e70 2023-10-06T04:40:29.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.811+0000 7f4063fff700 1 --2- 172.21.15.112:0/2159577809 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f40680670e0 0x7f4068069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:29.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.811+0000 7f4063fff700 1 -- 172.21.15.112:0/2159577809 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f406c084b90 con 0x7f407c0b0e70 2023-10-06T04:40:29.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.811+0000 7f407b7fe700 1 --2- 172.21.15.112:0/2159577809 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f40680670e0 0x7f4068069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:29.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.811+0000 7f407b7fe700 1 --2- 172.21.15.112:0/2159577809 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f40680670e0 0x7f4068069590 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4070006fd0 tx=0x7f4070008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:29.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:29.815+0000 7f4063fff700 1 -- 172.21.15.112:0/2159577809 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f407c16d550 con 0x7f407c0b0e70 2023-10-06T04:40:30.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:30.052+0000 7f4082382700 1 -- 172.21.15.112:0/2159577809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f407c16d550 con 0x7f407c0b0e70 2023-10-06T04:40:30.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:30.057+0000 7f4063fff700 1 -- 172.21.15.112:0/2159577809 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v6) v1 ==== 81+0+449961 (secure 0 0 0) 0x7f407c16d550 con 0x7f407c0b0e70 2023-10-06T04:40:30.065 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:30.065 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-10-06T04:40:30.065 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 6, 2023-10-06T04:40:30.065 INFO:teuthology.orchestra.run.smithi112.stdout: "active_gid": 4105, 2023-10-06T04:40:30.065 INFO:teuthology.orchestra.run.smithi112.stdout: "active_name": "y", 2023-10-06T04:40:30.065 INFO:teuthology.orchestra.run.smithi112.stdout: "active_addrs": { 2023-10-06T04:40:30.065 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2023-10-06T04:40:30.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.065 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2023-10-06T04:40:30.066 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6832", 2023-10-06T04:40:30.066 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 90409 2023-10-06T04:40:30.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.066 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2023-10-06T04:40:30.066 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6833", 2023-10-06T04:40:30.066 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 90409 2023-10-06T04:40:30.066 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.066 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2023-10-06T04:40:30.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.066 INFO:teuthology.orchestra.run.smithi112.stdout: "active_addr": "172.21.15.112:6833/90409", 2023-10-06T04:40:30.067 INFO:teuthology.orchestra.run.smithi112.stdout: "active_change": "2023-10-06T04:39:08.268958+0000", 2023-10-06T04:40:30.067 INFO:teuthology.orchestra.run.smithi112.stdout: "active_mgr_features": 4540138320759226367, 2023-10-06T04:40:30.067 INFO:teuthology.orchestra.run.smithi112.stdout: "available": true, 2023-10-06T04:40:30.067 INFO:teuthology.orchestra.run.smithi112.stdout: "standbys": [ 2023-10-06T04:40:30.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.067 INFO:teuthology.orchestra.run.smithi112.stdout: "gid": 4108, 2023-10-06T04:40:30.067 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "x", 2023-10-06T04:40:30.067 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_features": 4540138320759226367, 2023-10-06T04:40:30.067 INFO:teuthology.orchestra.run.smithi112.stdout: "available_modules": [ 2023-10-06T04:40:30.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.068 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "alerts", 2023-10-06T04:40:30.068 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.068 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.068 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.068 INFO:teuthology.orchestra.run.smithi112.stdout: "interval": { 2023-10-06T04:40:30.068 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "interval", 2023-10-06T04:40:30.068 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.068 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.068 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.068 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "60", 2023-10-06T04:40:30.068 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.069 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.069 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.069 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "How frequently to reexamine health status", 2023-10-06T04:40:30.069 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.069 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.069 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.069 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.069 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.069 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.069 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.069 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.070 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.070 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.070 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.070 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.070 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.070 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.070 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.070 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.070 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.070 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.070 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.071 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.071 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.071 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.071 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.071 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.071 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.071 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.071 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.071 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.071 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.072 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.072 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.072 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.072 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.072 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.072 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.072 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.072 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.072 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.072 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.073 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.073 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.073 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.073 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.073 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.073 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.073 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.073 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.073 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.073 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.073 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.073 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.074 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.074 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.074 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.074 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.074 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.074 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.074 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.074 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.074 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.074 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.075 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.075 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.075 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.075 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.075 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.075 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.075 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.075 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.075 INFO:teuthology.orchestra.run.smithi112.stdout: "smtp_destination": { 2023-10-06T04:40:30.075 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "smtp_destination", 2023-10-06T04:40:30.075 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.076 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.076 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.076 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.076 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.076 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.076 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.076 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Email address to send alerts to", 2023-10-06T04:40:30.076 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.076 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.077 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.077 INFO:teuthology.orchestra.run.smithi112.stdout: "smtp_from_name": { 2023-10-06T04:40:30.077 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "smtp_from_name", 2023-10-06T04:40:30.077 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.077 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.077 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.077 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "Ceph", 2023-10-06T04:40:30.077 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.078 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.078 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.078 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Email From: name", 2023-10-06T04:40:30.078 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.078 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.078 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.078 INFO:teuthology.orchestra.run.smithi112.stdout: "smtp_host": { 2023-10-06T04:40:30.078 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "smtp_host", 2023-10-06T04:40:30.078 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.078 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.078 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.079 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.079 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.079 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.079 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.079 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "SMTP server", 2023-10-06T04:40:30.079 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.079 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.079 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.079 INFO:teuthology.orchestra.run.smithi112.stdout: "smtp_password": { 2023-10-06T04:40:30.079 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "smtp_password", 2023-10-06T04:40:30.080 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.080 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.080 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.080 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.080 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.080 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.080 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.080 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Password to authenticate with", 2023-10-06T04:40:30.080 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.080 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.080 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.081 INFO:teuthology.orchestra.run.smithi112.stdout: "smtp_port": { 2023-10-06T04:40:30.081 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "smtp_port", 2023-10-06T04:40:30.081 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.081 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.081 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.081 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "465", 2023-10-06T04:40:30.081 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.081 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.081 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.081 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "SMTP port", 2023-10-06T04:40:30.081 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.081 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.082 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.082 INFO:teuthology.orchestra.run.smithi112.stdout: "smtp_sender": { 2023-10-06T04:40:30.082 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "smtp_sender", 2023-10-06T04:40:30.082 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.082 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.082 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.082 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.082 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.082 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.082 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.083 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "SMTP envelope sender", 2023-10-06T04:40:30.083 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.083 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.083 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.083 INFO:teuthology.orchestra.run.smithi112.stdout: "smtp_ssl": { 2023-10-06T04:40:30.083 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "smtp_ssl", 2023-10-06T04:40:30.083 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.083 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.083 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.084 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.084 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.084 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.084 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.084 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-06T04:40:30.084 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.084 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.084 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.084 INFO:teuthology.orchestra.run.smithi112.stdout: "smtp_user": { 2023-10-06T04:40:30.084 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "smtp_user", 2023-10-06T04:40:30.085 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.085 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.085 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.085 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.085 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.085 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.085 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.085 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "User to authenticate as", 2023-10-06T04:40:30.085 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.085 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.086 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.086 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.086 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.086 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "balancer", 2023-10-06T04:40:30.086 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.086 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.086 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.086 INFO:teuthology.orchestra.run.smithi112.stdout: "active": { 2023-10-06T04:40:30.086 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "active", 2023-10-06T04:40:30.086 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.087 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.087 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.087 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.087 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.087 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.087 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.087 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "automatically balance PGs across cluster", 2023-10-06T04:40:30.087 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.087 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.087 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.088 INFO:teuthology.orchestra.run.smithi112.stdout: "begin_time": { 2023-10-06T04:40:30.088 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "begin_time", 2023-10-06T04:40:30.088 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.088 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.088 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.088 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "0000", 2023-10-06T04:40:30.088 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.088 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.088 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.088 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "beginning time of day to automatically balance", 2023-10-06T04:40:30.088 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-06T04:40:30.089 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.089 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.089 INFO:teuthology.orchestra.run.smithi112.stdout: "begin_weekday": { 2023-10-06T04:40:30.089 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "begin_weekday", 2023-10-06T04:40:30.089 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "uint", 2023-10-06T04:40:30.089 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.089 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.089 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "0", 2023-10-06T04:40:30.089 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "0", 2023-10-06T04:40:30.090 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "7", 2023-10-06T04:40:30.090 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.090 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-06T04:40:30.090 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-10-06T04:40:30.090 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.090 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.090 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_compat_max_iterations": { 2023-10-06T04:40:30.090 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "crush_compat_max_iterations", 2023-10-06T04:40:30.091 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "uint", 2023-10-06T04:40:30.091 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.091 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.091 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "25", 2023-10-06T04:40:30.091 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "1", 2023-10-06T04:40:30.091 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "250", 2023-10-06T04:40:30.091 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.091 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-06T04:40:30.091 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.091 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.091 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.092 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_compat_metrics": { 2023-10-06T04:40:30.092 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "crush_compat_metrics", 2023-10-06T04:40:30.092 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.092 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.092 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.092 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "pgs,objects,bytes", 2023-10-06T04:40:30.092 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.093 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.093 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.093 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-06T04:40:30.093 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-06T04:40:30.093 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.093 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.093 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_compat_step": { 2023-10-06T04:40:30.093 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "crush_compat_step", 2023-10-06T04:40:30.093 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "float", 2023-10-06T04:40:30.093 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.093 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.094 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "0.5", 2023-10-06T04:40:30.094 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "0.001", 2023-10-06T04:40:30.094 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "0.999", 2023-10-06T04:40:30.094 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.094 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "aggressiveness of optimization", 2023-10-06T04:40:30.094 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-06T04:40:30.094 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.094 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.095 INFO:teuthology.orchestra.run.smithi112.stdout: "end_time": { 2023-10-06T04:40:30.095 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "end_time", 2023-10-06T04:40:30.095 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.095 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.095 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.095 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "2400", 2023-10-06T04:40:30.095 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.095 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.095 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.096 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "ending time of day to automatically balance", 2023-10-06T04:40:30.096 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-06T04:40:30.096 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.096 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.096 INFO:teuthology.orchestra.run.smithi112.stdout: "end_weekday": { 2023-10-06T04:40:30.096 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "end_weekday", 2023-10-06T04:40:30.096 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "uint", 2023-10-06T04:40:30.096 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.097 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.097 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "7", 2023-10-06T04:40:30.097 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "0", 2023-10-06T04:40:30.097 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "7", 2023-10-06T04:40:30.097 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.097 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-06T04:40:30.097 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-10-06T04:40:30.097 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.097 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.098 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.098 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.098 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.098 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.098 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.098 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.098 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.098 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.098 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.098 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.099 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.099 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.099 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.099 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.099 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.099 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.099 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.099 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.099 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.099 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.100 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.100 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.100 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.100 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.100 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.100 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.100 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.100 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.100 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.100 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.101 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.101 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.101 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.101 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.101 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.101 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.101 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.101 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.101 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.101 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.101 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.102 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.102 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.102 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.102 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.102 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.102 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.102 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.102 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.102 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.102 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.102 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.103 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.103 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.103 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.103 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.103 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.103 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.103 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.103 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.103 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.104 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.104 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.104 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.104 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.104 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.104 INFO:teuthology.orchestra.run.smithi112.stdout: "min_score": { 2023-10-06T04:40:30.104 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "min_score", 2023-10-06T04:40:30.104 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "float", 2023-10-06T04:40:30.104 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.105 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.105 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "0", 2023-10-06T04:40:30.105 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.105 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.105 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.105 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-06T04:40:30.105 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.105 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.105 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.105 INFO:teuthology.orchestra.run.smithi112.stdout: "mode": { 2023-10-06T04:40:30.105 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "mode", 2023-10-06T04:40:30.106 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.106 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.106 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.106 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "upmap", 2023-10-06T04:40:30.106 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.106 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.106 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.106 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-compat", 2023-10-06T04:40:30.106 INFO:teuthology.orchestra.run.smithi112.stdout: "none", 2023-10-06T04:40:30.106 INFO:teuthology.orchestra.run.smithi112.stdout: "upmap" 2023-10-06T04:40:30.106 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.107 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Balancer mode", 2023-10-06T04:40:30.107 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.107 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.107 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.107 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_ids": { 2023-10-06T04:40:30.107 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "pool_ids", 2023-10-06T04:40:30.107 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.107 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.107 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.107 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.107 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.108 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.108 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.108 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-06T04:40:30.108 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.108 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.108 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.108 INFO:teuthology.orchestra.run.smithi112.stdout: "sleep_interval": { 2023-10-06T04:40:30.108 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "sleep_interval", 2023-10-06T04:40:30.108 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.108 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.109 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.109 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "60", 2023-10-06T04:40:30.109 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.109 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.109 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.109 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-06T04:40:30.109 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.109 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.109 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.109 INFO:teuthology.orchestra.run.smithi112.stdout: "upmap_max_deviation": { 2023-10-06T04:40:30.110 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "upmap_max_deviation", 2023-10-06T04:40:30.110 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.110 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.110 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.110 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "5", 2023-10-06T04:40:30.110 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "1", 2023-10-06T04:40:30.110 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.110 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.110 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-06T04:40:30.110 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-06T04:40:30.111 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.111 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.111 INFO:teuthology.orchestra.run.smithi112.stdout: "upmap_max_optimizations": { 2023-10-06T04:40:30.111 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "upmap_max_optimizations", 2023-10-06T04:40:30.111 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "uint", 2023-10-06T04:40:30.111 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.111 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.111 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "10", 2023-10-06T04:40:30.111 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.111 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.111 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.112 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-06T04:40:30.112 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.112 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.112 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.112 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.112 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.112 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "cephadm", 2023-10-06T04:40:30.112 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.112 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.113 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.113 INFO:teuthology.orchestra.run.smithi112.stdout: "agent_down_multiplier": { 2023-10-06T04:40:30.113 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "agent_down_multiplier", 2023-10-06T04:40:30.113 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "float", 2023-10-06T04:40:30.113 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.113 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.113 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "3.0", 2023-10-06T04:40:30.113 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.113 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.113 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.113 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-06T04:40:30.114 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.114 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.114 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.114 INFO:teuthology.orchestra.run.smithi112.stdout: "agent_refresh_rate": { 2023-10-06T04:40:30.114 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "agent_refresh_rate", 2023-10-06T04:40:30.114 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.114 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.114 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.114 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "20", 2023-10-06T04:40:30.115 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.115 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.115 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.115 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-06T04:40:30.115 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.115 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.115 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.115 INFO:teuthology.orchestra.run.smithi112.stdout: "agent_starting_port": { 2023-10-06T04:40:30.115 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "agent_starting_port", 2023-10-06T04:40:30.115 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.116 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.116 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.116 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "4721", 2023-10-06T04:40:30.116 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.116 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.116 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.116 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-06T04:40:30.116 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.116 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.116 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.117 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_ptrace": { 2023-10-06T04:40:30.117 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "allow_ptrace", 2023-10-06T04:40:30.117 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.117 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.117 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.117 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.117 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.117 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.117 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.117 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-06T04:40:30.117 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-06T04:40:30.118 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.118 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.118 INFO:teuthology.orchestra.run.smithi112.stdout: "autotune_interval": { 2023-10-06T04:40:30.118 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "autotune_interval", 2023-10-06T04:40:30.118 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.118 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.118 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.118 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "600", 2023-10-06T04:40:30.118 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.118 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.119 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.119 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-06T04:40:30.119 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.119 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.119 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.119 INFO:teuthology.orchestra.run.smithi112.stdout: "autotune_memory_target_ratio": { 2023-10-06T04:40:30.119 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "autotune_memory_target_ratio", 2023-10-06T04:40:30.119 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "float", 2023-10-06T04:40:30.119 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.119 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.120 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "0.7", 2023-10-06T04:40:30.120 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.120 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.120 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.120 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-06T04:40:30.120 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.120 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.120 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.120 INFO:teuthology.orchestra.run.smithi112.stdout: "cgroups_split": { 2023-10-06T04:40:30.120 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "cgroups_split", 2023-10-06T04:40:30.120 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.121 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.121 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.121 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.121 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.121 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.121 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.121 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-06T04:40:30.121 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.121 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.121 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.122 INFO:teuthology.orchestra.run.smithi112.stdout: "config_checks_enabled": { 2023-10-06T04:40:30.122 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "config_checks_enabled", 2023-10-06T04:40:30.122 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.122 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.122 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.122 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.122 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.122 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.122 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.122 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-06T04:40:30.123 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.123 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.123 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.123 INFO:teuthology.orchestra.run.smithi112.stdout: "config_dashboard": { 2023-10-06T04:40:30.123 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "config_dashboard", 2023-10-06T04:40:30.123 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.123 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.123 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.123 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.123 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.124 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.124 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.124 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-06T04:40:30.124 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.124 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.124 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.124 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image_alertmanager": { 2023-10-06T04:40:30.124 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_image_alertmanager", 2023-10-06T04:40:30.124 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.125 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.125 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.125 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-06T04:40:30.125 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.125 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.125 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.125 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Prometheus container image", 2023-10-06T04:40:30.125 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.125 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.125 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.126 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image_base": { 2023-10-06T04:40:30.126 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_image_base", 2023-10-06T04:40:30.126 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.126 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.126 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.126 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-06T04:40:30.126 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.126 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.126 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.127 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Container image name, without the tag", 2023-10-06T04:40:30.127 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.127 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.127 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.127 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image_grafana": { 2023-10-06T04:40:30.127 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_image_grafana", 2023-10-06T04:40:30.127 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.127 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.127 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.127 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-06T04:40:30.128 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.128 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.128 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.128 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Prometheus container image", 2023-10-06T04:40:30.128 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.128 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.128 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.128 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image_haproxy": { 2023-10-06T04:40:30.128 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_image_haproxy", 2023-10-06T04:40:30.128 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.129 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.129 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.129 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-06T04:40:30.129 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.129 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.129 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.129 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "HAproxy container image", 2023-10-06T04:40:30.129 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.129 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.129 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.130 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image_keepalived": { 2023-10-06T04:40:30.130 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_image_keepalived", 2023-10-06T04:40:30.130 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.130 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.130 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.130 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "quay.io/ceph/keepalived:2.1.5", 2023-10-06T04:40:30.130 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.130 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.130 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.130 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Keepalived container image", 2023-10-06T04:40:30.130 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.131 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.131 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.131 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image_loki": { 2023-10-06T04:40:30.131 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_image_loki", 2023-10-06T04:40:30.131 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.131 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.131 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.132 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-06T04:40:30.132 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.132 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.132 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.132 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Loki container image", 2023-10-06T04:40:30.132 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.132 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.132 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.132 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image_node_exporter": { 2023-10-06T04:40:30.132 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_image_node_exporter", 2023-10-06T04:40:30.133 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.133 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.133 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.133 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-06T04:40:30.133 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.133 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.133 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.133 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Prometheus container image", 2023-10-06T04:40:30.133 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.133 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.133 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.134 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image_prometheus": { 2023-10-06T04:40:30.134 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_image_prometheus", 2023-10-06T04:40:30.134 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.134 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.134 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.134 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-06T04:40:30.134 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.134 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.134 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.134 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Prometheus container image", 2023-10-06T04:40:30.135 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.135 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.135 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.135 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image_promtail": { 2023-10-06T04:40:30.135 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_image_promtail", 2023-10-06T04:40:30.135 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.135 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.135 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.135 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-06T04:40:30.135 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.136 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.136 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.136 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Promtail container image", 2023-10-06T04:40:30.136 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.136 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.136 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.136 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image_snmp_gateway": { 2023-10-06T04:40:30.136 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_image_snmp_gateway", 2023-10-06T04:40:30.136 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.136 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.136 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.137 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-06T04:40:30.137 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.137 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.137 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.137 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "SNMP Gateway container image", 2023-10-06T04:40:30.137 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.137 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.137 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.137 INFO:teuthology.orchestra.run.smithi112.stdout: "container_init": { 2023-10-06T04:40:30.138 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_init", 2023-10-06T04:40:30.138 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.138 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.138 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.138 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.138 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.138 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.138 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.138 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Run podman/docker with `--init`", 2023-10-06T04:40:30.138 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.138 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.139 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.139 INFO:teuthology.orchestra.run.smithi112.stdout: "daemon_cache_timeout": { 2023-10-06T04:40:30.139 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "daemon_cache_timeout", 2023-10-06T04:40:30.139 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.139 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.139 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.139 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "600", 2023-10-06T04:40:30.139 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.139 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.139 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.140 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-06T04:40:30.140 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.140 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.140 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.140 INFO:teuthology.orchestra.run.smithi112.stdout: "default_cephadm_command_timeout": { 2023-10-06T04:40:30.140 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "default_cephadm_command_timeout", 2023-10-06T04:40:30.140 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.140 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.140 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.140 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "900", 2023-10-06T04:40:30.141 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.141 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.141 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.141 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-06T04:40:30.141 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.141 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.141 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.141 INFO:teuthology.orchestra.run.smithi112.stdout: "default_registry": { 2023-10-06T04:40:30.141 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "default_registry", 2023-10-06T04:40:30.141 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.141 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.142 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.142 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "docker.io", 2023-10-06T04:40:30.142 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.142 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.142 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.142 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-06T04:40:30.142 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.142 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.142 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.142 INFO:teuthology.orchestra.run.smithi112.stdout: "device_cache_timeout": { 2023-10-06T04:40:30.143 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "device_cache_timeout", 2023-10-06T04:40:30.143 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.143 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.143 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.143 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "1800", 2023-10-06T04:40:30.143 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.143 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.143 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.143 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "seconds to cache device inventory", 2023-10-06T04:40:30.143 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.143 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.144 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.144 INFO:teuthology.orchestra.run.smithi112.stdout: "device_enhanced_scan": { 2023-10-06T04:40:30.144 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "device_enhanced_scan", 2023-10-06T04:40:30.144 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.144 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.144 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.144 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.144 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.144 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.144 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.144 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-06T04:40:30.145 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.145 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.145 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.145 INFO:teuthology.orchestra.run.smithi112.stdout: "facts_cache_timeout": { 2023-10-06T04:40:30.145 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "facts_cache_timeout", 2023-10-06T04:40:30.145 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.145 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.145 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.145 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "60", 2023-10-06T04:40:30.145 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.146 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.146 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.146 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "seconds to cache host facts data", 2023-10-06T04:40:30.146 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.146 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.146 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.146 INFO:teuthology.orchestra.run.smithi112.stdout: "host_check_interval": { 2023-10-06T04:40:30.146 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "host_check_interval", 2023-10-06T04:40:30.146 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.146 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.146 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.147 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "600", 2023-10-06T04:40:30.147 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.147 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.147 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.147 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "how frequently to perform a host check", 2023-10-06T04:40:30.147 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.147 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.147 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.147 INFO:teuthology.orchestra.run.smithi112.stdout: "inventory_list_all": { 2023-10-06T04:40:30.147 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "inventory_list_all", 2023-10-06T04:40:30.148 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.148 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.148 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.148 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.148 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.148 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.148 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.148 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-06T04:40:30.148 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.148 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.148 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.149 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.149 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.149 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.149 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.149 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.149 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.149 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.149 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.149 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.149 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.149 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.150 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.150 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.150 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.150 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.150 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.150 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.150 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.150 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.150 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.150 INFO:teuthology.orchestra.run.smithi112.stdout: "log_refresh_metadata": { 2023-10-06T04:40:30.150 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_refresh_metadata", 2023-10-06T04:40:30.151 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.151 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.151 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.151 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.151 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.151 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.151 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.151 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-06T04:40:30.151 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.151 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.151 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.152 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.152 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.152 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.152 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.152 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.152 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.152 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.152 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.152 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.152 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-06T04:40:30.152 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.153 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.153 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.153 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.153 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.153 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.153 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.153 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.153 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.153 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.153 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.153 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.154 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.154 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.154 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.154 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.154 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.154 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.154 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.154 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.154 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.154 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.154 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.155 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.155 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.155 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.155 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.155 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.155 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.155 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.155 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.155 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.155 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.155 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.156 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.156 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.156 INFO:teuthology.orchestra.run.smithi112.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-06T04:40:30.156 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-06T04:40:30.156 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.156 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.156 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.156 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.156 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.156 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.156 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.157 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-06T04:40:30.157 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.157 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.157 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.157 INFO:teuthology.orchestra.run.smithi112.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-06T04:40:30.157 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-06T04:40:30.157 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.157 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.157 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.157 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "*", 2023-10-06T04:40:30.158 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.158 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.158 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.158 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-06T04:40:30.158 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.158 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.158 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.158 INFO:teuthology.orchestra.run.smithi112.stdout: "max_count_per_host": { 2023-10-06T04:40:30.158 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "max_count_per_host", 2023-10-06T04:40:30.158 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.158 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.159 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.159 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "10", 2023-10-06T04:40:30.159 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.159 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.159 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.159 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "max number of daemons per service per host", 2023-10-06T04:40:30.159 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.159 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.159 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.159 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd_draining_count": { 2023-10-06T04:40:30.159 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "max_osd_draining_count", 2023-10-06T04:40:30.160 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.160 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.160 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.160 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "10", 2023-10-06T04:40:30.160 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.160 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.160 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.160 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-06T04:40:30.160 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.160 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.160 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.161 INFO:teuthology.orchestra.run.smithi112.stdout: "migration_current": { 2023-10-06T04:40:30.161 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "migration_current", 2023-10-06T04:40:30.161 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.161 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.161 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.161 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.161 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.161 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.161 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.161 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "internal - do not modify", 2023-10-06T04:40:30.161 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.161 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.162 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.162 INFO:teuthology.orchestra.run.smithi112.stdout: "mode": { 2023-10-06T04:40:30.162 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "mode", 2023-10-06T04:40:30.162 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.162 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.162 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.162 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "root", 2023-10-06T04:40:30.162 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.162 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.162 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.163 INFO:teuthology.orchestra.run.smithi112.stdout: "cephadm-package", 2023-10-06T04:40:30.163 INFO:teuthology.orchestra.run.smithi112.stdout: "root" 2023-10-06T04:40:30.163 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.163 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "mode for remote execution of cephadm", 2023-10-06T04:40:30.163 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.163 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.163 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.163 INFO:teuthology.orchestra.run.smithi112.stdout: "prometheus_alerts_path": { 2023-10-06T04:40:30.163 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "prometheus_alerts_path", 2023-10-06T04:40:30.163 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.163 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.164 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.164 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-06T04:40:30.164 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.164 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.164 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.164 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-06T04:40:30.164 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.164 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.164 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.164 INFO:teuthology.orchestra.run.smithi112.stdout: "registry_insecure": { 2023-10-06T04:40:30.164 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "registry_insecure", 2023-10-06T04:40:30.165 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.165 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.165 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.165 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.165 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.165 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.165 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.165 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-06T04:40:30.165 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.165 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.165 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.166 INFO:teuthology.orchestra.run.smithi112.stdout: "registry_password": { 2023-10-06T04:40:30.166 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "registry_password", 2023-10-06T04:40:30.166 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.166 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.166 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.166 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.166 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.166 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.166 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.166 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-06T04:40:30.166 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.167 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.167 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.167 INFO:teuthology.orchestra.run.smithi112.stdout: "registry_url": { 2023-10-06T04:40:30.167 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "registry_url", 2023-10-06T04:40:30.167 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.167 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.167 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.167 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.167 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.167 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.167 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.168 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-06T04:40:30.168 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.168 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.168 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.168 INFO:teuthology.orchestra.run.smithi112.stdout: "registry_username": { 2023-10-06T04:40:30.168 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "registry_username", 2023-10-06T04:40:30.168 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.168 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.168 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.168 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.168 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.169 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.169 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.169 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-06T04:40:30.169 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.169 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.169 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.169 INFO:teuthology.orchestra.run.smithi112.stdout: "ssh_config_file": { 2023-10-06T04:40:30.169 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "ssh_config_file", 2023-10-06T04:40:30.169 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.169 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.169 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.170 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.170 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.170 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.170 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.170 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-06T04:40:30.170 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.170 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.170 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.170 INFO:teuthology.orchestra.run.smithi112.stdout: "use_agent": { 2023-10-06T04:40:30.170 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "use_agent", 2023-10-06T04:40:30.171 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.171 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.171 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.171 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.171 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.171 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.171 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.171 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-06T04:40:30.171 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.171 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.171 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.172 INFO:teuthology.orchestra.run.smithi112.stdout: "use_repo_digest": { 2023-10-06T04:40:30.172 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "use_repo_digest", 2023-10-06T04:40:30.172 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.172 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.172 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.172 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.172 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.172 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.172 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.172 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-06T04:40:30.173 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.173 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.173 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.173 INFO:teuthology.orchestra.run.smithi112.stdout: "warn_on_failed_host_check": { 2023-10-06T04:40:30.173 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "warn_on_failed_host_check", 2023-10-06T04:40:30.173 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.173 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.173 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.173 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.174 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.174 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.174 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.174 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "raise a health warning if the host check fails", 2023-10-06T04:40:30.174 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.174 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.174 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.174 INFO:teuthology.orchestra.run.smithi112.stdout: "warn_on_stray_daemons": { 2023-10-06T04:40:30.174 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "warn_on_stray_daemons", 2023-10-06T04:40:30.174 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.174 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.175 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.175 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.175 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.175 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.175 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.175 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-06T04:40:30.175 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.175 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.175 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.175 INFO:teuthology.orchestra.run.smithi112.stdout: "warn_on_stray_hosts": { 2023-10-06T04:40:30.175 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "warn_on_stray_hosts", 2023-10-06T04:40:30.176 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.176 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.176 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.176 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.176 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.176 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.176 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.176 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-06T04:40:30.176 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.176 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.176 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.176 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.176 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.177 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "crash", 2023-10-06T04:40:30.177 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.177 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.177 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.177 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.177 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.177 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.177 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.177 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.178 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.178 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.178 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.178 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.178 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.178 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.178 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.178 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.178 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.178 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.178 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.178 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.179 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.179 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.179 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.179 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.179 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.179 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.179 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.179 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.179 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.179 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.179 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.180 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.180 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.180 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.180 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.180 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.180 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.180 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.180 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.180 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.180 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.181 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.181 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.181 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.181 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.181 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.181 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.181 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.181 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.181 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.181 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.181 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.181 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.182 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.182 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.182 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.182 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.182 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.182 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.182 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.182 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.182 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.183 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.183 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.183 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.183 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.183 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.183 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.183 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.183 INFO:teuthology.orchestra.run.smithi112.stdout: "retain_interval": { 2023-10-06T04:40:30.183 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "retain_interval", 2023-10-06T04:40:30.183 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.183 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.184 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.184 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "31536000", 2023-10-06T04:40:30.184 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.184 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.184 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.184 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-06T04:40:30.184 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.184 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.184 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.184 INFO:teuthology.orchestra.run.smithi112.stdout: "warn_recent_interval": { 2023-10-06T04:40:30.184 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "warn_recent_interval", 2023-10-06T04:40:30.185 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.185 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.185 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.185 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "1209600", 2023-10-06T04:40:30.185 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.185 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.185 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.185 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-06T04:40:30.185 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.185 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.185 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.185 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.186 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.186 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "dashboard", 2023-10-06T04:40:30.186 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.186 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.186 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.186 INFO:teuthology.orchestra.run.smithi112.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-06T04:40:30.186 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-06T04:40:30.186 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.186 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.186 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.187 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "10", 2023-10-06T04:40:30.187 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.187 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.187 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.187 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.187 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.187 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.187 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.187 INFO:teuthology.orchestra.run.smithi112.stdout: "ALERTMANAGER_API_HOST": { 2023-10-06T04:40:30.187 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-06T04:40:30.188 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.188 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.188 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.188 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.188 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.188 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.188 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.188 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.188 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.188 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.188 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.188 INFO:teuthology.orchestra.run.smithi112.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-06T04:40:30.189 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-06T04:40:30.189 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.189 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.189 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.189 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.189 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.189 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.189 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.189 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.189 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.189 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.190 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.190 INFO:teuthology.orchestra.run.smithi112.stdout: "AUDIT_API_ENABLED": { 2023-10-06T04:40:30.190 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "AUDIT_API_ENABLED", 2023-10-06T04:40:30.190 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.190 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.190 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.190 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.190 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.190 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.190 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.191 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.191 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.191 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.191 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.191 INFO:teuthology.orchestra.run.smithi112.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-06T04:40:30.191 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-06T04:40:30.191 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.191 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.191 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.191 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.191 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.192 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.192 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.192 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.192 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.192 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.192 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.193 INFO:teuthology.orchestra.run.smithi112.stdout: "ENABLE_BROWSABLE_API": { 2023-10-06T04:40:30.193 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-06T04:40:30.193 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.193 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.193 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.193 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.193 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.193 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.193 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.193 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.193 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.194 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.194 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.194 INFO:teuthology.orchestra.run.smithi112.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-06T04:40:30.194 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-06T04:40:30.194 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.194 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.194 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.194 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.195 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.195 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.195 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.195 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.195 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.195 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.195 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.195 INFO:teuthology.orchestra.run.smithi112.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-06T04:40:30.195 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-06T04:40:30.195 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.196 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.196 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.196 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.196 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.196 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.196 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.196 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.196 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.196 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.196 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.197 INFO:teuthology.orchestra.run.smithi112.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-06T04:40:30.197 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-06T04:40:30.197 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.197 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.197 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.197 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.197 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.197 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.197 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.198 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.198 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.198 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.198 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.198 INFO:teuthology.orchestra.run.smithi112.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-06T04:40:30.198 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-06T04:40:30.198 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.198 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.198 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.199 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.199 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.199 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.199 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.199 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.199 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.199 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.199 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.200 INFO:teuthology.orchestra.run.smithi112.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-06T04:40:30.200 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-06T04:40:30.200 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.200 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.200 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.200 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.200 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.200 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.200 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.200 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.201 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.201 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.201 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.201 INFO:teuthology.orchestra.run.smithi112.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-06T04:40:30.201 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-06T04:40:30.201 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.201 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.201 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.201 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.202 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.202 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.202 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.202 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.202 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.202 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.202 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.202 INFO:teuthology.orchestra.run.smithi112.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-06T04:40:30.202 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-06T04:40:30.202 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.202 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.203 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.203 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.203 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.203 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.203 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.203 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.203 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.203 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.203 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.203 INFO:teuthology.orchestra.run.smithi112.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-06T04:40:30.204 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-06T04:40:30.204 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.204 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.204 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.204 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.204 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.204 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.204 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.204 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.204 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.204 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.204 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.205 INFO:teuthology.orchestra.run.smithi112.stdout: "GRAFANA_API_PASSWORD": { 2023-10-06T04:40:30.205 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-06T04:40:30.205 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.205 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.205 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.205 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "admin", 2023-10-06T04:40:30.205 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.205 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.205 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.205 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.205 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.206 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.206 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.206 INFO:teuthology.orchestra.run.smithi112.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-06T04:40:30.206 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-06T04:40:30.206 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.206 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.206 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.206 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.207 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.207 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.207 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.207 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.207 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.207 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.207 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.207 INFO:teuthology.orchestra.run.smithi112.stdout: "GRAFANA_API_URL": { 2023-10-06T04:40:30.207 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "GRAFANA_API_URL", 2023-10-06T04:40:30.207 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.208 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.208 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.208 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.208 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.208 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.208 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.208 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.208 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.208 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.208 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.208 INFO:teuthology.orchestra.run.smithi112.stdout: "GRAFANA_API_USERNAME": { 2023-10-06T04:40:30.209 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-06T04:40:30.209 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.209 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.209 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.209 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "admin", 2023-10-06T04:40:30.209 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.209 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.209 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.209 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.209 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.209 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.210 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.210 INFO:teuthology.orchestra.run.smithi112.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-06T04:40:30.210 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-06T04:40:30.210 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.210 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.210 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.210 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.210 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.210 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.210 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.210 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.211 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.211 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.211 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.211 INFO:teuthology.orchestra.run.smithi112.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-06T04:40:30.211 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-06T04:40:30.211 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.211 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.211 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.211 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.212 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.212 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.212 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.212 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.212 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.212 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.212 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.212 INFO:teuthology.orchestra.run.smithi112.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-06T04:40:30.212 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-06T04:40:30.212 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.213 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.213 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.213 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.213 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.213 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.213 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.213 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.213 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.213 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.213 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.214 INFO:teuthology.orchestra.run.smithi112.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-06T04:40:30.214 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-06T04:40:30.214 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.214 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.214 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.214 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.214 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.214 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.214 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.214 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.215 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.215 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.215 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.215 INFO:teuthology.orchestra.run.smithi112.stdout: "PROMETHEUS_API_HOST": { 2023-10-06T04:40:30.215 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-06T04:40:30.215 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.215 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.215 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.215 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.215 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.216 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.216 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.216 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.216 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.216 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.216 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.216 INFO:teuthology.orchestra.run.smithi112.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-06T04:40:30.216 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-06T04:40:30.216 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.216 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.217 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.217 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.217 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.217 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.217 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.217 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.217 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.217 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.217 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.218 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-06T04:40:30.218 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-06T04:40:30.218 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.218 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.218 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.218 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.218 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.218 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.218 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.218 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.218 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.219 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.219 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.219 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-06T04:40:30.219 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-06T04:40:30.219 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.219 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.219 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.219 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.219 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.219 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.220 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.220 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.220 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.220 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.220 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.220 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-06T04:40:30.220 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-06T04:40:30.220 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.220 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.221 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.221 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.221 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.221 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.221 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.221 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.221 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.221 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.221 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.222 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-06T04:40:30.222 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-06T04:40:30.222 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.222 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.222 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.222 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.222 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.222 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.222 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.222 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.223 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.223 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.223 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.223 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-06T04:40:30.223 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-06T04:40:30.223 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.223 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.223 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.223 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.223 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.223 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.224 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.224 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.224 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.224 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.224 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.224 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-06T04:40:30.224 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-06T04:40:30.224 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.224 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.224 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.225 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.225 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.225 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.225 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.225 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.225 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.225 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.225 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.225 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-06T04:40:30.226 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-06T04:40:30.226 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.226 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.226 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.226 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.226 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.226 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.226 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.226 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.226 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.227 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.227 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.227 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_ENABLED": { 2023-10-06T04:40:30.227 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-06T04:40:30.227 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.227 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.227 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.227 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.227 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.227 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.228 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.228 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.228 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.228 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.228 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.228 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-06T04:40:30.228 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-06T04:40:30.228 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.228 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.228 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.229 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-06T04:40:30.229 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.229 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.229 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.229 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.229 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.229 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.229 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.229 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-06T04:40:30.229 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-06T04:40:30.230 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.230 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.230 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.230 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "10", 2023-10-06T04:40:30.230 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.230 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.230 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.230 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.230 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.230 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.231 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.231 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-06T04:40:30.231 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-06T04:40:30.231 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.231 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.231 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.231 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "8", 2023-10-06T04:40:30.231 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.231 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.231 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.232 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.232 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.232 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.232 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.232 INFO:teuthology.orchestra.run.smithi112.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-06T04:40:30.232 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-06T04:40:30.232 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.232 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.232 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.232 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "45", 2023-10-06T04:40:30.233 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.233 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.233 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.233 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.233 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.233 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.233 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.233 INFO:teuthology.orchestra.run.smithi112.stdout: "RGW_API_ACCESS_KEY": { 2023-10-06T04:40:30.233 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-06T04:40:30.233 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.234 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.234 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.234 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.234 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.234 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.234 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.234 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.234 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.234 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.234 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.234 INFO:teuthology.orchestra.run.smithi112.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-06T04:40:30.235 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-06T04:40:30.235 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.235 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.235 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.235 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "admin", 2023-10-06T04:40:30.235 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.235 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.235 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.235 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.235 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.235 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.236 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.236 INFO:teuthology.orchestra.run.smithi112.stdout: "RGW_API_SECRET_KEY": { 2023-10-06T04:40:30.236 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-06T04:40:30.236 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.236 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.236 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.236 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.236 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.236 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.236 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.236 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.237 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.237 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.237 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.237 INFO:teuthology.orchestra.run.smithi112.stdout: "RGW_API_SSL_VERIFY": { 2023-10-06T04:40:30.237 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-06T04:40:30.237 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.237 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.237 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.237 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.237 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.237 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.238 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.238 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.238 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.238 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.238 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.238 INFO:teuthology.orchestra.run.smithi112.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-06T04:40:30.238 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-06T04:40:30.238 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.238 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.238 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.238 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "0", 2023-10-06T04:40:30.239 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.239 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.239 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.239 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.239 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.239 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.239 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.239 INFO:teuthology.orchestra.run.smithi112.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-06T04:40:30.239 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-06T04:40:30.239 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.239 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.240 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.240 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "10", 2023-10-06T04:40:30.240 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.240 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.240 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.240 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.240 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.240 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.240 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.240 INFO:teuthology.orchestra.run.smithi112.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-06T04:40:30.240 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-06T04:40:30.241 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.241 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.241 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.241 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "5", 2023-10-06T04:40:30.241 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.241 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.241 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.241 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.241 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.241 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.241 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.242 INFO:teuthology.orchestra.run.smithi112.stdout: "cross_origin_url": { 2023-10-06T04:40:30.242 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "cross_origin_url", 2023-10-06T04:40:30.242 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.242 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.242 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.242 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.242 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.242 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.242 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.242 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.242 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.242 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.243 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.243 INFO:teuthology.orchestra.run.smithi112.stdout: "crt_file": { 2023-10-06T04:40:30.243 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "crt_file", 2023-10-06T04:40:30.243 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.243 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.243 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.243 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.243 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.243 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.243 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.245 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.245 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.245 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.245 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.245 INFO:teuthology.orchestra.run.smithi112.stdout: "debug": { 2023-10-06T04:40:30.245 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "debug", 2023-10-06T04:40:30.245 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.245 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.246 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.246 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.246 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.246 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.246 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.246 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Enable/disable debug options", 2023-10-06T04:40:30.246 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.246 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.246 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.247 INFO:teuthology.orchestra.run.smithi112.stdout: "jwt_token_ttl": { 2023-10-06T04:40:30.247 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "jwt_token_ttl", 2023-10-06T04:40:30.247 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.247 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.247 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.247 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "28800", 2023-10-06T04:40:30.247 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.247 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.247 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.247 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.247 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.248 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.248 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.248 INFO:teuthology.orchestra.run.smithi112.stdout: "key_file": { 2023-10-06T04:40:30.248 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "key_file", 2023-10-06T04:40:30.248 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.248 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.248 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.248 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.248 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.248 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.248 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.249 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.249 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.249 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.249 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.249 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.249 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.249 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.249 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.249 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.249 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.249 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.250 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.250 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.250 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.250 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.250 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.250 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.250 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.250 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.250 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.250 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.250 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.250 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.251 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.251 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.251 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.251 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.251 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.251 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.251 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.251 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.251 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.251 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.252 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.252 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.252 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.252 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.252 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.252 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.252 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.252 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.252 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.252 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.252 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.253 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.253 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.253 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.253 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.253 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.253 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.253 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.253 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.253 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.253 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.253 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.253 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.254 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.254 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.254 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.254 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.254 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.254 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.254 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.254 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.254 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.254 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.255 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.255 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.255 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.255 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.255 INFO:teuthology.orchestra.run.smithi112.stdout: "motd": { 2023-10-06T04:40:30.255 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "motd", 2023-10-06T04:40:30.255 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.255 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.255 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.255 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.255 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.256 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.256 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.256 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "The message of the day", 2023-10-06T04:40:30.256 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.256 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.256 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.256 INFO:teuthology.orchestra.run.smithi112.stdout: "redirect_resolve_ip_addr": { 2023-10-06T04:40:30.256 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "redirect_resolve_ip_addr", 2023-10-06T04:40:30.256 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.256 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.257 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.257 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.257 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.257 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.257 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.257 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.257 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.257 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.257 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.257 INFO:teuthology.orchestra.run.smithi112.stdout: "server_addr": { 2023-10-06T04:40:30.258 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "server_addr", 2023-10-06T04:40:30.258 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.258 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.258 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.258 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "::", 2023-10-06T04:40:30.258 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.258 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.258 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.258 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.258 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.258 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.259 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.259 INFO:teuthology.orchestra.run.smithi112.stdout: "server_port": { 2023-10-06T04:40:30.259 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "server_port", 2023-10-06T04:40:30.259 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.259 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.259 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.259 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "8080", 2023-10-06T04:40:30.259 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.259 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.259 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.259 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.260 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.260 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.260 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.260 INFO:teuthology.orchestra.run.smithi112.stdout: "ssl": { 2023-10-06T04:40:30.260 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "ssl", 2023-10-06T04:40:30.260 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.260 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.260 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.260 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.260 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.261 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.261 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.261 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.261 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.261 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.261 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.261 INFO:teuthology.orchestra.run.smithi112.stdout: "ssl_server_port": { 2023-10-06T04:40:30.261 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "ssl_server_port", 2023-10-06T04:40:30.261 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.262 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.262 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.262 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "8443", 2023-10-06T04:40:30.262 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.262 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.262 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.262 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.262 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.262 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.262 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.263 INFO:teuthology.orchestra.run.smithi112.stdout: "standby_behaviour": { 2023-10-06T04:40:30.263 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "standby_behaviour", 2023-10-06T04:40:30.263 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.263 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.263 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.263 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "redirect", 2023-10-06T04:40:30.263 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.263 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.263 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.263 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.263 INFO:teuthology.orchestra.run.smithi112.stdout: "redirect" 2023-10-06T04:40:30.263 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.264 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.264 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.264 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.264 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.264 INFO:teuthology.orchestra.run.smithi112.stdout: "standby_error_status_code": { 2023-10-06T04:40:30.264 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "standby_error_status_code", 2023-10-06T04:40:30.264 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.264 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.264 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.264 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "500", 2023-10-06T04:40:30.265 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "400", 2023-10-06T04:40:30.265 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "599", 2023-10-06T04:40:30.265 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.265 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.265 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.265 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.265 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.265 INFO:teuthology.orchestra.run.smithi112.stdout: "url_prefix": { 2023-10-06T04:40:30.265 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "url_prefix", 2023-10-06T04:40:30.265 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.265 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.266 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.266 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.266 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.266 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.266 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.266 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.266 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.266 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.266 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.266 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.266 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.267 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "devicehealth", 2023-10-06T04:40:30.267 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.267 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.267 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.267 INFO:teuthology.orchestra.run.smithi112.stdout: "enable_monitoring": { 2023-10-06T04:40:30.267 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "enable_monitoring", 2023-10-06T04:40:30.267 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.267 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.267 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.267 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.268 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.268 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.268 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.268 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "monitor device health metrics", 2023-10-06T04:40:30.268 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.268 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.268 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.268 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.268 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.268 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.269 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.269 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.269 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.269 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.269 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.269 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.269 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.269 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.269 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.269 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.269 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.270 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.270 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.270 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.270 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.270 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.270 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.270 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.270 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.271 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.271 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.271 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.271 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.271 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.271 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.271 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.271 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.271 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.271 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.271 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.272 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.272 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.272 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.272 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.272 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.272 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.272 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.272 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.272 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.272 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.272 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.273 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.273 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.273 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.273 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.273 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.273 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.273 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.273 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.273 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.273 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.274 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.274 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.274 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.274 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.274 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.274 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.274 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.274 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.274 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.274 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.274 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.274 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.275 INFO:teuthology.orchestra.run.smithi112.stdout: "mark_out_threshold": { 2023-10-06T04:40:30.275 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "mark_out_threshold", 2023-10-06T04:40:30.275 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.275 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.275 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.275 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "2419200", 2023-10-06T04:40:30.275 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.275 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.275 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.275 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-06T04:40:30.275 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.276 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.276 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.276 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": { 2023-10-06T04:40:30.276 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "pool_name", 2023-10-06T04:40:30.276 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.276 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.276 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.276 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "device_health_metrics", 2023-10-06T04:40:30.276 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.276 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.277 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.277 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-06T04:40:30.277 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.277 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.277 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.277 INFO:teuthology.orchestra.run.smithi112.stdout: "retention_period": { 2023-10-06T04:40:30.277 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "retention_period", 2023-10-06T04:40:30.277 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.277 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.277 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.278 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "15552000", 2023-10-06T04:40:30.278 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.278 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.278 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.278 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "how long to retain device health metrics", 2023-10-06T04:40:30.278 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.278 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.278 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.278 INFO:teuthology.orchestra.run.smithi112.stdout: "scrape_frequency": { 2023-10-06T04:40:30.278 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "scrape_frequency", 2023-10-06T04:40:30.279 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.279 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.279 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.279 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "86400", 2023-10-06T04:40:30.279 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.279 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.279 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.279 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-06T04:40:30.279 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.279 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.279 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.280 INFO:teuthology.orchestra.run.smithi112.stdout: "self_heal": { 2023-10-06T04:40:30.280 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "self_heal", 2023-10-06T04:40:30.280 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.280 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.280 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.280 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.280 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.280 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.280 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.280 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-06T04:40:30.280 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.281 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.281 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.281 INFO:teuthology.orchestra.run.smithi112.stdout: "sleep_interval": { 2023-10-06T04:40:30.281 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "sleep_interval", 2023-10-06T04:40:30.281 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.281 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.281 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.281 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "600", 2023-10-06T04:40:30.281 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.281 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.281 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.282 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "how frequently to wake up and check device health", 2023-10-06T04:40:30.282 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.282 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.282 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.282 INFO:teuthology.orchestra.run.smithi112.stdout: "warn_threshold": { 2023-10-06T04:40:30.282 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "warn_threshold", 2023-10-06T04:40:30.282 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.282 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.282 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.282 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "7257600", 2023-10-06T04:40:30.283 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.283 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.283 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.283 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-06T04:40:30.283 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.283 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.283 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.283 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.283 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.284 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "diskprediction_local", 2023-10-06T04:40:30.284 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.284 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.284 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.284 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.284 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.284 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.284 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.284 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.284 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.284 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.285 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.285 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.285 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.285 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.285 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.285 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.285 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.285 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.285 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.285 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.285 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.286 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.286 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.286 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.286 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.286 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.286 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.286 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.286 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.286 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.286 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.287 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.287 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.287 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.287 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.287 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.287 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.287 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.287 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.287 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.287 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.288 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.288 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.288 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.288 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.288 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.288 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.288 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.288 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.288 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.288 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.288 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.288 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.289 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.289 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.289 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.289 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.289 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.289 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.289 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.289 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.289 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.289 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.290 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.290 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.290 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.290 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.290 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.290 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.290 INFO:teuthology.orchestra.run.smithi112.stdout: "predict_interval": { 2023-10-06T04:40:30.290 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "predict_interval", 2023-10-06T04:40:30.290 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.291 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.291 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.291 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "86400", 2023-10-06T04:40:30.291 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.291 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.291 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.291 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.291 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.291 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.291 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.291 INFO:teuthology.orchestra.run.smithi112.stdout: "predictor_model": { 2023-10-06T04:40:30.292 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "predictor_model", 2023-10-06T04:40:30.292 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.292 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.292 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.292 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "prophetstor", 2023-10-06T04:40:30.292 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.292 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.292 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.292 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.292 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.292 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.292 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.293 INFO:teuthology.orchestra.run.smithi112.stdout: "sleep_interval": { 2023-10-06T04:40:30.293 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "sleep_interval", 2023-10-06T04:40:30.293 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.293 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.293 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.293 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "600", 2023-10-06T04:40:30.293 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.293 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.293 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.293 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.293 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.294 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.294 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.294 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.294 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.294 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "influx", 2023-10-06T04:40:30.294 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": false, 2023-10-06T04:40:30.294 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "influxdb python module not found", 2023-10-06T04:40:30.294 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.294 INFO:teuthology.orchestra.run.smithi112.stdout: "batch_size": { 2023-10-06T04:40:30.295 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "batch_size", 2023-10-06T04:40:30.295 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.295 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.295 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.295 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "5000", 2023-10-06T04:40:30.295 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.295 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.295 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.295 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-06T04:40:30.295 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.295 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.295 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.296 INFO:teuthology.orchestra.run.smithi112.stdout: "database": { 2023-10-06T04:40:30.296 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "database", 2023-10-06T04:40:30.296 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.296 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.296 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.296 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "ceph", 2023-10-06T04:40:30.296 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.296 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.296 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.296 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-06T04:40:30.296 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.297 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.297 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.297 INFO:teuthology.orchestra.run.smithi112.stdout: "hostname": { 2023-10-06T04:40:30.297 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "hostname", 2023-10-06T04:40:30.297 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.297 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.297 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.297 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.297 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.297 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.298 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.298 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "InfluxDB server hostname", 2023-10-06T04:40:30.298 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.298 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.298 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.298 INFO:teuthology.orchestra.run.smithi112.stdout: "interval": { 2023-10-06T04:40:30.298 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "interval", 2023-10-06T04:40:30.298 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.298 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.298 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.299 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "30", 2023-10-06T04:40:30.299 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "5", 2023-10-06T04:40:30.299 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.299 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.299 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-06T04:40:30.299 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.299 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.299 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.299 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.299 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.300 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.300 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.300 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.300 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.300 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.300 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.300 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.300 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.300 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.300 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.300 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.301 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.301 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.301 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.301 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.301 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.301 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.301 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.301 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.301 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.301 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.301 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.302 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.302 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.302 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.302 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.302 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.302 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.302 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.302 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.302 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.302 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.303 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.303 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.303 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.303 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.303 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.303 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.303 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.303 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.303 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.303 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.303 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.303 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.304 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.304 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.304 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.304 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.304 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.304 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.304 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.304 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.304 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.304 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.305 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.305 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.305 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.305 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.305 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.305 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.305 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.305 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.305 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.305 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.306 INFO:teuthology.orchestra.run.smithi112.stdout: "password": { 2023-10-06T04:40:30.306 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "password", 2023-10-06T04:40:30.306 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.306 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.306 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.306 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.306 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.306 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.306 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.306 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "password of InfluxDB server user", 2023-10-06T04:40:30.307 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.307 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.307 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.307 INFO:teuthology.orchestra.run.smithi112.stdout: "port": { 2023-10-06T04:40:30.307 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "port", 2023-10-06T04:40:30.307 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.307 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.307 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.307 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "8086", 2023-10-06T04:40:30.307 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.308 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.308 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.308 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "InfluxDB server port", 2023-10-06T04:40:30.308 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.308 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.308 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.308 INFO:teuthology.orchestra.run.smithi112.stdout: "ssl": { 2023-10-06T04:40:30.308 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "ssl", 2023-10-06T04:40:30.308 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.309 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.309 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.309 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "false", 2023-10-06T04:40:30.309 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.309 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.309 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.309 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-06T04:40:30.309 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.309 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.309 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.310 INFO:teuthology.orchestra.run.smithi112.stdout: "threads": { 2023-10-06T04:40:30.310 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "threads", 2023-10-06T04:40:30.310 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.310 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.310 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.310 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "5", 2023-10-06T04:40:30.310 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "1", 2023-10-06T04:40:30.310 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "32", 2023-10-06T04:40:30.310 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.310 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-06T04:40:30.311 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.311 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.311 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.311 INFO:teuthology.orchestra.run.smithi112.stdout: "username": { 2023-10-06T04:40:30.311 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "username", 2023-10-06T04:40:30.311 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.311 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.311 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.311 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.311 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.311 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.312 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.312 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "username of InfluxDB server user", 2023-10-06T04:40:30.312 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.312 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.312 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.312 INFO:teuthology.orchestra.run.smithi112.stdout: "verify_ssl": { 2023-10-06T04:40:30.312 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "verify_ssl", 2023-10-06T04:40:30.312 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.312 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.312 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.312 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "true", 2023-10-06T04:40:30.313 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.313 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.313 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.313 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-06T04:40:30.313 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.313 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.313 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.313 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.313 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.314 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "insights", 2023-10-06T04:40:30.314 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.314 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.314 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.314 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.314 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.314 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.314 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.314 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.314 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.315 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.315 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.315 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.315 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.315 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.315 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.315 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.315 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.315 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.315 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.315 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.315 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.316 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.316 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.316 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.316 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.316 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.316 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.316 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.316 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.316 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.316 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.316 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.317 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.317 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.317 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.317 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.317 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.317 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.317 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.317 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.317 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.317 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.317 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.318 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.318 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.318 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.318 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.318 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.318 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.318 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.318 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.318 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.318 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.318 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.319 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.319 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.319 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.319 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.319 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.319 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.319 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.319 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.319 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.319 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.320 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.320 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.320 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.320 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.320 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.320 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.320 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.320 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "iostat", 2023-10-06T04:40:30.320 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.320 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.321 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.321 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.321 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.321 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.321 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.321 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.321 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.321 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.321 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.321 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.321 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.322 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.322 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.322 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.322 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.322 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.322 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.322 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.322 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.322 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.322 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.323 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.323 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.323 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.323 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.323 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.323 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.323 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.323 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.323 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.323 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.323 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.324 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.324 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.324 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.324 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.324 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.324 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.324 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.324 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.324 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.324 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.325 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.325 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.325 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.325 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.325 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.325 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.325 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.325 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.325 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.325 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.325 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.326 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.326 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.326 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.326 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.326 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.326 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.326 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.326 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.326 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.326 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.327 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.327 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.327 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.327 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.327 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.327 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.327 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "localpool", 2023-10-06T04:40:30.327 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.327 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.328 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.328 INFO:teuthology.orchestra.run.smithi112.stdout: "failure_domain": { 2023-10-06T04:40:30.328 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "failure_domain", 2023-10-06T04:40:30.328 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.328 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.328 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.328 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "host", 2023-10-06T04:40:30.328 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.328 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.328 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.328 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "failure domain for any created local pool", 2023-10-06T04:40:30.329 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-06T04:40:30.329 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.329 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.329 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.329 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.329 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.329 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.329 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.329 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.329 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.329 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.330 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.330 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.330 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.330 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.330 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.330 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.330 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.330 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.330 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.330 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.331 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.331 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.331 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.331 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.331 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.331 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.331 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.331 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.331 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.331 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.331 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.332 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.332 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.332 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.332 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.332 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.332 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.332 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.332 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.332 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.333 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.333 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.333 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.333 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.333 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.333 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.333 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.333 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.333 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.334 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.334 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.334 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.334 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.334 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.334 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.334 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.334 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.334 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.334 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.335 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.335 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.335 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.335 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.335 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.335 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.335 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.335 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.335 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.335 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": { 2023-10-06T04:40:30.336 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "min_size", 2023-10-06T04:40:30.336 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.336 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.336 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.336 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.336 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.336 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.336 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.336 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "default min_size for any created local pool", 2023-10-06T04:40:30.336 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-06T04:40:30.336 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.336 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.337 INFO:teuthology.orchestra.run.smithi112.stdout: "num_rep": { 2023-10-06T04:40:30.337 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "num_rep", 2023-10-06T04:40:30.337 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.337 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.337 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.337 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "3", 2023-10-06T04:40:30.337 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.337 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.337 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.337 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "default replica count for any created local pool", 2023-10-06T04:40:30.337 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.338 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.338 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.338 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": { 2023-10-06T04:40:30.338 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "pg_num", 2023-10-06T04:40:30.338 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.338 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.338 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.338 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "128", 2023-10-06T04:40:30.338 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.338 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.338 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.339 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "default pg_num for any created local pool", 2023-10-06T04:40:30.339 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.339 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.339 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.339 INFO:teuthology.orchestra.run.smithi112.stdout: "prefix": { 2023-10-06T04:40:30.339 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "prefix", 2023-10-06T04:40:30.339 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.339 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.339 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.339 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.340 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.340 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.340 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.340 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "name prefix for any created local pool", 2023-10-06T04:40:30.340 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.340 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.340 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.340 INFO:teuthology.orchestra.run.smithi112.stdout: "subtree": { 2023-10-06T04:40:30.340 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "subtree", 2023-10-06T04:40:30.340 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.340 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.341 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.341 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "rack", 2023-10-06T04:40:30.341 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.341 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.341 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.341 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-06T04:40:30.341 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-06T04:40:30.341 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.341 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.341 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.341 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.342 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "mds_autoscaler", 2023-10-06T04:40:30.342 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.342 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.342 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.342 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.342 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.342 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.342 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.342 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.342 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.342 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.343 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.343 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.343 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.343 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.343 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.343 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.343 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.343 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.343 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.343 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.343 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.344 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.344 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.344 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.344 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.344 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.344 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.344 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.344 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.344 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.344 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.345 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.345 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.345 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.345 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.345 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.345 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.345 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.345 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.345 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.345 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.345 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.346 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.346 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.346 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.346 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.346 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.346 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.346 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.346 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.346 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.346 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.346 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.347 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.347 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.347 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.347 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.347 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.347 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.347 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.347 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.347 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.348 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.348 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.348 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.348 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.348 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.348 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.348 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.348 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.348 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.349 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "mirroring", 2023-10-06T04:40:30.349 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.349 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.349 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.349 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.349 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.349 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.349 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.349 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.349 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.349 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.349 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.350 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.350 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.350 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.350 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.350 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.350 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.350 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.350 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.350 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.350 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.351 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.351 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.351 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.351 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.351 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.351 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.351 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.351 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.351 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.351 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.352 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.352 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.352 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.352 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.352 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.352 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.352 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.352 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.352 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.352 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.353 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.353 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.353 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.353 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.353 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.353 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.353 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.353 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.353 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.353 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.353 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.353 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.354 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.354 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.354 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.354 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.354 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.354 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.354 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.354 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.354 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.354 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.355 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.355 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.355 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.355 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.355 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.355 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.355 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.355 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.355 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "nfs", 2023-10-06T04:40:30.355 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.356 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.356 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.356 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.356 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.356 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.356 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.356 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.356 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.356 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.356 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.356 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.357 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.357 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.357 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.357 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.357 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.357 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.357 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.357 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.357 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.357 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.357 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.358 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.358 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.358 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.358 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.358 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.358 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.358 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.358 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.358 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.358 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.358 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.359 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.359 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.359 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.359 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.359 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.359 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.359 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.359 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.359 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.359 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.360 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.360 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.360 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.360 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.360 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.360 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.360 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.360 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.360 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.360 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.360 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.360 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.361 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.361 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.361 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.361 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.361 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.361 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.361 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.361 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.361 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.361 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.361 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.362 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.362 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.362 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "orchestrator", 2023-10-06T04:40:30.362 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.362 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.362 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.363 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.363 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.363 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.363 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.363 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.363 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.363 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.363 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.363 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.363 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.363 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.363 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.364 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.364 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.364 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.364 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.364 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.364 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.364 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.364 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.364 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.364 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.364 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.365 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.365 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.365 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.365 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.365 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.365 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.365 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.365 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.365 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.365 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.365 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.365 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.366 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.366 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.366 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.366 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.366 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.366 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.366 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.366 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.366 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.366 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.367 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.367 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.367 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.367 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.367 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.367 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.367 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.367 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.367 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.367 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.367 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.368 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.368 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.368 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.368 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.368 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.368 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.368 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.368 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.368 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.368 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.369 INFO:teuthology.orchestra.run.smithi112.stdout: "orchestrator": { 2023-10-06T04:40:30.369 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "orchestrator", 2023-10-06T04:40:30.369 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.369 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.369 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.369 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.369 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.369 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.369 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.369 INFO:teuthology.orchestra.run.smithi112.stdout: "cephadm", 2023-10-06T04:40:30.369 INFO:teuthology.orchestra.run.smithi112.stdout: "rook", 2023-10-06T04:40:30.370 INFO:teuthology.orchestra.run.smithi112.stdout: "test_orchestrator" 2023-10-06T04:40:30.370 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.370 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Orchestrator backend", 2023-10-06T04:40:30.370 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.370 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.370 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.370 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.370 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.371 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "osd_perf_query", 2023-10-06T04:40:30.371 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.371 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.371 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.371 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.371 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.371 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.371 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.371 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.371 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.371 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.371 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.372 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.372 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.372 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.372 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.372 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.372 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.372 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.372 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.372 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.372 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.372 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.372 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.373 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.373 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.373 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.373 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.373 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.373 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.373 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.373 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.373 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.373 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.373 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.374 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.374 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.374 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.374 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.374 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.374 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.374 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.374 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.374 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.374 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.375 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.375 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.375 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.375 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.375 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.375 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.375 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.375 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.375 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.375 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.375 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.376 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.376 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.376 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.376 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.376 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.376 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.376 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.376 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.376 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.376 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.377 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.377 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.377 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.377 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.377 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.377 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.377 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "osd_support", 2023-10-06T04:40:30.377 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.378 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.378 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.378 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.378 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.378 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.378 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.378 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.378 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.378 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.378 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.378 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.378 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.379 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.379 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.379 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.379 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.379 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.379 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.379 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.379 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.379 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.379 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.379 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.380 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.380 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.380 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.380 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.380 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.380 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.380 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.380 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.380 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.380 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.380 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.381 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.381 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.381 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.381 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.381 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.381 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.381 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.381 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.381 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.381 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.382 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.382 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.382 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.382 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.382 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.382 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.382 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.382 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.382 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.382 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.382 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.383 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.383 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.383 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.383 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.383 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.383 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.383 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.383 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.383 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.383 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.384 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.384 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.384 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.384 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.384 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.384 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "pg_autoscaler", 2023-10-06T04:40:30.384 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.384 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.384 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.385 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.385 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.385 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.385 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.385 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.385 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.385 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.385 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.385 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.385 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.385 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.385 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.386 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.386 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.386 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.386 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.386 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.386 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.386 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.386 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.386 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.386 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.387 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.387 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.387 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.387 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.387 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.387 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.387 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.387 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.387 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.387 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.387 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.388 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.388 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.388 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.388 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.388 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.388 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.388 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.388 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.388 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.388 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.388 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.388 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.388 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.389 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.389 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.389 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.389 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.389 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.389 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.389 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.389 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.389 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.389 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.390 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.390 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.390 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.390 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.390 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.390 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.390 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.390 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.390 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.390 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.391 INFO:teuthology.orchestra.run.smithi112.stdout: "sleep_interval": { 2023-10-06T04:40:30.391 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "sleep_interval", 2023-10-06T04:40:30.391 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.391 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.391 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.391 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "60", 2023-10-06T04:40:30.391 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.391 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.391 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.391 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.391 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.392 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.392 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.392 INFO:teuthology.orchestra.run.smithi112.stdout: "threshold": { 2023-10-06T04:40:30.392 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "threshold", 2023-10-06T04:40:30.392 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "float", 2023-10-06T04:40:30.392 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.392 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.392 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "3.0", 2023-10-06T04:40:30.392 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "1.0", 2023-10-06T04:40:30.392 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.393 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.393 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "scaling threshold", 2023-10-06T04:40:30.393 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-06T04:40:30.393 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.393 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.393 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.393 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.393 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "progress", 2023-10-06T04:40:30.393 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.393 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.394 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.394 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_pg_recovery_event": { 2023-10-06T04:40:30.394 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "allow_pg_recovery_event", 2023-10-06T04:40:30.394 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.394 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.394 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.394 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.394 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.394 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.394 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.394 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-06T04:40:30.394 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.395 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.395 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.395 INFO:teuthology.orchestra.run.smithi112.stdout: "enabled": { 2023-10-06T04:40:30.395 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "enabled", 2023-10-06T04:40:30.395 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.395 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.395 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.395 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.395 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.395 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.395 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.396 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.396 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.396 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.396 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.396 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.396 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.396 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.396 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.396 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.396 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.397 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.397 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.397 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.397 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.397 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.397 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.397 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.397 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.397 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.397 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.397 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.397 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.398 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.398 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.398 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.398 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.398 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.398 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.398 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.398 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.398 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.398 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.398 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.399 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.399 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.399 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.399 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.399 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.399 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.399 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.399 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.399 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.399 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.400 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.400 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.400 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.400 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.400 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.400 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.400 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.400 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.400 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.400 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.401 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.401 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.401 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.401 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.401 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.401 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.401 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.401 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.401 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.401 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.402 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.402 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.402 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.402 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.402 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.402 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.402 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.402 INFO:teuthology.orchestra.run.smithi112.stdout: "max_completed_events": { 2023-10-06T04:40:30.402 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "max_completed_events", 2023-10-06T04:40:30.402 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.403 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.403 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.403 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "50", 2023-10-06T04:40:30.403 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.403 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.403 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.403 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "number of past completed events to remember", 2023-10-06T04:40:30.403 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.403 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.403 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.404 INFO:teuthology.orchestra.run.smithi112.stdout: "sleep_interval": { 2023-10-06T04:40:30.404 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "sleep_interval", 2023-10-06T04:40:30.404 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.404 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.404 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.404 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "5", 2023-10-06T04:40:30.404 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.404 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.404 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.404 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "how long the module is going to sleep", 2023-10-06T04:40:30.404 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.404 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.404 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.405 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.405 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.405 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "prometheus", 2023-10-06T04:40:30.405 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.405 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.405 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.405 INFO:teuthology.orchestra.run.smithi112.stdout: "cache": { 2023-10-06T04:40:30.405 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "cache", 2023-10-06T04:40:30.405 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.406 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.406 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.406 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.406 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.406 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.406 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.406 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.406 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.406 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.406 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.407 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.407 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.407 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.407 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.407 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.407 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.407 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.407 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.407 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.407 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.407 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.407 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.408 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.408 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.408 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.408 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.408 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.408 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.408 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.408 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.408 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.409 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.409 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.409 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.409 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.409 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.409 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.409 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.409 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.409 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.409 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.409 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.409 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.410 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.410 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.410 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.410 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.410 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.410 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.410 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.410 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.410 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.410 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.411 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.411 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.411 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.411 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.411 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.411 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.411 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.411 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.411 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.411 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.411 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.412 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.412 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.412 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.412 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.412 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.412 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.412 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.412 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.412 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.412 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.412 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.413 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.413 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_stats_pools": { 2023-10-06T04:40:30.413 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rbd_stats_pools", 2023-10-06T04:40:30.413 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.413 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.413 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.413 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.413 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.413 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.413 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.414 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.414 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.414 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.414 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.414 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-06T04:40:30.414 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-06T04:40:30.414 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.414 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.414 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.414 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "300", 2023-10-06T04:40:30.415 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.415 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.415 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.415 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.415 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.415 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.415 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.415 INFO:teuthology.orchestra.run.smithi112.stdout: "scrape_interval": { 2023-10-06T04:40:30.415 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "scrape_interval", 2023-10-06T04:40:30.415 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "float", 2023-10-06T04:40:30.416 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.416 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.416 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "15.0", 2023-10-06T04:40:30.416 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.416 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.416 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.416 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.416 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.416 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.416 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.417 INFO:teuthology.orchestra.run.smithi112.stdout: "server_addr": { 2023-10-06T04:40:30.417 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "server_addr", 2023-10-06T04:40:30.417 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.417 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.417 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.417 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "::", 2023-10-06T04:40:30.417 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.417 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.417 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.417 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-06T04:40:30.417 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.418 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.418 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.418 INFO:teuthology.orchestra.run.smithi112.stdout: "server_port": { 2023-10-06T04:40:30.418 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "server_port", 2023-10-06T04:40:30.418 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.418 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.418 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.418 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "9283", 2023-10-06T04:40:30.418 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.418 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.418 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.419 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-06T04:40:30.419 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.419 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.419 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.419 INFO:teuthology.orchestra.run.smithi112.stdout: "stale_cache_strategy": { 2023-10-06T04:40:30.419 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "stale_cache_strategy", 2023-10-06T04:40:30.419 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.419 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.419 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.419 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "log", 2023-10-06T04:40:30.419 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.420 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.420 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.420 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.420 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.420 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.420 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.420 INFO:teuthology.orchestra.run.smithi112.stdout: "standby_behaviour": { 2023-10-06T04:40:30.420 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "standby_behaviour", 2023-10-06T04:40:30.420 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.420 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.421 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.421 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "default", 2023-10-06T04:40:30.421 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.421 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.421 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.421 INFO:teuthology.orchestra.run.smithi112.stdout: "default", 2023-10-06T04:40:30.421 INFO:teuthology.orchestra.run.smithi112.stdout: "error" 2023-10-06T04:40:30.421 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.421 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.421 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.421 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.421 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.422 INFO:teuthology.orchestra.run.smithi112.stdout: "standby_error_status_code": { 2023-10-06T04:40:30.422 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "standby_error_status_code", 2023-10-06T04:40:30.422 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.422 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.422 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.422 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "500", 2023-10-06T04:40:30.422 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "400", 2023-10-06T04:40:30.422 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "599", 2023-10-06T04:40:30.422 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.422 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.422 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.423 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.423 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.423 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.423 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.423 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rbd_support", 2023-10-06T04:40:30.423 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.423 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.423 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.424 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.424 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.424 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.424 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.424 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.424 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.424 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.424 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.424 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.424 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.424 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.424 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.425 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.425 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.425 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.425 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.425 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.425 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.425 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.425 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.425 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.425 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.426 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.426 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.426 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.426 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.426 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.426 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.426 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.426 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.426 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.426 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.426 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.427 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.427 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.427 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.427 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.427 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.427 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.427 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.427 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.427 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.427 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.427 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.428 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.428 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.428 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.428 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.428 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.428 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.428 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.428 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.428 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.428 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.428 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.428 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.428 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.429 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.429 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.429 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.429 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.429 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.429 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.429 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.429 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.429 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.429 INFO:teuthology.orchestra.run.smithi112.stdout: "max_concurrent_snap_create": { 2023-10-06T04:40:30.429 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "max_concurrent_snap_create", 2023-10-06T04:40:30.430 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.430 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.430 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.430 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "10", 2023-10-06T04:40:30.430 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.430 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.430 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.430 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.430 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.430 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.430 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.431 INFO:teuthology.orchestra.run.smithi112.stdout: "mirror_snapshot_schedule": { 2023-10-06T04:40:30.431 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "mirror_snapshot_schedule", 2023-10-06T04:40:30.431 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.431 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.431 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.431 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.431 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.431 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.431 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.431 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.431 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.432 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.432 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.432 INFO:teuthology.orchestra.run.smithi112.stdout: "trash_purge_schedule": { 2023-10-06T04:40:30.432 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "trash_purge_schedule", 2023-10-06T04:40:30.432 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.432 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.432 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.432 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.432 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.432 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.433 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.433 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.433 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.433 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.433 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.433 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.433 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.433 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "restful", 2023-10-06T04:40:30.433 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.433 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.434 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.434 INFO:teuthology.orchestra.run.smithi112.stdout: "enable_auth": { 2023-10-06T04:40:30.434 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "enable_auth", 2023-10-06T04:40:30.434 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.434 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.434 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.434 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.434 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.434 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.434 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.434 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.435 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.435 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.435 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.435 INFO:teuthology.orchestra.run.smithi112.stdout: "key_file": { 2023-10-06T04:40:30.435 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "key_file", 2023-10-06T04:40:30.435 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.435 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.435 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.435 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.435 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.436 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.436 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.436 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.436 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.436 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.436 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.436 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.436 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.436 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.436 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.436 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.437 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.437 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.437 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.437 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.437 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.437 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.437 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.437 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.437 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.437 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.437 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.437 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.438 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.438 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.438 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.438 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.438 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.438 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.438 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.438 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.438 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.438 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.439 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.439 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.439 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.439 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.439 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.439 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.439 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.439 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.439 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.439 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.440 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.440 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.440 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.440 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.440 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.440 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.440 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.440 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.440 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.440 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.440 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.440 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.441 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.441 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.441 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.441 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.441 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.441 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.441 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.441 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.441 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.441 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.442 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.442 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.442 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.442 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.442 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.442 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.442 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.442 INFO:teuthology.orchestra.run.smithi112.stdout: "server_addr": { 2023-10-06T04:40:30.442 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "server_addr", 2023-10-06T04:40:30.442 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.442 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.443 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.443 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.443 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.443 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.443 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.443 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.443 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.443 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.443 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.443 INFO:teuthology.orchestra.run.smithi112.stdout: "server_port": { 2023-10-06T04:40:30.444 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "server_port", 2023-10-06T04:40:30.444 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.444 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.444 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.444 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.444 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.444 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.444 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.444 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.444 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.444 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.444 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.445 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.445 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.445 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rgw", 2023-10-06T04:40:30.445 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.445 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.445 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.445 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.445 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.445 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.446 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.446 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.446 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.446 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.446 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.446 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.446 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.446 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.446 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.447 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.447 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.447 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.447 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.447 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.447 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.447 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.447 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.447 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.447 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.447 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.448 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.448 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.448 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.448 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.448 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.448 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.448 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.448 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.448 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.448 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.449 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.449 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.449 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.449 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.449 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.449 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.449 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.449 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.450 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.450 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.450 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.450 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.451 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.451 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.451 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.451 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.451 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.451 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.451 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.451 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.451 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.451 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.452 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.452 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.452 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.452 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.452 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.452 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.452 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.452 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.452 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.452 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.452 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.453 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.453 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.453 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rook", 2023-10-06T04:40:30.453 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.453 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.453 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.453 INFO:teuthology.orchestra.run.smithi112.stdout: "drive_group_interval": { 2023-10-06T04:40:30.453 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "drive_group_interval", 2023-10-06T04:40:30.453 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "float", 2023-10-06T04:40:30.453 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.454 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.454 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "300.0", 2023-10-06T04:40:30.454 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.454 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.454 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.454 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-06T04:40:30.454 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.454 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.454 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.455 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.455 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.455 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.455 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.455 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.455 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.455 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.455 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.455 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.455 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.456 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.456 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.456 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.456 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.456 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.456 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.456 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.456 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.456 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.456 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.457 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.457 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.457 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.457 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.457 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.457 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.457 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.457 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.457 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.457 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.457 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.458 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.458 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.458 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.458 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.458 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.458 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.458 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.458 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.458 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.458 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.459 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.459 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.459 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.459 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.459 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.459 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.459 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.459 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.459 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.459 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.459 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.460 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.460 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.460 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.460 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.460 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.460 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.460 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.460 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.460 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.460 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.460 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.461 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.461 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.461 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.461 INFO:teuthology.orchestra.run.smithi112.stdout: "storage_class": { 2023-10-06T04:40:30.461 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "storage_class", 2023-10-06T04:40:30.461 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.461 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.461 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.461 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "local", 2023-10-06T04:40:30.461 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.461 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.462 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.462 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-06T04:40:30.462 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.462 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.462 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.462 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.462 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.462 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "selftest", 2023-10-06T04:40:30.462 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.462 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.463 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.463 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.463 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.463 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.463 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.463 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.463 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.463 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.463 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.463 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.463 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.464 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.464 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.464 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.464 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.464 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.464 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.464 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.464 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.464 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.464 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.464 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.465 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.465 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.465 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.465 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.465 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.465 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.465 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.465 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.465 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.465 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.465 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.465 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.466 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.466 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.466 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.466 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.466 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.466 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.466 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.466 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.466 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.466 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.467 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.467 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.467 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.467 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.467 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.467 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.467 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.467 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.467 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.467 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.467 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.468 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.468 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.468 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.468 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.468 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.468 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.468 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.468 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.468 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.468 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.468 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.468 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.469 INFO:teuthology.orchestra.run.smithi112.stdout: "roption1": { 2023-10-06T04:40:30.469 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "roption1", 2023-10-06T04:40:30.469 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.469 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.469 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.469 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.469 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.469 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.469 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.469 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.470 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.470 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.470 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.470 INFO:teuthology.orchestra.run.smithi112.stdout: "roption2": { 2023-10-06T04:40:30.470 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "roption2", 2023-10-06T04:40:30.470 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.470 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.470 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.470 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "xyz", 2023-10-06T04:40:30.470 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.471 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.471 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.471 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.471 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.471 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.471 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.471 INFO:teuthology.orchestra.run.smithi112.stdout: "rwoption1": { 2023-10-06T04:40:30.471 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rwoption1", 2023-10-06T04:40:30.471 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.471 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.471 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.472 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.472 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.472 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.472 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.472 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.472 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.472 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.472 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.472 INFO:teuthology.orchestra.run.smithi112.stdout: "rwoption2": { 2023-10-06T04:40:30.473 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rwoption2", 2023-10-06T04:40:30.473 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.473 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.473 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.473 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.473 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.473 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.473 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.473 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.473 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.473 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.473 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.474 INFO:teuthology.orchestra.run.smithi112.stdout: "rwoption3": { 2023-10-06T04:40:30.474 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rwoption3", 2023-10-06T04:40:30.474 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "float", 2023-10-06T04:40:30.474 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.474 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.474 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.474 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.474 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.474 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.474 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.474 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.475 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.475 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.475 INFO:teuthology.orchestra.run.smithi112.stdout: "rwoption4": { 2023-10-06T04:40:30.475 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rwoption4", 2023-10-06T04:40:30.475 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.475 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.475 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.475 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.475 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.475 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.476 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.476 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.476 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.476 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.476 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.476 INFO:teuthology.orchestra.run.smithi112.stdout: "rwoption5": { 2023-10-06T04:40:30.476 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rwoption5", 2023-10-06T04:40:30.476 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.476 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.476 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.476 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.476 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.477 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.477 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.477 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.477 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.477 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.477 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.477 INFO:teuthology.orchestra.run.smithi112.stdout: "rwoption6": { 2023-10-06T04:40:30.477 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rwoption6", 2023-10-06T04:40:30.477 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.477 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.478 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.478 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.478 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.478 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.478 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.478 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.478 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.478 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.478 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.478 INFO:teuthology.orchestra.run.smithi112.stdout: "rwoption7": { 2023-10-06T04:40:30.479 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rwoption7", 2023-10-06T04:40:30.479 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.479 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.479 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.479 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.479 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "1", 2023-10-06T04:40:30.479 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "42", 2023-10-06T04:40:30.479 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.479 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.479 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.479 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.480 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.480 INFO:teuthology.orchestra.run.smithi112.stdout: "testkey": { 2023-10-06T04:40:30.480 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "testkey", 2023-10-06T04:40:30.480 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.480 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.480 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.480 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.480 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.480 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.480 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.480 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.481 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.481 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.481 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.481 INFO:teuthology.orchestra.run.smithi112.stdout: "testlkey": { 2023-10-06T04:40:30.481 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "testlkey", 2023-10-06T04:40:30.481 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.481 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.481 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.481 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.481 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.481 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.482 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.482 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.482 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.482 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.482 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.482 INFO:teuthology.orchestra.run.smithi112.stdout: "testnewline": { 2023-10-06T04:40:30.482 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "testnewline", 2023-10-06T04:40:30.482 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.482 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.482 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.483 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.483 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.483 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.483 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.483 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.483 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.483 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.483 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.483 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.483 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.484 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "snap_schedule", 2023-10-06T04:40:30.484 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.484 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.484 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.484 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_m_granularity": { 2023-10-06T04:40:30.484 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "allow_m_granularity", 2023-10-06T04:40:30.484 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.484 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.484 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.484 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.484 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.485 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.485 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.485 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "allow minute scheduled snapshots", 2023-10-06T04:40:30.485 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.485 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.485 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.485 INFO:teuthology.orchestra.run.smithi112.stdout: "dump_on_update": { 2023-10-06T04:40:30.485 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "dump_on_update", 2023-10-06T04:40:30.485 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.485 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.486 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.486 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.486 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.486 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.486 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.486 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "dump database to debug log on update", 2023-10-06T04:40:30.486 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.486 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.486 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.486 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.487 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.487 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.487 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.487 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.487 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.487 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.487 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.487 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.487 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.487 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.487 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.487 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.488 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.488 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.488 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.488 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.488 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.488 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.488 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.488 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.488 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.489 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.489 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.489 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.489 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.489 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.489 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.489 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.489 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.489 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.489 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.489 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.490 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.490 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.490 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.490 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.490 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.490 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.490 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.490 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.490 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.490 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.491 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.491 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.491 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.491 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.491 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.491 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.491 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.491 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.491 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.491 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.492 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.492 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.492 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.492 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.492 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.492 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.492 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.492 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.492 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.492 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.492 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.492 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.493 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.493 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.493 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.493 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "stats", 2023-10-06T04:40:30.493 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.493 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.493 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.493 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.493 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.493 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.494 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.494 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.494 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.494 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.494 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.494 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.494 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.494 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.494 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.494 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.494 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.495 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.495 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.495 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.495 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.495 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.495 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.495 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.495 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.495 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.495 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.495 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.496 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.496 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.496 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.496 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.496 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.496 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.496 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.496 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.496 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.496 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.496 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.496 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.497 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.497 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.497 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.497 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.497 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.497 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.497 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.497 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.497 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.497 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.497 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.497 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.497 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.497 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.498 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.498 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.498 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.498 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.498 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.498 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.498 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.498 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.498 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.498 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.499 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.499 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.499 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.499 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.499 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.499 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.499 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.499 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "status", 2023-10-06T04:40:30.499 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.499 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.499 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.500 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.500 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.500 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.500 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.500 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.500 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.500 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.500 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.500 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.500 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.500 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.500 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.500 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.501 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.501 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.501 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.501 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.501 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.501 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.501 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.501 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.501 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.501 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.501 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.502 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.502 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.502 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.502 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.502 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.502 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.502 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.502 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.502 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.503 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.503 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.503 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.503 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.503 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.503 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.503 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.503 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.503 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.503 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.503 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.503 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.503 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.504 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.504 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.504 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.504 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.504 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.504 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.504 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.504 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.504 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.504 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.504 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.504 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.505 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.505 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.505 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.505 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.505 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.505 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.505 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.505 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.505 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.505 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.506 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "telegraf", 2023-10-06T04:40:30.506 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.506 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.506 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.506 INFO:teuthology.orchestra.run.smithi112.stdout: "address": { 2023-10-06T04:40:30.506 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "address", 2023-10-06T04:40:30.506 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.506 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.506 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.506 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-06T04:40:30.506 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.507 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.507 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.507 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.507 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.507 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.507 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.507 INFO:teuthology.orchestra.run.smithi112.stdout: "interval": { 2023-10-06T04:40:30.507 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "interval", 2023-10-06T04:40:30.507 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.507 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.508 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.508 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "15", 2023-10-06T04:40:30.508 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.508 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.508 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.508 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.508 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.508 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.508 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.508 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.508 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.509 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.509 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.509 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.509 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.509 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.509 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.509 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.509 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.509 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.509 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.509 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.509 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.510 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.510 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.510 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.510 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.510 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.510 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.510 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.510 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.510 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.510 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.511 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.511 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.511 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.511 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.511 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.511 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.511 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.511 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.511 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.511 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.511 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.512 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.512 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.512 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.512 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.512 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.512 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.512 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.512 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.512 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.512 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.512 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.512 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.513 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.513 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.513 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.513 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.513 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.513 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.513 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.513 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.513 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.513 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.514 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.514 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.514 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.514 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.514 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.514 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.514 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.514 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.514 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.514 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.514 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.515 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "telemetry", 2023-10-06T04:40:30.515 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.515 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.515 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.515 INFO:teuthology.orchestra.run.smithi112.stdout: "channel_basic": { 2023-10-06T04:40:30.515 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "channel_basic", 2023-10-06T04:40:30.515 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.515 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.515 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.516 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.516 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.516 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.516 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.516 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-06T04:40:30.516 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.516 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.516 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.516 INFO:teuthology.orchestra.run.smithi112.stdout: "channel_crash": { 2023-10-06T04:40:30.516 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "channel_crash", 2023-10-06T04:40:30.517 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.517 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.517 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.517 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.517 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.517 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.517 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.517 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-06T04:40:30.517 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.517 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.517 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.518 INFO:teuthology.orchestra.run.smithi112.stdout: "channel_device": { 2023-10-06T04:40:30.518 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "channel_device", 2023-10-06T04:40:30.518 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.518 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.518 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.518 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.518 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.518 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.518 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.518 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-06T04:40:30.519 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.519 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.519 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.519 INFO:teuthology.orchestra.run.smithi112.stdout: "channel_ident": { 2023-10-06T04:40:30.519 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "channel_ident", 2023-10-06T04:40:30.519 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.519 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.519 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.519 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.519 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.520 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.520 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.520 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-06T04:40:30.520 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.520 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.520 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.520 INFO:teuthology.orchestra.run.smithi112.stdout: "channel_perf": { 2023-10-06T04:40:30.520 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "channel_perf", 2023-10-06T04:40:30.520 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.520 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.521 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.521 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.521 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.521 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.521 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.521 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-06T04:40:30.521 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.521 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.521 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.521 INFO:teuthology.orchestra.run.smithi112.stdout: "contact": { 2023-10-06T04:40:30.521 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "contact", 2023-10-06T04:40:30.521 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.522 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.522 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.522 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.522 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.522 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.522 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.522 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.522 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.522 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.522 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.523 INFO:teuthology.orchestra.run.smithi112.stdout: "description": { 2023-10-06T04:40:30.523 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "description", 2023-10-06T04:40:30.523 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.523 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.523 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.523 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.523 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.523 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.523 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.523 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.523 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.523 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.523 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.524 INFO:teuthology.orchestra.run.smithi112.stdout: "device_url": { 2023-10-06T04:40:30.524 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "device_url", 2023-10-06T04:40:30.524 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.524 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.524 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.524 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-06T04:40:30.524 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.524 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.524 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.524 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.524 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.524 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.525 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.525 INFO:teuthology.orchestra.run.smithi112.stdout: "enabled": { 2023-10-06T04:40:30.525 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "enabled", 2023-10-06T04:40:30.525 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.525 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.525 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.525 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.525 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.525 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.525 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.525 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.526 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.526 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.526 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.526 INFO:teuthology.orchestra.run.smithi112.stdout: "interval": { 2023-10-06T04:40:30.526 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "interval", 2023-10-06T04:40:30.526 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.526 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.526 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.526 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "24", 2023-10-06T04:40:30.526 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "8", 2023-10-06T04:40:30.527 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.527 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.527 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.527 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.527 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.527 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.527 INFO:teuthology.orchestra.run.smithi112.stdout: "last_opt_revision": { 2023-10-06T04:40:30.527 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "last_opt_revision", 2023-10-06T04:40:30.527 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.527 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.527 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.528 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "1", 2023-10-06T04:40:30.528 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.528 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.528 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.528 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.528 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.528 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.528 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.528 INFO:teuthology.orchestra.run.smithi112.stdout: "leaderboard": { 2023-10-06T04:40:30.528 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "leaderboard", 2023-10-06T04:40:30.529 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.529 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.529 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.529 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.529 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.529 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.529 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.529 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.529 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.529 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.529 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.530 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.530 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.530 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.530 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.530 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.530 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.530 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.530 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.530 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.530 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.530 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.531 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.531 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.531 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.531 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.531 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.531 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.531 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.531 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.531 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.531 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.531 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.532 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.532 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.532 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.532 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.532 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.532 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.532 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.532 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.532 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.532 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.532 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.533 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.533 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.533 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.533 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.533 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.533 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.533 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.533 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.533 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.533 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.533 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.533 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.534 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.534 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.534 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.534 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.534 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.534 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.534 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.534 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.534 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.534 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.535 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.535 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.535 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.535 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.535 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.535 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.535 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.535 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.535 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.535 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.535 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.536 INFO:teuthology.orchestra.run.smithi112.stdout: "organization": { 2023-10-06T04:40:30.536 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "organization", 2023-10-06T04:40:30.536 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.536 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.536 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.536 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.536 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.536 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.536 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.536 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.536 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.537 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.537 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.537 INFO:teuthology.orchestra.run.smithi112.stdout: "proxy": { 2023-10-06T04:40:30.537 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "proxy", 2023-10-06T04:40:30.537 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.537 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.537 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.537 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.537 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.537 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.537 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.538 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.538 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.538 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.538 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.538 INFO:teuthology.orchestra.run.smithi112.stdout: "url": { 2023-10-06T04:40:30.538 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "url", 2023-10-06T04:40:30.538 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.538 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.538 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.538 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-06T04:40:30.538 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.539 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.539 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.539 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.539 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.539 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.539 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.539 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.539 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.540 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "test_orchestrator", 2023-10-06T04:40:30.540 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.540 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.540 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.540 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.540 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.540 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.540 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.540 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.540 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.540 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.540 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.541 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.541 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.541 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.541 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.541 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.541 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.541 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.541 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.541 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.541 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.541 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.541 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.542 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.542 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.542 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.542 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.542 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.542 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.542 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.542 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.542 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.542 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.543 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.543 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.543 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.543 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.543 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.543 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.543 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.543 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.543 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.543 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.543 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.544 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.544 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.544 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.544 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.544 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.544 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.544 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.544 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.544 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.544 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.544 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.544 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.545 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.545 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.545 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.545 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.545 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.545 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.545 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.545 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.545 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.545 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.546 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.546 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.546 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.546 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.546 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.546 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "volumes", 2023-10-06T04:40:30.546 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.546 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.546 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.546 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.547 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.547 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.547 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.547 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.547 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.547 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.547 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.547 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.547 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.547 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.547 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.547 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.548 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.548 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.548 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.548 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.548 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.548 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.548 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.548 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.548 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.548 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.548 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.549 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.549 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.549 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.549 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.549 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.549 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.549 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.549 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.549 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.549 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.549 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.550 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.550 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.550 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.550 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.550 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.550 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.550 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.550 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.550 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.550 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.550 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.551 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.551 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.551 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.551 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.551 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.551 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.551 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.551 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.551 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.551 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.551 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.552 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.552 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.552 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.552 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.552 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.552 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.552 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.552 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.552 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.552 INFO:teuthology.orchestra.run.smithi112.stdout: "max_concurrent_clones": { 2023-10-06T04:40:30.553 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "max_concurrent_clones", 2023-10-06T04:40:30.553 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.553 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.553 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.553 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "4", 2023-10-06T04:40:30.553 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.553 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.553 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.553 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-06T04:40:30.553 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.553 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.553 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.554 INFO:teuthology.orchestra.run.smithi112.stdout: "snapshot_clone_delay": { 2023-10-06T04:40:30.554 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "snapshot_clone_delay", 2023-10-06T04:40:30.554 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.554 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.554 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.554 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "0", 2023-10-06T04:40:30.554 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.554 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.554 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.554 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-06T04:40:30.555 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.555 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.555 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.555 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.555 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.555 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "zabbix", 2023-10-06T04:40:30.555 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.555 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.555 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.555 INFO:teuthology.orchestra.run.smithi112.stdout: "discovery_interval": { 2023-10-06T04:40:30.556 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "discovery_interval", 2023-10-06T04:40:30.556 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "uint", 2023-10-06T04:40:30.556 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.556 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.556 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "100", 2023-10-06T04:40:30.556 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.556 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.556 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.556 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.556 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.556 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.557 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.557 INFO:teuthology.orchestra.run.smithi112.stdout: "identifier": { 2023-10-06T04:40:30.557 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "identifier", 2023-10-06T04:40:30.557 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.557 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.557 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.557 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.557 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.557 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.557 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.558 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.558 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.558 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.558 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.558 INFO:teuthology.orchestra.run.smithi112.stdout: "interval": { 2023-10-06T04:40:30.558 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "interval", 2023-10-06T04:40:30.558 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.558 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.558 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.558 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "60", 2023-10-06T04:40:30.558 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.559 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.559 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.559 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.559 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.559 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.559 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.559 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.559 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.559 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.559 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.560 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.560 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.560 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.560 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.560 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.560 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.560 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.560 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.560 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.560 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.560 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.560 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.560 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.561 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.561 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.561 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.561 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.561 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.561 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.561 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.561 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.561 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.561 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.561 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.562 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.562 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.562 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.562 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.562 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.562 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.562 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.562 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.562 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.562 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.563 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.563 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.563 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.563 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.563 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.563 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.563 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.563 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.563 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.563 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.563 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.564 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.564 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.564 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.564 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.564 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.564 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.564 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.564 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.564 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.564 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.564 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.565 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.565 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.565 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.565 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.565 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.565 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.565 INFO:teuthology.orchestra.run.smithi112.stdout: "zabbix_host": { 2023-10-06T04:40:30.565 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "zabbix_host", 2023-10-06T04:40:30.565 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.565 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.565 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.566 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.566 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.566 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.566 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.566 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.566 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.566 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.566 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.566 INFO:teuthology.orchestra.run.smithi112.stdout: "zabbix_port": { 2023-10-06T04:40:30.566 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "zabbix_port", 2023-10-06T04:40:30.567 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.567 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.567 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.567 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "10051", 2023-10-06T04:40:30.567 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.567 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.567 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.567 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.567 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.567 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.567 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.568 INFO:teuthology.orchestra.run.smithi112.stdout: "zabbix_sender": { 2023-10-06T04:40:30.568 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "zabbix_sender", 2023-10-06T04:40:30.568 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.568 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.568 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.568 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-06T04:40:30.568 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.568 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.568 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.568 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.568 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.569 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.569 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.569 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.569 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.569 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.569 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2023-10-06T04:40:30.569 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.569 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.569 INFO:teuthology.orchestra.run.smithi112.stdout: "modules": [ 2023-10-06T04:40:30.570 INFO:teuthology.orchestra.run.smithi112.stdout: "iostat", 2023-10-06T04:40:30.570 INFO:teuthology.orchestra.run.smithi112.stdout: "nfs", 2023-10-06T04:40:30.570 INFO:teuthology.orchestra.run.smithi112.stdout: "restful" 2023-10-06T04:40:30.570 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.570 INFO:teuthology.orchestra.run.smithi112.stdout: "available_modules": [ 2023-10-06T04:40:30.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.570 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "alerts", 2023-10-06T04:40:30.570 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.570 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.570 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.571 INFO:teuthology.orchestra.run.smithi112.stdout: "interval": { 2023-10-06T04:40:30.571 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "interval", 2023-10-06T04:40:30.571 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.571 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.571 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.571 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "60", 2023-10-06T04:40:30.571 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.571 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.571 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.571 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "How frequently to reexamine health status", 2023-10-06T04:40:30.571 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.571 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.572 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.572 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.572 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.572 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.572 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.572 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.572 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.572 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.572 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.572 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.573 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.573 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.573 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.573 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.573 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.573 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.573 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.573 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.573 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.573 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.573 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.574 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.574 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.574 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.574 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.574 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.574 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.574 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.574 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.574 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.574 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.574 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.575 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.575 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.575 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.575 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.575 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.575 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.575 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.575 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.575 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.575 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.576 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.576 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.576 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.576 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.576 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.576 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.576 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.576 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.576 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.576 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.576 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.576 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.577 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.577 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.577 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.577 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.577 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.577 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.577 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.577 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.577 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.577 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.577 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.578 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.578 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.578 INFO:teuthology.orchestra.run.smithi112.stdout: "smtp_destination": { 2023-10-06T04:40:30.578 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "smtp_destination", 2023-10-06T04:40:30.578 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.578 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.578 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.578 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.578 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.578 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.579 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.579 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Email address to send alerts to", 2023-10-06T04:40:30.579 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.579 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.579 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.579 INFO:teuthology.orchestra.run.smithi112.stdout: "smtp_from_name": { 2023-10-06T04:40:30.579 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "smtp_from_name", 2023-10-06T04:40:30.579 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.579 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.579 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.579 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "Ceph", 2023-10-06T04:40:30.580 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.580 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.580 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.580 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Email From: name", 2023-10-06T04:40:30.580 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.580 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.580 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.580 INFO:teuthology.orchestra.run.smithi112.stdout: "smtp_host": { 2023-10-06T04:40:30.580 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "smtp_host", 2023-10-06T04:40:30.580 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.580 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.581 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.581 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.581 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.581 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.581 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.581 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "SMTP server", 2023-10-06T04:40:30.581 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.581 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.581 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.581 INFO:teuthology.orchestra.run.smithi112.stdout: "smtp_password": { 2023-10-06T04:40:30.581 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "smtp_password", 2023-10-06T04:40:30.582 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.582 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.582 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.582 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.582 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.582 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.582 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.582 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Password to authenticate with", 2023-10-06T04:40:30.582 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.582 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.582 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.583 INFO:teuthology.orchestra.run.smithi112.stdout: "smtp_port": { 2023-10-06T04:40:30.583 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "smtp_port", 2023-10-06T04:40:30.583 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.583 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.583 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.583 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "465", 2023-10-06T04:40:30.583 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.583 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.583 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.583 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "SMTP port", 2023-10-06T04:40:30.583 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.583 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.584 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.584 INFO:teuthology.orchestra.run.smithi112.stdout: "smtp_sender": { 2023-10-06T04:40:30.584 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "smtp_sender", 2023-10-06T04:40:30.584 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.584 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.584 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.584 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.584 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.584 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.584 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.584 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "SMTP envelope sender", 2023-10-06T04:40:30.585 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.585 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.585 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.585 INFO:teuthology.orchestra.run.smithi112.stdout: "smtp_ssl": { 2023-10-06T04:40:30.585 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "smtp_ssl", 2023-10-06T04:40:30.585 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.585 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.585 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.585 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.585 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.585 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.586 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.586 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-06T04:40:30.586 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.586 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.586 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.586 INFO:teuthology.orchestra.run.smithi112.stdout: "smtp_user": { 2023-10-06T04:40:30.586 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "smtp_user", 2023-10-06T04:40:30.586 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.586 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.586 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.587 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.587 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.587 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.587 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.587 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "User to authenticate as", 2023-10-06T04:40:30.587 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.587 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.587 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.587 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.587 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.588 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "balancer", 2023-10-06T04:40:30.588 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.588 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.588 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.588 INFO:teuthology.orchestra.run.smithi112.stdout: "active": { 2023-10-06T04:40:30.588 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "active", 2023-10-06T04:40:30.588 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.588 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.588 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.588 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.589 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.589 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.589 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.589 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "automatically balance PGs across cluster", 2023-10-06T04:40:30.589 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.589 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.589 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.589 INFO:teuthology.orchestra.run.smithi112.stdout: "begin_time": { 2023-10-06T04:40:30.589 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "begin_time", 2023-10-06T04:40:30.589 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.589 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.590 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.590 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "0000", 2023-10-06T04:40:30.590 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.590 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.590 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.590 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "beginning time of day to automatically balance", 2023-10-06T04:40:30.590 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-06T04:40:30.590 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.590 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.591 INFO:teuthology.orchestra.run.smithi112.stdout: "begin_weekday": { 2023-10-06T04:40:30.591 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "begin_weekday", 2023-10-06T04:40:30.591 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "uint", 2023-10-06T04:40:30.591 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.591 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.591 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "0", 2023-10-06T04:40:30.591 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "0", 2023-10-06T04:40:30.591 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "7", 2023-10-06T04:40:30.591 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.591 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-06T04:40:30.591 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-10-06T04:40:30.591 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.592 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.592 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_compat_max_iterations": { 2023-10-06T04:40:30.592 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "crush_compat_max_iterations", 2023-10-06T04:40:30.592 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "uint", 2023-10-06T04:40:30.592 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.592 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.592 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "25", 2023-10-06T04:40:30.592 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "1", 2023-10-06T04:40:30.592 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "250", 2023-10-06T04:40:30.592 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.592 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-06T04:40:30.593 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.593 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.593 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.593 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_compat_metrics": { 2023-10-06T04:40:30.593 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "crush_compat_metrics", 2023-10-06T04:40:30.593 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.593 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.593 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.593 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "pgs,objects,bytes", 2023-10-06T04:40:30.593 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.593 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.593 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.594 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-06T04:40:30.594 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-06T04:40:30.594 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.594 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.594 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_compat_step": { 2023-10-06T04:40:30.594 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "crush_compat_step", 2023-10-06T04:40:30.594 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "float", 2023-10-06T04:40:30.594 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.594 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.594 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "0.5", 2023-10-06T04:40:30.595 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "0.001", 2023-10-06T04:40:30.595 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "0.999", 2023-10-06T04:40:30.595 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.595 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "aggressiveness of optimization", 2023-10-06T04:40:30.595 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-06T04:40:30.595 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.595 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.595 INFO:teuthology.orchestra.run.smithi112.stdout: "end_time": { 2023-10-06T04:40:30.595 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "end_time", 2023-10-06T04:40:30.595 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.595 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.595 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.596 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "2400", 2023-10-06T04:40:30.596 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.596 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.596 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.596 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "ending time of day to automatically balance", 2023-10-06T04:40:30.596 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-06T04:40:30.596 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.596 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.596 INFO:teuthology.orchestra.run.smithi112.stdout: "end_weekday": { 2023-10-06T04:40:30.596 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "end_weekday", 2023-10-06T04:40:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "uint", 2023-10-06T04:40:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "7", 2023-10-06T04:40:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "0", 2023-10-06T04:40:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "7", 2023-10-06T04:40:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-06T04:40:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-10-06T04:40:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.600 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.600 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.600 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.600 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.600 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.600 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.600 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.600 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.600 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.600 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: "min_score": { 2023-10-06T04:40:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "min_score", 2023-10-06T04:40:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "float", 2023-10-06T04:40:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "0", 2023-10-06T04:40:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-06T04:40:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: "mode": { 2023-10-06T04:40:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "mode", 2023-10-06T04:40:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "upmap", 2023-10-06T04:40:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-compat", 2023-10-06T04:40:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: "none", 2023-10-06T04:40:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: "upmap" 2023-10-06T04:40:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Balancer mode", 2023-10-06T04:40:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_ids": { 2023-10-06T04:40:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "pool_ids", 2023-10-06T04:40:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-06T04:40:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: "sleep_interval": { 2023-10-06T04:40:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "sleep_interval", 2023-10-06T04:40:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "60", 2023-10-06T04:40:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-06T04:40:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: "upmap_max_deviation": { 2023-10-06T04:40:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "upmap_max_deviation", 2023-10-06T04:40:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "5", 2023-10-06T04:40:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "1", 2023-10-06T04:40:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-06T04:40:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-06T04:40:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: "upmap_max_optimizations": { 2023-10-06T04:40:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "upmap_max_optimizations", 2023-10-06T04:40:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "uint", 2023-10-06T04:40:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "10", 2023-10-06T04:40:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-06T04:40:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "cephadm", 2023-10-06T04:40:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: "agent_down_multiplier": { 2023-10-06T04:40:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "agent_down_multiplier", 2023-10-06T04:40:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "float", 2023-10-06T04:40:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "3.0", 2023-10-06T04:40:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-06T04:40:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: "agent_refresh_rate": { 2023-10-06T04:40:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "agent_refresh_rate", 2023-10-06T04:40:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "20", 2023-10-06T04:40:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-06T04:40:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: "agent_starting_port": { 2023-10-06T04:40:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "agent_starting_port", 2023-10-06T04:40:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "4721", 2023-10-06T04:40:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-06T04:40:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_ptrace": { 2023-10-06T04:40:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "allow_ptrace", 2023-10-06T04:40:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-06T04:40:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-06T04:40:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: "autotune_interval": { 2023-10-06T04:40:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "autotune_interval", 2023-10-06T04:40:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "600", 2023-10-06T04:40:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-06T04:40:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: "autotune_memory_target_ratio": { 2023-10-06T04:40:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "autotune_memory_target_ratio", 2023-10-06T04:40:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "float", 2023-10-06T04:40:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "0.7", 2023-10-06T04:40:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-06T04:40:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: "cgroups_split": { 2023-10-06T04:40:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "cgroups_split", 2023-10-06T04:40:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-06T04:40:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: "config_checks_enabled": { 2023-10-06T04:40:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "config_checks_enabled", 2023-10-06T04:40:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-06T04:40:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "config_dashboard": { 2023-10-06T04:40:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "config_dashboard", 2023-10-06T04:40:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-06T04:40:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image_alertmanager": { 2023-10-06T04:40:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_image_alertmanager", 2023-10-06T04:40:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-06T04:40:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Prometheus container image", 2023-10-06T04:40:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image_base": { 2023-10-06T04:40:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_image_base", 2023-10-06T04:40:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-06T04:40:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Container image name, without the tag", 2023-10-06T04:40:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image_grafana": { 2023-10-06T04:40:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_image_grafana", 2023-10-06T04:40:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-06T04:40:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Prometheus container image", 2023-10-06T04:40:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image_haproxy": { 2023-10-06T04:40:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_image_haproxy", 2023-10-06T04:40:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-06T04:40:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "HAproxy container image", 2023-10-06T04:40:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image_keepalived": { 2023-10-06T04:40:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_image_keepalived", 2023-10-06T04:40:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "quay.io/ceph/keepalived:2.1.5", 2023-10-06T04:40:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Keepalived container image", 2023-10-06T04:40:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image_loki": { 2023-10-06T04:40:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_image_loki", 2023-10-06T04:40:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-06T04:40:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Loki container image", 2023-10-06T04:40:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image_node_exporter": { 2023-10-06T04:40:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_image_node_exporter", 2023-10-06T04:40:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-06T04:40:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Prometheus container image", 2023-10-06T04:40:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image_prometheus": { 2023-10-06T04:40:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_image_prometheus", 2023-10-06T04:40:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-06T04:40:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Prometheus container image", 2023-10-06T04:40:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image_promtail": { 2023-10-06T04:40:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_image_promtail", 2023-10-06T04:40:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-06T04:40:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Promtail container image", 2023-10-06T04:40:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image_snmp_gateway": { 2023-10-06T04:40:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_image_snmp_gateway", 2023-10-06T04:40:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-06T04:40:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "SNMP Gateway container image", 2023-10-06T04:40:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: "container_init": { 2023-10-06T04:40:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "container_init", 2023-10-06T04:40:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Run podman/docker with `--init`", 2023-10-06T04:40:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: "daemon_cache_timeout": { 2023-10-06T04:40:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "daemon_cache_timeout", 2023-10-06T04:40:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "600", 2023-10-06T04:40:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-06T04:40:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: "default_cephadm_command_timeout": { 2023-10-06T04:40:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "default_cephadm_command_timeout", 2023-10-06T04:40:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "900", 2023-10-06T04:40:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-06T04:40:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: "default_registry": { 2023-10-06T04:40:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "default_registry", 2023-10-06T04:40:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "docker.io", 2023-10-06T04:40:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-06T04:40:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: "device_cache_timeout": { 2023-10-06T04:40:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "device_cache_timeout", 2023-10-06T04:40:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "1800", 2023-10-06T04:40:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "seconds to cache device inventory", 2023-10-06T04:40:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: "device_enhanced_scan": { 2023-10-06T04:40:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "device_enhanced_scan", 2023-10-06T04:40:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-06T04:40:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: "facts_cache_timeout": { 2023-10-06T04:40:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "facts_cache_timeout", 2023-10-06T04:40:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "60", 2023-10-06T04:40:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "seconds to cache host facts data", 2023-10-06T04:40:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: "host_check_interval": { 2023-10-06T04:40:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "host_check_interval", 2023-10-06T04:40:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "600", 2023-10-06T04:40:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "how frequently to perform a host check", 2023-10-06T04:40:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "inventory_list_all": { 2023-10-06T04:40:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "inventory_list_all", 2023-10-06T04:40:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-06T04:40:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: "log_refresh_metadata": { 2023-10-06T04:40:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_refresh_metadata", 2023-10-06T04:40:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-06T04:40:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-06T04:40:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-06T04:40:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-06T04:40:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-06T04:40:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-06T04:40:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-06T04:40:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "*", 2023-10-06T04:40:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-06T04:40:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: "max_count_per_host": { 2023-10-06T04:40:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "max_count_per_host", 2023-10-06T04:40:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.655 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.655 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "10", 2023-10-06T04:40:30.655 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.657 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.657 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.657 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "max number of daemons per service per host", 2023-10-06T04:40:30.657 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.657 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.657 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd_draining_count": { 2023-10-06T04:40:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "max_osd_draining_count", 2023-10-06T04:40:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "10", 2023-10-06T04:40:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-06T04:40:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: "migration_current": { 2023-10-06T04:40:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "migration_current", 2023-10-06T04:40:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "internal - do not modify", 2023-10-06T04:40:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: "mode": { 2023-10-06T04:40:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "mode", 2023-10-06T04:40:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "root", 2023-10-06T04:40:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: "cephadm-package", 2023-10-06T04:40:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: "root" 2023-10-06T04:40:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "mode for remote execution of cephadm", 2023-10-06T04:40:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: "prometheus_alerts_path": { 2023-10-06T04:40:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "prometheus_alerts_path", 2023-10-06T04:40:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-06T04:40:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-06T04:40:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: "registry_insecure": { 2023-10-06T04:40:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "registry_insecure", 2023-10-06T04:40:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-06T04:40:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: "registry_password": { 2023-10-06T04:40:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "registry_password", 2023-10-06T04:40:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-06T04:40:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: "registry_url": { 2023-10-06T04:40:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "registry_url", 2023-10-06T04:40:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-06T04:40:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: "registry_username": { 2023-10-06T04:40:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "registry_username", 2023-10-06T04:40:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-06T04:40:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "ssh_config_file": { 2023-10-06T04:40:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "ssh_config_file", 2023-10-06T04:40:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-06T04:40:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: "use_agent": { 2023-10-06T04:40:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "use_agent", 2023-10-06T04:40:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-06T04:40:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: "use_repo_digest": { 2023-10-06T04:40:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "use_repo_digest", 2023-10-06T04:40:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-06T04:40:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: "warn_on_failed_host_check": { 2023-10-06T04:40:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "warn_on_failed_host_check", 2023-10-06T04:40:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "raise a health warning if the host check fails", 2023-10-06T04:40:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: "warn_on_stray_daemons": { 2023-10-06T04:40:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "warn_on_stray_daemons", 2023-10-06T04:40:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-06T04:40:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "warn_on_stray_hosts": { 2023-10-06T04:40:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "warn_on_stray_hosts", 2023-10-06T04:40:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-06T04:40:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "crash", 2023-10-06T04:40:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: "retain_interval": { 2023-10-06T04:40:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "retain_interval", 2023-10-06T04:40:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "31536000", 2023-10-06T04:40:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-06T04:40:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: "warn_recent_interval": { 2023-10-06T04:40:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "warn_recent_interval", 2023-10-06T04:40:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "1209600", 2023-10-06T04:40:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-06T04:40:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "dashboard", 2023-10-06T04:40:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-06T04:40:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-06T04:40:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "10", 2023-10-06T04:40:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: "ALERTMANAGER_API_HOST": { 2023-10-06T04:40:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-06T04:40:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-06T04:40:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-06T04:40:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: "AUDIT_API_ENABLED": { 2023-10-06T04:40:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "AUDIT_API_ENABLED", 2023-10-06T04:40:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-06T04:40:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-06T04:40:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: "ENABLE_BROWSABLE_API": { 2023-10-06T04:40:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-06T04:40:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-06T04:40:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-06T04:40:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-06T04:40:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-06T04:40:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-06T04:40:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-06T04:40:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-06T04:40:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-06T04:40:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-06T04:40:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-06T04:40:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-06T04:40:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-06T04:40:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-06T04:40:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-06T04:40:30.699 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.699 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.699 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.699 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.699 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.699 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.699 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-06T04:40:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-06T04:40:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "GRAFANA_API_PASSWORD": { 2023-10-06T04:40:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-06T04:40:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "admin", 2023-10-06T04:40:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-06T04:40:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-06T04:40:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: "GRAFANA_API_URL": { 2023-10-06T04:40:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "GRAFANA_API_URL", 2023-10-06T04:40:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: "GRAFANA_API_USERNAME": { 2023-10-06T04:40:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-06T04:40:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "admin", 2023-10-06T04:40:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-06T04:40:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-06T04:40:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-06T04:40:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-06T04:40:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-06T04:40:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-06T04:40:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-06T04:40:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-06T04:40:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: "PROMETHEUS_API_HOST": { 2023-10-06T04:40:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-06T04:40:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.712 INFO:teuthology.orchestra.run.smithi112.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-06T04:40:30.712 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-06T04:40:30.712 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.712 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.712 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.712 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.712 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.712 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.712 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.712 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.712 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.712 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.713 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.713 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-06T04:40:30.713 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-06T04:40:30.713 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.713 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.713 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.713 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.713 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.713 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.713 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.714 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.714 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.714 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.714 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.714 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-06T04:40:30.714 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-06T04:40:30.714 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.714 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.714 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.714 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.714 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.715 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.715 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.715 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.715 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.715 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.715 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.715 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-06T04:40:30.715 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-06T04:40:30.715 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.715 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.715 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.716 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.716 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.716 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.716 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.716 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.716 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.716 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.716 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.716 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-06T04:40:30.716 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-06T04:40:30.716 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.717 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.717 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.717 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.717 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.717 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.717 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.717 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.717 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.717 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.717 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.717 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-06T04:40:30.718 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-06T04:40:30.718 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.718 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.718 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.718 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.718 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.718 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.718 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.718 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.718 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.718 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.718 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.719 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-06T04:40:30.719 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-06T04:40:30.719 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.719 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.719 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.719 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.719 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.719 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.719 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.719 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.719 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.719 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.720 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.720 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-06T04:40:30.720 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-06T04:40:30.720 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.720 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.720 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.720 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.720 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.720 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.720 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.721 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.721 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.721 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.721 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.721 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_ENABLED": { 2023-10-06T04:40:30.721 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-06T04:40:30.721 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.721 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.721 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.721 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.721 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.721 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.722 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.722 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.722 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.722 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.722 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.722 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-06T04:40:30.722 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-06T04:40:30.722 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.722 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.722 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.723 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-06T04:40:30.723 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.723 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.723 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.723 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.723 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.723 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.723 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.723 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-06T04:40:30.723 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-06T04:40:30.723 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.724 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.724 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.724 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "10", 2023-10-06T04:40:30.724 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.724 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.724 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.724 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.724 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.724 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.724 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.725 INFO:teuthology.orchestra.run.smithi112.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-06T04:40:30.725 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-06T04:40:30.725 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.725 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.725 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.725 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "8", 2023-10-06T04:40:30.725 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.725 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.725 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.725 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.725 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.726 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.726 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.726 INFO:teuthology.orchestra.run.smithi112.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-06T04:40:30.726 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-06T04:40:30.726 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.726 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.726 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.726 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "45", 2023-10-06T04:40:30.726 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.726 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.726 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.727 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.727 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.727 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.727 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.727 INFO:teuthology.orchestra.run.smithi112.stdout: "RGW_API_ACCESS_KEY": { 2023-10-06T04:40:30.727 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-06T04:40:30.727 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.727 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.727 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.727 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.728 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.728 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.728 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.728 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.728 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.728 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.728 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.728 INFO:teuthology.orchestra.run.smithi112.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-06T04:40:30.728 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-06T04:40:30.728 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.728 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.729 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.729 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "admin", 2023-10-06T04:40:30.729 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.729 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.729 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.729 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.729 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.729 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.729 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.729 INFO:teuthology.orchestra.run.smithi112.stdout: "RGW_API_SECRET_KEY": { 2023-10-06T04:40:30.729 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-06T04:40:30.730 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.730 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.730 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.730 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.730 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.730 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.730 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.730 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.730 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.730 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.730 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.731 INFO:teuthology.orchestra.run.smithi112.stdout: "RGW_API_SSL_VERIFY": { 2023-10-06T04:40:30.731 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-06T04:40:30.731 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.731 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.731 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.731 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.731 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.731 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.731 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.731 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.731 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.732 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.732 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.732 INFO:teuthology.orchestra.run.smithi112.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-06T04:40:30.732 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-06T04:40:30.732 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.732 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.732 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.732 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "0", 2023-10-06T04:40:30.732 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.732 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.732 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.732 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.733 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.733 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.733 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.733 INFO:teuthology.orchestra.run.smithi112.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-06T04:40:30.733 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-06T04:40:30.733 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.733 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.733 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.733 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "10", 2023-10-06T04:40:30.733 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.734 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.734 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.734 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.734 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.734 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.734 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.734 INFO:teuthology.orchestra.run.smithi112.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-06T04:40:30.734 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-06T04:40:30.734 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.734 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.734 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.734 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "5", 2023-10-06T04:40:30.735 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.735 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.735 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.735 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.735 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.735 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.735 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.735 INFO:teuthology.orchestra.run.smithi112.stdout: "cross_origin_url": { 2023-10-06T04:40:30.735 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "cross_origin_url", 2023-10-06T04:40:30.735 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.736 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.736 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.736 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.736 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.736 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.736 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.736 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.736 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.736 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.736 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.736 INFO:teuthology.orchestra.run.smithi112.stdout: "crt_file": { 2023-10-06T04:40:30.737 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "crt_file", 2023-10-06T04:40:30.737 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.737 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.737 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.737 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.737 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.737 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.737 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.737 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.737 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.737 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.737 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.738 INFO:teuthology.orchestra.run.smithi112.stdout: "debug": { 2023-10-06T04:40:30.738 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "debug", 2023-10-06T04:40:30.738 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.738 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.738 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.738 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.738 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.738 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.738 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.738 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Enable/disable debug options", 2023-10-06T04:40:30.738 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.739 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.739 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.739 INFO:teuthology.orchestra.run.smithi112.stdout: "jwt_token_ttl": { 2023-10-06T04:40:30.739 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "jwt_token_ttl", 2023-10-06T04:40:30.739 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.739 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.739 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.739 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "28800", 2023-10-06T04:40:30.740 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.740 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.740 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.740 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.740 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.740 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.740 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.740 INFO:teuthology.orchestra.run.smithi112.stdout: "key_file": { 2023-10-06T04:40:30.740 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "key_file", 2023-10-06T04:40:30.740 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.741 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.741 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.741 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.741 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.741 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.741 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.741 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.741 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.741 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.741 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.741 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.742 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.742 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.742 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.742 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.742 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.742 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.742 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.742 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.742 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.742 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.742 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.743 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.743 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.743 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.743 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.743 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.743 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.743 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.743 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.743 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.744 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.744 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.744 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.744 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.744 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.744 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.744 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.744 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.744 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.744 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.744 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.745 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.745 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.745 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.745 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.745 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.745 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.745 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.745 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.745 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.745 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.746 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.746 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.746 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.746 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.746 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.746 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.746 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.746 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.746 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.746 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.746 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.747 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.747 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.747 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.747 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.747 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.747 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.747 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.747 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.747 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.747 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.747 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.748 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.748 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.748 INFO:teuthology.orchestra.run.smithi112.stdout: "motd": { 2023-10-06T04:40:30.748 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "motd", 2023-10-06T04:40:30.748 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.748 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.748 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.748 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.748 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.748 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.748 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.748 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "The message of the day", 2023-10-06T04:40:30.749 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.749 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.749 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.749 INFO:teuthology.orchestra.run.smithi112.stdout: "redirect_resolve_ip_addr": { 2023-10-06T04:40:30.749 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "redirect_resolve_ip_addr", 2023-10-06T04:40:30.749 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.749 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.749 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.749 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.749 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.750 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.750 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.750 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.750 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.750 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.750 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.750 INFO:teuthology.orchestra.run.smithi112.stdout: "server_addr": { 2023-10-06T04:40:30.750 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "server_addr", 2023-10-06T04:40:30.750 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.750 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.751 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.751 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "::", 2023-10-06T04:40:30.751 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.751 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.751 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.751 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.751 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.751 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.751 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.751 INFO:teuthology.orchestra.run.smithi112.stdout: "server_port": { 2023-10-06T04:40:30.751 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "server_port", 2023-10-06T04:40:30.752 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.752 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.752 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.752 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "8080", 2023-10-06T04:40:30.752 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.752 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.752 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.752 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.752 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.752 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.752 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.752 INFO:teuthology.orchestra.run.smithi112.stdout: "ssl": { 2023-10-06T04:40:30.753 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "ssl", 2023-10-06T04:40:30.753 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.753 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.753 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.753 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.753 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.753 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.753 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.753 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.753 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.753 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.753 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.754 INFO:teuthology.orchestra.run.smithi112.stdout: "ssl_server_port": { 2023-10-06T04:40:30.754 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "ssl_server_port", 2023-10-06T04:40:30.754 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.754 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.754 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.754 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "8443", 2023-10-06T04:40:30.754 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.754 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.754 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.754 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.755 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.755 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.755 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.755 INFO:teuthology.orchestra.run.smithi112.stdout: "standby_behaviour": { 2023-10-06T04:40:30.755 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "standby_behaviour", 2023-10-06T04:40:30.755 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.755 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.755 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.755 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "redirect", 2023-10-06T04:40:30.755 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.755 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.755 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.756 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.756 INFO:teuthology.orchestra.run.smithi112.stdout: "redirect" 2023-10-06T04:40:30.756 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.756 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.756 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.756 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.756 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.756 INFO:teuthology.orchestra.run.smithi112.stdout: "standby_error_status_code": { 2023-10-06T04:40:30.756 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "standby_error_status_code", 2023-10-06T04:40:30.756 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.757 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.757 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.757 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "500", 2023-10-06T04:40:30.757 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "400", 2023-10-06T04:40:30.757 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "599", 2023-10-06T04:40:30.757 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.757 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.757 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.757 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.757 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.757 INFO:teuthology.orchestra.run.smithi112.stdout: "url_prefix": { 2023-10-06T04:40:30.758 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "url_prefix", 2023-10-06T04:40:30.758 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.758 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.758 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.758 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.758 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.758 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.758 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.758 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.758 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.758 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.758 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.759 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.759 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.759 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "devicehealth", 2023-10-06T04:40:30.759 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.759 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.759 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.759 INFO:teuthology.orchestra.run.smithi112.stdout: "enable_monitoring": { 2023-10-06T04:40:30.759 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "enable_monitoring", 2023-10-06T04:40:30.759 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.760 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.760 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.760 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.760 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.760 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.760 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.760 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "monitor device health metrics", 2023-10-06T04:40:30.760 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.760 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.760 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.760 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.761 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.761 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.761 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.761 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.761 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.761 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.761 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.761 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.761 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.761 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.761 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.761 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.762 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.762 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.762 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.762 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.762 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.762 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.762 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.762 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.762 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.762 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.762 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.763 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.763 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.763 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.763 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.763 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.763 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.763 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.763 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.763 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.763 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.763 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.764 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.764 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.764 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.764 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.764 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.764 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.764 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.764 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.764 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.764 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.764 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.764 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.765 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.765 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.765 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.765 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.765 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.765 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.765 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.765 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.765 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.765 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.765 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.766 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.766 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.766 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.766 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.766 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.766 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.766 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.766 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.766 INFO:teuthology.orchestra.run.smithi112.stdout: "mark_out_threshold": { 2023-10-06T04:40:30.766 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "mark_out_threshold", 2023-10-06T04:40:30.767 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.767 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.767 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.767 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "2419200", 2023-10-06T04:40:30.767 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.767 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.767 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.767 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-06T04:40:30.767 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.767 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.767 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.768 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": { 2023-10-06T04:40:30.768 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "pool_name", 2023-10-06T04:40:30.768 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.768 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.768 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.768 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "device_health_metrics", 2023-10-06T04:40:30.768 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.768 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.768 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.768 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-06T04:40:30.768 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.769 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.769 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.769 INFO:teuthology.orchestra.run.smithi112.stdout: "retention_period": { 2023-10-06T04:40:30.769 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "retention_period", 2023-10-06T04:40:30.769 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.769 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.769 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.769 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "15552000", 2023-10-06T04:40:30.769 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.769 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.770 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.770 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "how long to retain device health metrics", 2023-10-06T04:40:30.770 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.770 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.770 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.770 INFO:teuthology.orchestra.run.smithi112.stdout: "scrape_frequency": { 2023-10-06T04:40:30.770 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "scrape_frequency", 2023-10-06T04:40:30.770 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.770 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.770 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.771 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "86400", 2023-10-06T04:40:30.771 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.771 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.771 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.771 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-06T04:40:30.771 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.771 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.771 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.771 INFO:teuthology.orchestra.run.smithi112.stdout: "self_heal": { 2023-10-06T04:40:30.771 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "self_heal", 2023-10-06T04:40:30.771 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.772 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.772 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.772 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.772 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.772 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.772 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.772 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-06T04:40:30.772 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.772 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.772 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.772 INFO:teuthology.orchestra.run.smithi112.stdout: "sleep_interval": { 2023-10-06T04:40:30.773 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "sleep_interval", 2023-10-06T04:40:30.773 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.773 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.773 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.773 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "600", 2023-10-06T04:40:30.773 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.773 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.773 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.773 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "how frequently to wake up and check device health", 2023-10-06T04:40:30.773 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.773 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.773 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.774 INFO:teuthology.orchestra.run.smithi112.stdout: "warn_threshold": { 2023-10-06T04:40:30.774 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "warn_threshold", 2023-10-06T04:40:30.774 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.774 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.774 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.774 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "7257600", 2023-10-06T04:40:30.774 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.774 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.774 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.774 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-06T04:40:30.775 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.775 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.775 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.775 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.775 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.775 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "diskprediction_local", 2023-10-06T04:40:30.775 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.775 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.775 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.776 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.776 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.776 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.776 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.776 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.776 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.776 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.776 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.776 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.776 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.776 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.776 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.776 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.776 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.777 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.777 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.777 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.777 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.777 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.777 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.777 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.777 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.777 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.777 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.777 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.777 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.778 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.778 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.778 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.778 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.778 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.778 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.778 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.778 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.778 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.778 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.778 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.779 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.779 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.779 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.779 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.779 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.779 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.779 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.779 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.779 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.779 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.779 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.779 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.780 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.780 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.780 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.780 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.780 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.780 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.780 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.780 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.780 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.780 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.780 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.780 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.781 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.781 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.781 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.781 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.781 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.781 INFO:teuthology.orchestra.run.smithi112.stdout: "predict_interval": { 2023-10-06T04:40:30.781 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "predict_interval", 2023-10-06T04:40:30.781 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.781 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.781 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.782 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "86400", 2023-10-06T04:40:30.782 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.782 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.782 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.782 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.782 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.782 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.782 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.782 INFO:teuthology.orchestra.run.smithi112.stdout: "predictor_model": { 2023-10-06T04:40:30.782 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "predictor_model", 2023-10-06T04:40:30.782 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.783 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.783 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.783 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "prophetstor", 2023-10-06T04:40:30.783 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.783 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.783 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.783 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.783 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.783 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.783 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.784 INFO:teuthology.orchestra.run.smithi112.stdout: "sleep_interval": { 2023-10-06T04:40:30.784 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "sleep_interval", 2023-10-06T04:40:30.784 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.784 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.784 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.784 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "600", 2023-10-06T04:40:30.784 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.784 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.784 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.784 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.784 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.785 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.785 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.785 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.785 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.785 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "influx", 2023-10-06T04:40:30.785 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": false, 2023-10-06T04:40:30.785 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "influxdb python module not found", 2023-10-06T04:40:30.785 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.785 INFO:teuthology.orchestra.run.smithi112.stdout: "batch_size": { 2023-10-06T04:40:30.786 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "batch_size", 2023-10-06T04:40:30.786 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.786 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.786 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.786 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "5000", 2023-10-06T04:40:30.786 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.786 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.786 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.786 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-06T04:40:30.786 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.786 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.786 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.787 INFO:teuthology.orchestra.run.smithi112.stdout: "database": { 2023-10-06T04:40:30.787 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "database", 2023-10-06T04:40:30.787 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.787 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.787 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.787 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "ceph", 2023-10-06T04:40:30.787 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.787 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.787 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.787 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-06T04:40:30.787 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.788 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.788 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.788 INFO:teuthology.orchestra.run.smithi112.stdout: "hostname": { 2023-10-06T04:40:30.788 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "hostname", 2023-10-06T04:40:30.788 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.788 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.788 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.788 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.788 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.788 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.788 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.789 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "InfluxDB server hostname", 2023-10-06T04:40:30.789 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.789 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.789 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.789 INFO:teuthology.orchestra.run.smithi112.stdout: "interval": { 2023-10-06T04:40:30.789 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "interval", 2023-10-06T04:40:30.789 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.789 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.789 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.789 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "30", 2023-10-06T04:40:30.789 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "5", 2023-10-06T04:40:30.790 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.790 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.790 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-06T04:40:30.790 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.790 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.790 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.790 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.790 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.790 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.790 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.790 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.791 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.791 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.791 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.791 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.791 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.791 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.791 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.791 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.791 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.791 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.791 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.792 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.792 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.792 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.792 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.792 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.792 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.792 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.792 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.792 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.792 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.792 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.793 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.793 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.793 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.793 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.793 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.793 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.793 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.793 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.793 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.793 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.793 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.793 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.794 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.794 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.794 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.794 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.794 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.794 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.794 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.794 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.794 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.794 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.794 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.795 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.795 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.795 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.795 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.795 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.795 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.795 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.795 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.795 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.795 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.796 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.796 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.796 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.796 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.796 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.796 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.796 INFO:teuthology.orchestra.run.smithi112.stdout: "password": { 2023-10-06T04:40:30.796 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "password", 2023-10-06T04:40:30.796 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.796 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.797 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.797 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.797 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.797 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.797 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.797 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "password of InfluxDB server user", 2023-10-06T04:40:30.797 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.797 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.797 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.797 INFO:teuthology.orchestra.run.smithi112.stdout: "port": { 2023-10-06T04:40:30.798 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "port", 2023-10-06T04:40:30.798 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.798 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.798 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.798 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "8086", 2023-10-06T04:40:30.798 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.798 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.798 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.798 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "InfluxDB server port", 2023-10-06T04:40:30.798 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.798 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.799 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.799 INFO:teuthology.orchestra.run.smithi112.stdout: "ssl": { 2023-10-06T04:40:30.799 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "ssl", 2023-10-06T04:40:30.799 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.799 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.799 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.799 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "false", 2023-10-06T04:40:30.799 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.799 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.799 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.800 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-06T04:40:30.800 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.800 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.800 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.800 INFO:teuthology.orchestra.run.smithi112.stdout: "threads": { 2023-10-06T04:40:30.800 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "threads", 2023-10-06T04:40:30.800 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.800 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.800 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.800 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "5", 2023-10-06T04:40:30.800 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "1", 2023-10-06T04:40:30.801 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "32", 2023-10-06T04:40:30.801 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.801 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-06T04:40:30.801 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.801 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.801 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.801 INFO:teuthology.orchestra.run.smithi112.stdout: "username": { 2023-10-06T04:40:30.801 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "username", 2023-10-06T04:40:30.801 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.801 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.801 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.802 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.802 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.802 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.802 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.802 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "username of InfluxDB server user", 2023-10-06T04:40:30.802 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.802 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.802 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.802 INFO:teuthology.orchestra.run.smithi112.stdout: "verify_ssl": { 2023-10-06T04:40:30.802 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "verify_ssl", 2023-10-06T04:40:30.803 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.803 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.803 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.803 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "true", 2023-10-06T04:40:30.803 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.803 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.803 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.803 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-06T04:40:30.803 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.803 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.803 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.804 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.804 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.804 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "insights", 2023-10-06T04:40:30.804 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.804 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.804 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.804 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.804 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.804 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.804 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.805 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.805 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.805 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.805 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.805 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.805 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.805 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.805 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.805 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.805 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.805 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.806 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.806 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.806 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.806 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.806 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.806 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.806 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.806 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.806 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.806 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.807 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.807 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.807 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.807 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.807 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.807 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.807 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.807 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.807 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.807 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.808 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.808 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.808 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.808 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.808 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.808 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.808 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.808 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.808 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.808 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.808 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.809 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.809 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.809 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.809 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.809 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.809 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.809 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.809 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.809 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.809 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.810 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.810 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.810 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.810 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.810 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.810 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.810 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.810 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.810 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.810 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.810 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.810 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.811 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "iostat", 2023-10-06T04:40:30.811 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.811 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.811 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.811 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.811 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.811 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.811 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.811 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.811 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.812 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.812 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.812 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.812 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.812 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.812 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.812 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.812 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.812 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.812 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.812 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.813 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.813 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.813 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.813 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.813 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.813 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.813 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.813 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.813 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.813 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.813 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.814 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.814 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.814 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.814 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.814 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.814 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.814 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.814 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.814 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.814 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.814 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.815 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.815 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.815 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.815 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.815 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.815 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.815 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.815 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.815 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.815 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.815 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.815 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.816 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.816 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.816 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.816 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.816 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.816 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.816 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.816 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.816 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.816 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.816 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.816 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.817 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.817 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.817 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.817 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.817 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.817 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "localpool", 2023-10-06T04:40:30.817 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.817 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.817 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.817 INFO:teuthology.orchestra.run.smithi112.stdout: "failure_domain": { 2023-10-06T04:40:30.818 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "failure_domain", 2023-10-06T04:40:30.818 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.818 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.818 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.818 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "host", 2023-10-06T04:40:30.818 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.818 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.818 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.818 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "failure domain for any created local pool", 2023-10-06T04:40:30.818 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-06T04:40:30.818 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.819 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.819 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.819 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.819 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.819 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.819 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.819 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.819 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.819 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.819 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.820 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.820 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.820 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.820 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.820 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.820 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.820 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.820 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.820 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.820 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.820 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.821 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.821 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.821 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.821 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.821 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.821 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.821 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.821 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.821 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.821 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.821 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.821 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.822 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.822 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.822 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.822 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.822 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.822 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.822 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.822 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.822 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.822 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.822 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.823 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.823 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.823 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.823 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.823 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.823 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.823 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.823 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.823 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.823 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.823 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.824 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.824 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.824 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.824 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.824 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.824 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.824 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.824 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.824 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.824 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.824 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.825 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.825 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": { 2023-10-06T04:40:30.825 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "min_size", 2023-10-06T04:40:30.825 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.825 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.825 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.825 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.825 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.825 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.825 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.825 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "default min_size for any created local pool", 2023-10-06T04:40:30.826 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-06T04:40:30.826 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.826 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.826 INFO:teuthology.orchestra.run.smithi112.stdout: "num_rep": { 2023-10-06T04:40:30.826 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "num_rep", 2023-10-06T04:40:30.826 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.826 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.826 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.826 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "3", 2023-10-06T04:40:30.826 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.826 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.827 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.827 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "default replica count for any created local pool", 2023-10-06T04:40:30.827 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.827 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.827 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.827 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": { 2023-10-06T04:40:30.827 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "pg_num", 2023-10-06T04:40:30.827 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.827 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.827 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.827 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "128", 2023-10-06T04:40:30.828 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.828 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.828 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.828 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "default pg_num for any created local pool", 2023-10-06T04:40:30.828 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.828 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.828 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.828 INFO:teuthology.orchestra.run.smithi112.stdout: "prefix": { 2023-10-06T04:40:30.828 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "prefix", 2023-10-06T04:40:30.828 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.829 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.829 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.829 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.829 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.829 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.829 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.829 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "name prefix for any created local pool", 2023-10-06T04:40:30.829 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.829 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.829 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.830 INFO:teuthology.orchestra.run.smithi112.stdout: "subtree": { 2023-10-06T04:40:30.830 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "subtree", 2023-10-06T04:40:30.830 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.830 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.830 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.830 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "rack", 2023-10-06T04:40:30.830 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.830 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.830 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.830 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-06T04:40:30.830 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-06T04:40:30.831 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.831 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.831 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.831 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.831 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "mds_autoscaler", 2023-10-06T04:40:30.831 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.831 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.831 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.831 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.831 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.832 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.832 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.832 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.832 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.832 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.832 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.832 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.832 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.832 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.832 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.832 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.832 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.833 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.833 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.833 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.833 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.833 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.833 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.833 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.833 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.833 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.833 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.833 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.833 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.834 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.834 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.834 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.834 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.834 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.834 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.834 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.834 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.834 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.835 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.835 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.835 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.835 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.835 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.835 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.835 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.835 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.835 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.835 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.835 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.836 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.836 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.836 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.836 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.836 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.836 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.836 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.836 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.836 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.836 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.837 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.837 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.837 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.837 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.837 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.837 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.837 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.837 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.837 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.837 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.837 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.837 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.838 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "mirroring", 2023-10-06T04:40:30.838 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.838 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.838 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.838 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.838 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.838 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.838 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.839 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.839 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.839 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.839 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.839 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.839 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.839 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.839 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.839 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.839 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.839 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.839 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.840 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.840 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.840 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.840 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.840 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.840 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.840 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.840 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.840 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.840 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.840 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.841 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.841 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.841 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.841 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.841 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.841 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.841 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.841 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.841 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.841 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.841 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.842 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.842 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.842 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.842 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.842 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.842 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.842 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.842 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.842 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.842 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.842 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.843 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.843 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.843 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.843 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.843 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.843 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.843 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.843 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.843 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.843 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.843 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.844 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.844 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.844 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.844 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.844 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.844 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.844 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.844 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.844 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "nfs", 2023-10-06T04:40:30.844 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.845 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.845 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.845 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.845 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.845 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.845 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.845 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.845 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.845 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.845 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.845 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.845 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.846 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.846 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.846 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.846 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.846 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.846 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.846 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.846 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.846 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.846 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.846 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.847 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.847 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.847 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.847 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.847 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.847 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.847 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.847 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.847 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.847 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.847 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.847 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.848 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.848 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.848 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.848 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.848 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.848 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.848 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.848 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.848 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.848 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.848 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.849 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.849 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.849 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.849 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.849 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.849 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.849 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.849 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.849 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.849 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.849 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.850 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.850 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.850 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.850 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.850 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.850 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.850 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.850 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.850 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.850 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.850 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.851 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.851 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.851 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "orchestrator", 2023-10-06T04:40:30.851 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.851 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.851 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.851 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.851 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.851 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.851 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.852 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.852 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.852 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.852 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.852 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.852 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.852 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.852 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.852 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.852 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.852 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.853 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.853 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.853 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.853 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.853 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.853 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.853 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.853 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.853 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.853 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.854 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.854 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.854 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.854 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.854 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.854 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.854 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.854 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.854 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.854 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.854 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.855 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.855 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.855 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.855 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.855 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.855 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.855 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.855 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.855 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.855 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.855 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.855 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.855 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.856 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.856 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.857 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.857 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.857 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.857 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.857 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.858 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.858 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.858 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.858 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.858 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.858 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.858 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.858 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.858 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.858 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.859 INFO:teuthology.orchestra.run.smithi112.stdout: "orchestrator": { 2023-10-06T04:40:30.859 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "orchestrator", 2023-10-06T04:40:30.859 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.859 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.859 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.859 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.859 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.859 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.859 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.859 INFO:teuthology.orchestra.run.smithi112.stdout: "cephadm", 2023-10-06T04:40:30.860 INFO:teuthology.orchestra.run.smithi112.stdout: "rook", 2023-10-06T04:40:30.860 INFO:teuthology.orchestra.run.smithi112.stdout: "test_orchestrator" 2023-10-06T04:40:30.860 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.860 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Orchestrator backend", 2023-10-06T04:40:30.860 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.860 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.860 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.860 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.860 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.861 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "osd_perf_query", 2023-10-06T04:40:30.861 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.861 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.861 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.861 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.861 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.861 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.861 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.861 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.861 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.861 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.861 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.861 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.862 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.862 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.862 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.862 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.862 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.862 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.862 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.862 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.862 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.862 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.862 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.863 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.863 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.863 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.863 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.863 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.863 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.863 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.863 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.863 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.863 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.863 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.864 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.864 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.864 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.864 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.864 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.864 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.864 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.864 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.864 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.864 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.864 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.865 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.865 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.865 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.865 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.865 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.865 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.865 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.865 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.865 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.865 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.865 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.865 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.866 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.866 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.866 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.866 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.866 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.866 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.866 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.866 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.866 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.866 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.867 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.867 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.867 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.867 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.867 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "osd_support", 2023-10-06T04:40:30.867 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.867 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.867 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.868 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.868 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.868 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.868 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.868 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.868 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.868 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.868 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.868 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.868 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.869 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.869 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.869 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.869 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.869 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.869 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.869 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.869 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.869 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.869 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.870 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.870 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.870 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.870 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.870 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.870 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.870 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.870 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.870 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.870 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.870 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.870 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.871 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.871 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.871 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.871 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.871 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.871 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.871 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.871 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.871 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.871 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.871 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.872 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.872 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.872 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.872 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.872 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.872 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.872 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.872 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.872 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.872 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.872 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.873 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.873 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.873 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.873 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.873 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.873 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.873 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.873 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.873 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.873 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.873 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.873 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.874 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.874 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.874 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "pg_autoscaler", 2023-10-06T04:40:30.874 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.874 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.874 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.874 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.874 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.874 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.874 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.875 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.875 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.875 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.875 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.875 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.875 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.875 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.875 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.875 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.875 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.875 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.875 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.876 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.876 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.876 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.876 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.876 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.876 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.876 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.876 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.876 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.876 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.876 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.877 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.877 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.877 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.877 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.877 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.877 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.877 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.877 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.877 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.877 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.877 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.877 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.878 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.878 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.878 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.878 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.878 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.878 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.878 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.878 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.878 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.878 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.878 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.879 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.879 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.879 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.879 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.879 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.879 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.879 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.879 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.879 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.879 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.879 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.880 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.880 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.880 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.880 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.880 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.880 INFO:teuthology.orchestra.run.smithi112.stdout: "sleep_interval": { 2023-10-06T04:40:30.880 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "sleep_interval", 2023-10-06T04:40:30.880 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.880 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.880 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.881 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "60", 2023-10-06T04:40:30.881 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.881 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.881 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.881 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.881 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.881 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.881 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.881 INFO:teuthology.orchestra.run.smithi112.stdout: "threshold": { 2023-10-06T04:40:30.881 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "threshold", 2023-10-06T04:40:30.881 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "float", 2023-10-06T04:40:30.881 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.882 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.882 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "3.0", 2023-10-06T04:40:30.882 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "1.0", 2023-10-06T04:40:30.882 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.882 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.882 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "scaling threshold", 2023-10-06T04:40:30.882 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-06T04:40:30.882 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.882 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.882 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.882 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.883 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "progress", 2023-10-06T04:40:30.883 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.883 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.883 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.883 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_pg_recovery_event": { 2023-10-06T04:40:30.883 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "allow_pg_recovery_event", 2023-10-06T04:40:30.883 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.883 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.883 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.883 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.884 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.884 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.884 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.884 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-06T04:40:30.884 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.884 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.884 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.884 INFO:teuthology.orchestra.run.smithi112.stdout: "enabled": { 2023-10-06T04:40:30.884 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "enabled", 2023-10-06T04:40:30.884 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.884 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.884 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.885 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.885 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.885 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.885 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.885 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.885 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.885 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.885 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.885 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.885 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.886 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.886 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.886 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.886 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.886 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.886 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.886 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.886 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.886 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.886 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.886 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.887 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.887 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.887 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.887 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.887 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.887 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.887 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.887 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.887 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.887 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.888 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.888 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.888 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.888 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.888 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.888 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.888 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.888 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.889 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.889 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.889 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.889 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.889 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.889 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.889 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.889 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.889 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.889 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.890 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.890 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.890 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.890 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.890 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.890 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.890 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.890 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.890 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.890 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.890 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.890 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.891 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.891 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.891 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.891 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.891 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.891 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.891 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.891 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.891 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.891 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.892 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.892 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.892 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.892 INFO:teuthology.orchestra.run.smithi112.stdout: "max_completed_events": { 2023-10-06T04:40:30.892 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "max_completed_events", 2023-10-06T04:40:30.892 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.892 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.892 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.892 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "50", 2023-10-06T04:40:30.892 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.893 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.893 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.893 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "number of past completed events to remember", 2023-10-06T04:40:30.893 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.893 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.893 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.893 INFO:teuthology.orchestra.run.smithi112.stdout: "sleep_interval": { 2023-10-06T04:40:30.893 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "sleep_interval", 2023-10-06T04:40:30.893 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.893 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.893 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.894 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "5", 2023-10-06T04:40:30.894 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.894 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.894 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.894 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "how long the module is going to sleep", 2023-10-06T04:40:30.894 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.894 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.894 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.894 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.894 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.895 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "prometheus", 2023-10-06T04:40:30.895 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.895 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.895 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.895 INFO:teuthology.orchestra.run.smithi112.stdout: "cache": { 2023-10-06T04:40:30.895 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "cache", 2023-10-06T04:40:30.895 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.895 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.895 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.896 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.896 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.896 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.896 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.896 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.896 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.896 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.896 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.896 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.896 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.896 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.897 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.898 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.898 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.898 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.898 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.898 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.898 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.898 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.898 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.898 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.898 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.899 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.899 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.899 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.899 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.899 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.899 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.899 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.899 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.899 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.899 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.899 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.900 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.900 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.900 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.900 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.900 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.900 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.900 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.900 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.900 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.900 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.900 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.901 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.901 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.901 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.901 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.901 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.901 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.901 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.901 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.901 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.901 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.902 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.902 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.902 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.902 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.902 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.902 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.902 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.902 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.902 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.903 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_stats_pools": { 2023-10-06T04:40:30.903 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rbd_stats_pools", 2023-10-06T04:40:30.903 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.903 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.903 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.903 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.903 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.903 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.903 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.903 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.903 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.903 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.904 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.904 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-06T04:40:30.904 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-06T04:40:30.904 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.904 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.904 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.904 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "300", 2023-10-06T04:40:30.904 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.904 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.904 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.904 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.905 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.905 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.905 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.905 INFO:teuthology.orchestra.run.smithi112.stdout: "scrape_interval": { 2023-10-06T04:40:30.905 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "scrape_interval", 2023-10-06T04:40:30.905 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "float", 2023-10-06T04:40:30.905 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.905 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.905 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "15.0", 2023-10-06T04:40:30.905 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.905 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.906 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.906 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.906 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.906 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.906 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.906 INFO:teuthology.orchestra.run.smithi112.stdout: "server_addr": { 2023-10-06T04:40:30.906 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "server_addr", 2023-10-06T04:40:30.906 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.906 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.906 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.907 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "::", 2023-10-06T04:40:30.907 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.907 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.907 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.907 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-06T04:40:30.907 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.907 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.907 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.907 INFO:teuthology.orchestra.run.smithi112.stdout: "server_port": { 2023-10-06T04:40:30.907 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "server_port", 2023-10-06T04:40:30.908 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.908 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.908 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.908 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "9283", 2023-10-06T04:40:30.908 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.908 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.908 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.908 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-06T04:40:30.908 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.908 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.908 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.909 INFO:teuthology.orchestra.run.smithi112.stdout: "stale_cache_strategy": { 2023-10-06T04:40:30.909 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "stale_cache_strategy", 2023-10-06T04:40:30.909 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.909 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.909 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.909 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "log", 2023-10-06T04:40:30.909 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.909 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.909 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.909 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.909 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.909 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.910 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.910 INFO:teuthology.orchestra.run.smithi112.stdout: "standby_behaviour": { 2023-10-06T04:40:30.910 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "standby_behaviour", 2023-10-06T04:40:30.910 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.910 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.910 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.910 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "default", 2023-10-06T04:40:30.910 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.910 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.910 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.910 INFO:teuthology.orchestra.run.smithi112.stdout: "default", 2023-10-06T04:40:30.911 INFO:teuthology.orchestra.run.smithi112.stdout: "error" 2023-10-06T04:40:30.911 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.911 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.911 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.911 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.911 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.911 INFO:teuthology.orchestra.run.smithi112.stdout: "standby_error_status_code": { 2023-10-06T04:40:30.911 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "standby_error_status_code", 2023-10-06T04:40:30.911 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.911 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.911 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.912 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "500", 2023-10-06T04:40:30.912 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "400", 2023-10-06T04:40:30.912 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "599", 2023-10-06T04:40:30.912 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.912 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.912 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.912 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.912 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.912 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.912 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.913 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rbd_support", 2023-10-06T04:40:30.913 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.913 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.913 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.913 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.913 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.913 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.913 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.913 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.913 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.913 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.913 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.914 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.914 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.914 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.914 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.914 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.914 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.914 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.914 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.914 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.914 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.914 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.914 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.915 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.915 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.915 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.915 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.915 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.915 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.915 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.915 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.915 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.915 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.915 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.916 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.916 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.916 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.916 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.916 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.916 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.916 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.916 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.916 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.916 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.916 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.917 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.917 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.917 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.917 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.917 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.917 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.917 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.917 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.917 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.917 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.917 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.918 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.918 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.918 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.918 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.918 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.918 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.918 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.918 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.918 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.918 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.918 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.918 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.919 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.919 INFO:teuthology.orchestra.run.smithi112.stdout: "max_concurrent_snap_create": { 2023-10-06T04:40:30.919 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "max_concurrent_snap_create", 2023-10-06T04:40:30.919 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.919 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.919 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.919 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "10", 2023-10-06T04:40:30.919 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.919 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.919 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.919 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.919 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.920 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.920 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.920 INFO:teuthology.orchestra.run.smithi112.stdout: "mirror_snapshot_schedule": { 2023-10-06T04:40:30.920 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "mirror_snapshot_schedule", 2023-10-06T04:40:30.920 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.920 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.920 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.920 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.920 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.920 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.920 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.921 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.921 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.921 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.921 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.921 INFO:teuthology.orchestra.run.smithi112.stdout: "trash_purge_schedule": { 2023-10-06T04:40:30.921 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "trash_purge_schedule", 2023-10-06T04:40:30.921 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.921 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.921 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.921 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.921 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.922 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.922 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.922 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.922 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.922 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.922 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.922 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.922 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.922 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "restful", 2023-10-06T04:40:30.923 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.923 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.923 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.923 INFO:teuthology.orchestra.run.smithi112.stdout: "enable_auth": { 2023-10-06T04:40:30.923 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "enable_auth", 2023-10-06T04:40:30.923 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.923 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.923 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.923 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.923 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.923 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.923 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.924 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.924 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.924 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.924 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.924 INFO:teuthology.orchestra.run.smithi112.stdout: "key_file": { 2023-10-06T04:40:30.924 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "key_file", 2023-10-06T04:40:30.924 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.924 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.924 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.924 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.925 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.925 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.925 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.925 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.925 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.925 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.925 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.925 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.925 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.925 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.925 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.926 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.926 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.926 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.926 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.926 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.926 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.926 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.926 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.926 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.926 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.926 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.926 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.927 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.927 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.927 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.927 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.927 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.927 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.927 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.927 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.927 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.927 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.928 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.928 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.928 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.928 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.928 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.928 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.928 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.928 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.928 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.928 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.928 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.929 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.929 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.929 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.929 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.929 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.929 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.929 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.929 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.929 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.929 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.929 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.929 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.930 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.930 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.930 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.930 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.930 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.930 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.930 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.930 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.930 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.930 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.930 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.931 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.931 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.931 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.931 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.931 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.931 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.931 INFO:teuthology.orchestra.run.smithi112.stdout: "server_addr": { 2023-10-06T04:40:30.931 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "server_addr", 2023-10-06T04:40:30.932 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.932 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.932 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.932 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.932 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.932 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.932 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.932 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.932 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.932 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.932 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.933 INFO:teuthology.orchestra.run.smithi112.stdout: "server_port": { 2023-10-06T04:40:30.933 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "server_port", 2023-10-06T04:40:30.933 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.933 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.933 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.933 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.933 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.933 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.933 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.933 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.933 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.934 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.934 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.934 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.934 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.934 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rgw", 2023-10-06T04:40:30.934 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.934 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.934 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.934 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.935 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.935 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.935 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.935 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.935 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.935 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.935 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.935 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.935 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.935 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.935 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.936 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.936 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.936 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.936 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.936 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.936 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.936 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.936 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.936 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.936 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.937 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.937 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.937 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.937 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.937 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.937 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.937 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.937 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.937 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.937 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.937 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.938 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.938 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.938 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.938 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.938 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.938 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.938 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.938 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.938 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.938 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.938 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.938 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.939 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.939 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.939 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.939 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.939 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.939 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.939 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.939 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.939 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.939 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.940 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.940 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.940 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.940 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.940 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.940 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.940 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.940 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.940 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.940 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.940 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.941 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.941 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.941 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rook", 2023-10-06T04:40:30.941 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.941 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.941 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.941 INFO:teuthology.orchestra.run.smithi112.stdout: "drive_group_interval": { 2023-10-06T04:40:30.941 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "drive_group_interval", 2023-10-06T04:40:30.941 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "float", 2023-10-06T04:40:30.941 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.942 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.942 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "300.0", 2023-10-06T04:40:30.942 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.942 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.942 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.942 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-06T04:40:30.942 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.942 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.943 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.943 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.943 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.943 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.943 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.943 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.943 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.943 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.943 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.943 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.943 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.943 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.944 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.944 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.944 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.944 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.944 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.944 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.944 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.944 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.944 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.944 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.944 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.945 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.945 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.945 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.945 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.945 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.945 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.945 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.945 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.945 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.945 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.945 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.946 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.946 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.946 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.946 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.946 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.946 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.946 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.946 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.946 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.946 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.946 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.947 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.947 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.947 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.947 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.947 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.947 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.947 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.947 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.947 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.947 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.947 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.948 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.948 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.948 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.948 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.948 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.948 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.948 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.948 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.948 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.948 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.948 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.949 INFO:teuthology.orchestra.run.smithi112.stdout: "storage_class": { 2023-10-06T04:40:30.949 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "storage_class", 2023-10-06T04:40:30.949 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.949 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.949 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.949 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "local", 2023-10-06T04:40:30.949 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.949 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.949 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.949 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-06T04:40:30.949 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.949 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.950 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.950 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.950 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.950 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "selftest", 2023-10-06T04:40:30.950 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.950 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.950 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.950 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.950 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.950 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.951 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.951 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.951 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.951 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.951 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.951 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.951 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.951 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.951 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.951 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.951 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.951 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.951 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.952 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.952 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.952 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.952 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.952 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.952 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.952 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.952 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.952 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.952 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.952 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.952 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.953 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.953 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.953 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.953 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.953 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.953 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.953 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.953 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.953 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.953 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.953 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.953 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.954 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.954 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.954 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.954 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.954 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.954 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.954 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.954 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.954 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.955 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.955 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.955 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.955 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.955 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.955 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.955 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.955 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.955 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.955 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.955 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.955 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.956 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.956 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.956 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.956 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.956 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.956 INFO:teuthology.orchestra.run.smithi112.stdout: "roption1": { 2023-10-06T04:40:30.956 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "roption1", 2023-10-06T04:40:30.956 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.956 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.956 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.956 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.957 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.957 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.957 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.957 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.957 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.957 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.957 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.957 INFO:teuthology.orchestra.run.smithi112.stdout: "roption2": { 2023-10-06T04:40:30.957 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "roption2", 2023-10-06T04:40:30.957 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.957 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.958 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.958 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "xyz", 2023-10-06T04:40:30.958 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.958 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.958 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.958 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.958 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.958 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.958 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.958 INFO:teuthology.orchestra.run.smithi112.stdout: "rwoption1": { 2023-10-06T04:40:30.959 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rwoption1", 2023-10-06T04:40:30.959 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.959 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.959 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.959 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.959 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.959 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.959 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.959 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.959 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.959 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.959 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.960 INFO:teuthology.orchestra.run.smithi112.stdout: "rwoption2": { 2023-10-06T04:40:30.960 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rwoption2", 2023-10-06T04:40:30.960 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.960 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.960 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.960 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.960 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.960 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.960 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.960 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.960 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.961 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.961 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.961 INFO:teuthology.orchestra.run.smithi112.stdout: "rwoption3": { 2023-10-06T04:40:30.961 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rwoption3", 2023-10-06T04:40:30.961 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "float", 2023-10-06T04:40:30.961 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.961 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.961 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.961 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.961 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.962 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.962 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.962 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.962 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.962 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.962 INFO:teuthology.orchestra.run.smithi112.stdout: "rwoption4": { 2023-10-06T04:40:30.962 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rwoption4", 2023-10-06T04:40:30.962 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.962 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.962 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.963 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.963 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.963 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.963 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.963 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.963 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.963 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.963 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.963 INFO:teuthology.orchestra.run.smithi112.stdout: "rwoption5": { 2023-10-06T04:40:30.963 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rwoption5", 2023-10-06T04:40:30.963 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.964 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.964 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.964 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.964 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.964 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.964 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.964 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.964 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.964 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.964 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.965 INFO:teuthology.orchestra.run.smithi112.stdout: "rwoption6": { 2023-10-06T04:40:30.965 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rwoption6", 2023-10-06T04:40:30.965 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.965 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.965 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.965 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:30.965 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.965 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.965 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.965 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.965 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.965 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.966 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.966 INFO:teuthology.orchestra.run.smithi112.stdout: "rwoption7": { 2023-10-06T04:40:30.966 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rwoption7", 2023-10-06T04:40:30.966 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:30.966 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.966 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.966 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.966 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "1", 2023-10-06T04:40:30.966 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "42", 2023-10-06T04:40:30.966 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.967 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.967 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.967 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.967 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.967 INFO:teuthology.orchestra.run.smithi112.stdout: "testkey": { 2023-10-06T04:40:30.967 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "testkey", 2023-10-06T04:40:30.967 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.967 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.967 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.967 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.967 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.968 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.968 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.968 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.968 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.968 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.968 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.968 INFO:teuthology.orchestra.run.smithi112.stdout: "testlkey": { 2023-10-06T04:40:30.968 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "testlkey", 2023-10-06T04:40:30.968 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.968 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.968 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.969 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.969 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.969 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.969 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.969 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.969 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.969 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.969 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.969 INFO:teuthology.orchestra.run.smithi112.stdout: "testnewline": { 2023-10-06T04:40:30.969 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "testnewline", 2023-10-06T04:40:30.970 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.970 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.970 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.970 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.970 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.970 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.970 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.970 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.970 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.970 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.970 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.971 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.971 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.971 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "snap_schedule", 2023-10-06T04:40:30.971 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.971 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.971 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.971 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_m_granularity": { 2023-10-06T04:40:30.971 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "allow_m_granularity", 2023-10-06T04:40:30.971 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.971 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.972 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.972 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.972 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.972 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.972 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.972 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "allow minute scheduled snapshots", 2023-10-06T04:40:30.972 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.972 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.972 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.972 INFO:teuthology.orchestra.run.smithi112.stdout: "dump_on_update": { 2023-10-06T04:40:30.972 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "dump_on_update", 2023-10-06T04:40:30.973 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.973 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.973 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.973 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.973 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.973 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.973 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.973 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "dump database to debug log on update", 2023-10-06T04:40:30.973 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.973 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.973 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.974 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.974 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.974 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.974 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.974 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.974 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.974 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.974 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.974 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.974 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.975 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.975 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.975 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.975 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.975 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.975 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.975 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.975 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.975 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.975 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.975 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.976 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.976 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.976 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.976 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.976 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.976 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.976 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.976 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.976 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.976 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.976 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.976 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.977 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.977 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.977 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.977 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.977 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.977 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.977 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.977 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.977 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.977 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.977 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.978 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.978 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.978 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.978 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.978 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.978 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.978 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.978 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.978 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.978 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.978 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.979 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.979 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.979 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.979 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.979 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.979 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.979 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.979 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.979 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.979 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.979 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.979 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.980 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.980 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "stats", 2023-10-06T04:40:30.980 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.980 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.980 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.980 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.980 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.980 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.980 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.980 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.981 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.981 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.981 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.981 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.981 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.981 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.981 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.981 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.981 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.981 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.981 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.982 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.982 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.982 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.982 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.982 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.982 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.982 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.982 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.982 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.982 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.982 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.983 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.983 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.983 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.983 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.983 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.983 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.983 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.983 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.983 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.984 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.984 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.984 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.984 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.984 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.984 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.984 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.984 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.984 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.984 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.984 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.984 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.985 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.985 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.985 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.985 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.985 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.985 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.985 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.985 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.985 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.985 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.986 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.986 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.986 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.986 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.986 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.986 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.986 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.986 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.986 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.986 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.987 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "status", 2023-10-06T04:40:30.987 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.987 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.987 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.987 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.987 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.987 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.987 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.987 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.987 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.987 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.988 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.988 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.988 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.988 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.988 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.988 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.988 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.988 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.988 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.988 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.988 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.988 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.989 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.989 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.989 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.989 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.989 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.989 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.989 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.989 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.989 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.989 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.990 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.990 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.990 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.990 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.990 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.990 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.990 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.990 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.990 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.990 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.991 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.991 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.991 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.991 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.991 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.991 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.991 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.991 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.991 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.991 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.991 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.991 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.992 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.992 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.992 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:30.992 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:30.992 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.992 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.992 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.992 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.992 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.992 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.992 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.992 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.993 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.993 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.993 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.993 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.993 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:30.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:30.993 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "telegraf", 2023-10-06T04:40:30.993 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:30.993 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:30.993 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:30.993 INFO:teuthology.orchestra.run.smithi112.stdout: "address": { 2023-10-06T04:40:30.994 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "address", 2023-10-06T04:40:30.994 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.994 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.994 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.994 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-06T04:40:30.994 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.994 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.994 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.994 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.994 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.994 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.995 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.995 INFO:teuthology.orchestra.run.smithi112.stdout: "interval": { 2023-10-06T04:40:30.995 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "interval", 2023-10-06T04:40:30.995 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:30.995 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.995 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:30.995 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "15", 2023-10-06T04:40:30.995 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.995 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.995 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.995 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.996 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.996 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.996 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.996 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:30.996 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:30.996 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.996 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.996 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.996 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:30.996 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.996 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.997 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:30.997 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:30.997 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:30.997 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:30.997 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:30.997 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:30.997 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:30.997 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:30.997 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.997 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.997 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.997 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.998 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:30.998 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:30.998 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:30.998 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.998 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.998 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:30.998 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.998 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.998 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:30.998 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:30.998 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:30.999 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:30.999 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:30.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:30.999 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:30.999 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:30.999 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:30.999 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:30.999 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:30.999 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:30.999 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:30.999 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:30.999 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:31.000 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:31.000 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:31.000 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:31.000 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:31.000 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:31.000 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:31.000 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:31.000 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.000 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.000 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.000 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.001 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:31.001 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:31.001 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:31.001 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.001 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:31.001 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:31.001 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.001 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.001 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.001 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.001 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.001 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.002 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.002 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.002 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:31.002 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "telemetry", 2023-10-06T04:40:31.002 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:31.002 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:31.002 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:31.002 INFO:teuthology.orchestra.run.smithi112.stdout: "channel_basic": { 2023-10-06T04:40:31.002 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "channel_basic", 2023-10-06T04:40:31.002 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:31.003 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.003 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.003 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:31.003 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.003 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.003 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.003 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-06T04:40:31.003 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.003 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.003 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.003 INFO:teuthology.orchestra.run.smithi112.stdout: "channel_crash": { 2023-10-06T04:40:31.004 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "channel_crash", 2023-10-06T04:40:31.004 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:31.004 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.004 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.004 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:31.004 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.004 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.004 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.004 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-06T04:40:31.004 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.004 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.004 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.005 INFO:teuthology.orchestra.run.smithi112.stdout: "channel_device": { 2023-10-06T04:40:31.005 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "channel_device", 2023-10-06T04:40:31.005 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:31.005 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.005 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.005 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "True", 2023-10-06T04:40:31.005 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.005 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.005 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.005 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-06T04:40:31.005 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.006 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.006 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.006 INFO:teuthology.orchestra.run.smithi112.stdout: "channel_ident": { 2023-10-06T04:40:31.006 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "channel_ident", 2023-10-06T04:40:31.006 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:31.006 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.006 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.006 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:31.006 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.006 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.007 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.007 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-06T04:40:31.007 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.007 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.007 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.007 INFO:teuthology.orchestra.run.smithi112.stdout: "channel_perf": { 2023-10-06T04:40:31.007 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "channel_perf", 2023-10-06T04:40:31.007 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:31.007 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.007 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.007 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:31.008 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.008 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.008 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.008 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-06T04:40:31.008 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.008 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.008 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.008 INFO:teuthology.orchestra.run.smithi112.stdout: "contact": { 2023-10-06T04:40:31.008 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "contact", 2023-10-06T04:40:31.008 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:31.008 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.009 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.009 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:31.009 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.009 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.009 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.009 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.009 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.009 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.009 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.009 INFO:teuthology.orchestra.run.smithi112.stdout: "description": { 2023-10-06T04:40:31.010 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "description", 2023-10-06T04:40:31.010 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:31.010 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.010 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.010 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:31.010 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.010 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.010 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.010 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.010 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.010 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.011 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.011 INFO:teuthology.orchestra.run.smithi112.stdout: "device_url": { 2023-10-06T04:40:31.011 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "device_url", 2023-10-06T04:40:31.011 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:31.011 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.011 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.011 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-06T04:40:31.011 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.011 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.011 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.011 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.012 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.012 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.012 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.012 INFO:teuthology.orchestra.run.smithi112.stdout: "enabled": { 2023-10-06T04:40:31.012 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "enabled", 2023-10-06T04:40:31.012 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:31.012 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.012 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.012 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:31.012 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.013 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.013 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.013 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.013 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.013 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.013 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.013 INFO:teuthology.orchestra.run.smithi112.stdout: "interval": { 2023-10-06T04:40:31.013 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "interval", 2023-10-06T04:40:31.013 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:31.013 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.013 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.014 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "24", 2023-10-06T04:40:31.014 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "8", 2023-10-06T04:40:31.014 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.014 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.014 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.014 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.014 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.014 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.014 INFO:teuthology.orchestra.run.smithi112.stdout: "last_opt_revision": { 2023-10-06T04:40:31.015 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "last_opt_revision", 2023-10-06T04:40:31.015 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:31.015 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.015 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.015 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "1", 2023-10-06T04:40:31.015 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.015 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.015 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.015 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.015 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.015 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.015 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.016 INFO:teuthology.orchestra.run.smithi112.stdout: "leaderboard": { 2023-10-06T04:40:31.016 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "leaderboard", 2023-10-06T04:40:31.016 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:31.016 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.016 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.016 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:31.016 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.016 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.016 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.016 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.016 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.017 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.017 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.017 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:31.017 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:31.017 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:31.017 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.017 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:31.017 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:31.017 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.017 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.018 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:31.018 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:31.018 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:31.018 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:31.018 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:31.018 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:31.018 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:31.018 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:31.018 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.018 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.018 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.019 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.019 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:31.019 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:31.019 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:31.019 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.019 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:31.019 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:31.019 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.019 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.019 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.019 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.020 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.020 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.020 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.020 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:31.020 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:31.020 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:31.020 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.020 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:31.020 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:31.020 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.021 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.021 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:31.021 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:31.021 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:31.021 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:31.021 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:31.021 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:31.021 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:31.021 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:31.021 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.021 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.021 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.022 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.022 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:31.022 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:31.022 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:31.022 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.022 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:31.022 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:31.022 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.022 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.022 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.022 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.023 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.023 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.023 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.023 INFO:teuthology.orchestra.run.smithi112.stdout: "organization": { 2023-10-06T04:40:31.023 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "organization", 2023-10-06T04:40:31.023 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:31.023 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.023 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.023 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:31.023 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.024 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.024 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.024 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.024 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.024 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.024 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.024 INFO:teuthology.orchestra.run.smithi112.stdout: "proxy": { 2023-10-06T04:40:31.024 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "proxy", 2023-10-06T04:40:31.024 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:31.024 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.024 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.025 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:31.025 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.025 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.025 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.025 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.025 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.025 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.025 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.025 INFO:teuthology.orchestra.run.smithi112.stdout: "url": { 2023-10-06T04:40:31.025 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "url", 2023-10-06T04:40:31.025 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:31.026 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.026 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.026 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-06T04:40:31.026 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.026 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.026 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.026 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.026 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.026 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.026 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.026 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.026 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:31.027 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "test_orchestrator", 2023-10-06T04:40:31.027 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:31.027 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:31.027 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:31.027 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:31.027 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:31.027 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:31.027 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.027 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:31.027 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:31.028 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.028 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.028 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:31.028 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:31.028 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:31.028 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:31.028 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:31.028 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:31.028 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:31.028 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:31.028 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.028 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.029 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.029 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.029 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:31.029 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:31.029 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:31.029 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.029 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:31.029 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:31.029 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.029 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.029 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.030 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.030 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.030 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.030 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.030 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:31.030 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:31.030 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:31.030 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.030 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:31.030 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:31.031 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.031 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.031 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:31.031 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:31.031 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:31.031 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:31.031 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:31.031 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:31.031 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:31.031 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:31.031 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.031 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.032 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.032 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.032 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:31.032 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:31.032 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:31.032 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.032 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:31.032 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:31.032 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.032 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.032 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.033 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.033 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.033 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.033 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.033 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.033 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:31.033 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "volumes", 2023-10-06T04:40:31.033 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:31.033 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:31.033 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:31.034 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:31.034 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:31.034 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:31.034 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.034 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:31.034 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:31.034 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.034 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.034 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:31.034 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:31.034 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:31.034 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:31.035 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:31.035 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:31.035 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:31.035 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:31.035 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.035 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.035 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.035 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.035 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:31.035 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:31.036 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:31.036 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.036 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:31.036 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:31.036 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.036 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.036 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.036 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.036 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.036 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.036 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.037 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:31.037 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:31.037 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:31.037 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.037 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:31.037 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:31.037 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.037 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.037 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:31.037 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:31.037 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:31.037 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:31.038 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:31.038 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:31.038 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:31.038 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:31.038 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.038 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.038 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.038 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.038 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:31.038 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:31.039 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:31.039 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.039 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:31.039 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:31.039 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.039 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.039 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.039 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.039 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.039 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.039 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.039 INFO:teuthology.orchestra.run.smithi112.stdout: "max_concurrent_clones": { 2023-10-06T04:40:31.040 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "max_concurrent_clones", 2023-10-06T04:40:31.040 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:31.040 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.040 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.040 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "4", 2023-10-06T04:40:31.040 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.040 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.040 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.040 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-06T04:40:31.040 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.040 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.041 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.041 INFO:teuthology.orchestra.run.smithi112.stdout: "snapshot_clone_delay": { 2023-10-06T04:40:31.041 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "snapshot_clone_delay", 2023-10-06T04:40:31.041 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:31.041 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.041 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.041 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "0", 2023-10-06T04:40:31.041 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.041 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.041 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.041 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-06T04:40:31.042 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.042 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.042 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.042 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.042 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:31.042 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "zabbix", 2023-10-06T04:40:31.042 INFO:teuthology.orchestra.run.smithi112.stdout: "can_run": true, 2023-10-06T04:40:31.042 INFO:teuthology.orchestra.run.smithi112.stdout: "error_string": "", 2023-10-06T04:40:31.042 INFO:teuthology.orchestra.run.smithi112.stdout: "module_options": { 2023-10-06T04:40:31.043 INFO:teuthology.orchestra.run.smithi112.stdout: "discovery_interval": { 2023-10-06T04:40:31.043 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "discovery_interval", 2023-10-06T04:40:31.043 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "uint", 2023-10-06T04:40:31.043 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.043 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.043 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "100", 2023-10-06T04:40:31.043 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.043 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.043 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.043 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.043 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.043 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.044 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.044 INFO:teuthology.orchestra.run.smithi112.stdout: "identifier": { 2023-10-06T04:40:31.044 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "identifier", 2023-10-06T04:40:31.044 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:31.044 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.044 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.044 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:31.044 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.044 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.044 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.045 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.045 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.045 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.045 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.045 INFO:teuthology.orchestra.run.smithi112.stdout: "interval": { 2023-10-06T04:40:31.045 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "interval", 2023-10-06T04:40:31.045 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "secs", 2023-10-06T04:40:31.045 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.045 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.045 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "60", 2023-10-06T04:40:31.045 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.046 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.046 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.046 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.046 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.046 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.046 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.046 INFO:teuthology.orchestra.run.smithi112.stdout: "log_level": { 2023-10-06T04:40:31.046 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_level", 2023-10-06T04:40:31.046 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:31.046 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.047 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:31.047 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:31.047 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.047 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.047 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:31.047 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:31.047 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:31.047 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:31.047 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:31.047 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:31.047 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:31.047 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:31.048 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.048 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.048 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.048 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.048 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster": { 2023-10-06T04:40:31.048 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster", 2023-10-06T04:40:31.048 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:31.048 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.048 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:31.048 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:31.049 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.049 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.049 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.049 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.049 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.049 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.049 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.049 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_cluster_level": { 2023-10-06T04:40:31.049 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_cluster_level", 2023-10-06T04:40:31.049 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:31.049 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.050 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:31.050 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "info", 2023-10-06T04:40:31.050 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.050 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.050 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [ 2023-10-06T04:40:31.050 INFO:teuthology.orchestra.run.smithi112.stdout: "", 2023-10-06T04:40:31.050 INFO:teuthology.orchestra.run.smithi112.stdout: "critical", 2023-10-06T04:40:31.050 INFO:teuthology.orchestra.run.smithi112.stdout: "debug", 2023-10-06T04:40:31.050 INFO:teuthology.orchestra.run.smithi112.stdout: "error", 2023-10-06T04:40:31.050 INFO:teuthology.orchestra.run.smithi112.stdout: "info", 2023-10-06T04:40:31.050 INFO:teuthology.orchestra.run.smithi112.stdout: "warning" 2023-10-06T04:40:31.050 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:31.051 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.051 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.051 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.051 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.051 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": { 2023-10-06T04:40:31.051 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "log_to_file", 2023-10-06T04:40:31.051 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "bool", 2023-10-06T04:40:31.051 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.051 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2023-10-06T04:40:31.051 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "False", 2023-10-06T04:40:31.052 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.052 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.052 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.052 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.052 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.052 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.052 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.052 INFO:teuthology.orchestra.run.smithi112.stdout: "zabbix_host": { 2023-10-06T04:40:31.052 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "zabbix_host", 2023-10-06T04:40:31.052 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:31.053 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.053 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.053 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "", 2023-10-06T04:40:31.053 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.053 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.053 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.053 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.053 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.053 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.053 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.054 INFO:teuthology.orchestra.run.smithi112.stdout: "zabbix_port": { 2023-10-06T04:40:31.054 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "zabbix_port", 2023-10-06T04:40:31.054 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "int", 2023-10-06T04:40:31.054 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.054 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.054 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "10051", 2023-10-06T04:40:31.054 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.054 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.054 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.054 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.054 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.055 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.055 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.055 INFO:teuthology.orchestra.run.smithi112.stdout: "zabbix_sender": { 2023-10-06T04:40:31.055 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "zabbix_sender", 2023-10-06T04:40:31.055 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "str", 2023-10-06T04:40:31.055 INFO:teuthology.orchestra.run.smithi112.stdout: "level": "advanced", 2023-10-06T04:40:31.055 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 0, 2023-10-06T04:40:31.055 INFO:teuthology.orchestra.run.smithi112.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-06T04:40:31.055 INFO:teuthology.orchestra.run.smithi112.stdout: "min": "", 2023-10-06T04:40:31.055 INFO:teuthology.orchestra.run.smithi112.stdout: "max": "", 2023-10-06T04:40:31.055 INFO:teuthology.orchestra.run.smithi112.stdout: "enum_allowed": [], 2023-10-06T04:40:31.056 INFO:teuthology.orchestra.run.smithi112.stdout: "desc": "", 2023-10-06T04:40:31.056 INFO:teuthology.orchestra.run.smithi112.stdout: "long_desc": "", 2023-10-06T04:40:31.056 INFO:teuthology.orchestra.run.smithi112.stdout: "tags": [], 2023-10-06T04:40:31.056 INFO:teuthology.orchestra.run.smithi112.stdout: "see_also": [] 2023-10-06T04:40:31.056 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.056 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.056 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.056 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:31.056 INFO:teuthology.orchestra.run.smithi112.stdout: "services": {}, 2023-10-06T04:40:31.056 INFO:teuthology.orchestra.run.smithi112.stdout: "always_on_modules": { 2023-10-06T04:40:31.056 INFO:teuthology.orchestra.run.smithi112.stdout: "octopus": [ 2023-10-06T04:40:31.056 INFO:teuthology.orchestra.run.smithi112.stdout: "balancer", 2023-10-06T04:40:31.057 INFO:teuthology.orchestra.run.smithi112.stdout: "crash", 2023-10-06T04:40:31.057 INFO:teuthology.orchestra.run.smithi112.stdout: "devicehealth", 2023-10-06T04:40:31.057 INFO:teuthology.orchestra.run.smithi112.stdout: "orchestrator", 2023-10-06T04:40:31.057 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscaler", 2023-10-06T04:40:31.057 INFO:teuthology.orchestra.run.smithi112.stdout: "progress", 2023-10-06T04:40:31.057 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_support", 2023-10-06T04:40:31.057 INFO:teuthology.orchestra.run.smithi112.stdout: "status", 2023-10-06T04:40:31.057 INFO:teuthology.orchestra.run.smithi112.stdout: "telemetry", 2023-10-06T04:40:31.057 INFO:teuthology.orchestra.run.smithi112.stdout: "volumes" 2023-10-06T04:40:31.057 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:31.057 INFO:teuthology.orchestra.run.smithi112.stdout: "pacific": [ 2023-10-06T04:40:31.058 INFO:teuthology.orchestra.run.smithi112.stdout: "balancer", 2023-10-06T04:40:31.058 INFO:teuthology.orchestra.run.smithi112.stdout: "crash", 2023-10-06T04:40:31.058 INFO:teuthology.orchestra.run.smithi112.stdout: "devicehealth", 2023-10-06T04:40:31.058 INFO:teuthology.orchestra.run.smithi112.stdout: "orchestrator", 2023-10-06T04:40:31.058 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscaler", 2023-10-06T04:40:31.058 INFO:teuthology.orchestra.run.smithi112.stdout: "progress", 2023-10-06T04:40:31.058 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_support", 2023-10-06T04:40:31.058 INFO:teuthology.orchestra.run.smithi112.stdout: "status", 2023-10-06T04:40:31.058 INFO:teuthology.orchestra.run.smithi112.stdout: "telemetry", 2023-10-06T04:40:31.058 INFO:teuthology.orchestra.run.smithi112.stdout: "volumes" 2023-10-06T04:40:31.058 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-10-06T04:40:31.058 INFO:teuthology.orchestra.run.smithi112.stdout: "quincy": [ 2023-10-06T04:40:31.059 INFO:teuthology.orchestra.run.smithi112.stdout: "balancer", 2023-10-06T04:40:31.059 INFO:teuthology.orchestra.run.smithi112.stdout: "crash", 2023-10-06T04:40:31.059 INFO:teuthology.orchestra.run.smithi112.stdout: "devicehealth", 2023-10-06T04:40:31.059 INFO:teuthology.orchestra.run.smithi112.stdout: "orchestrator", 2023-10-06T04:40:31.059 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscaler", 2023-10-06T04:40:31.059 INFO:teuthology.orchestra.run.smithi112.stdout: "progress", 2023-10-06T04:40:31.059 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_support", 2023-10-06T04:40:31.059 INFO:teuthology.orchestra.run.smithi112.stdout: "status", 2023-10-06T04:40:31.059 INFO:teuthology.orchestra.run.smithi112.stdout: "telemetry", 2023-10-06T04:40:31.059 INFO:teuthology.orchestra.run.smithi112.stdout: "volumes" 2023-10-06T04:40:31.059 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2023-10-06T04:40:31.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.060 INFO:teuthology.orchestra.run.smithi112.stdout: "last_failure_osd_epoch": 0, 2023-10-06T04:40:31.060 INFO:teuthology.orchestra.run.smithi112.stdout: "active_clients": [ 2023-10-06T04:40:31.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:31.060 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "devicehealth", 2023-10-06T04:40:31.060 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2023-10-06T04:40:31.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:31.060 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2023-10-06T04:40:31.060 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:0", 2023-10-06T04:40:31.060 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3861466522 2023-10-06T04:40:31.060 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.061 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2023-10-06T04:40:31.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:31.061 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "libcephsqlite", 2023-10-06T04:40:31.061 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2023-10-06T04:40:31.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:31.061 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2023-10-06T04:40:31.061 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:0", 2023-10-06T04:40:31.061 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1224448916 2023-10-06T04:40:31.061 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.061 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2023-10-06T04:40:31.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:31.062 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "rbd_support", 2023-10-06T04:40:31.062 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2023-10-06T04:40:31.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:31.062 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2023-10-06T04:40:31.062 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:0", 2023-10-06T04:40:31.062 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 135902333 2023-10-06T04:40:31.062 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.062 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2023-10-06T04:40:31.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:31.062 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "volumes", 2023-10-06T04:40:31.063 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2023-10-06T04:40:31.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:31.063 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2023-10-06T04:40:31.063 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:0", 2023-10-06T04:40:31.063 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1590427899 2023-10-06T04:40:31.063 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.063 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2023-10-06T04:40:31.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:31.063 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "volumes", 2023-10-06T04:40:31.063 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2023-10-06T04:40:31.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:31.064 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2023-10-06T04:40:31.064 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:0", 2023-10-06T04:40:31.064 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1170173582 2023-10-06T04:40:31.064 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.064 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2023-10-06T04:40:31.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:31.064 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "volumes", 2023-10-06T04:40:31.064 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2023-10-06T04:40:31.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:31.064 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2023-10-06T04:40:31.064 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:0", 2023-10-06T04:40:31.065 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3055001375 2023-10-06T04:40:31.065 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.065 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2023-10-06T04:40:31.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:31.065 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "volumes", 2023-10-06T04:40:31.065 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2023-10-06T04:40:31.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-10-06T04:40:31.065 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2023-10-06T04:40:31.065 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:0", 2023-10-06T04:40:31.065 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2444331267 2023-10-06T04:40:31.066 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.066 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2023-10-06T04:40:31.066 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.066 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2023-10-06T04:40:31.066 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-10-06T04:40:31.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:30.061+0000 7f4082382700 1 -- 172.21.15.112:0/2159577809 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f40680670e0 msgr2=0x7f4068069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:31.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:30.061+0000 7f4082382700 1 --2- 172.21.15.112:0/2159577809 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f40680670e0 0x7f4068069590 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4070006fd0 tx=0x7f4070008040 comp rx=0 tx=0).stop 2023-10-06T04:40:31.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:30.061+0000 7f4082382700 1 -- 172.21.15.112:0/2159577809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f407c0b0e70 msgr2=0x7f407c14e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:31.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:30.061+0000 7f4082382700 1 --2- 172.21.15.112:0/2159577809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f407c0b0e70 0x7f407c14e570 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f406c00c800 tx=0x7f406c008040 comp rx=0 tx=0).stop 2023-10-06T04:40:31.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:30.061+0000 7f4082382700 1 -- 172.21.15.112:0/2159577809 shutdown_connections 2023-10-06T04:40:31.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:30.061+0000 7f4082382700 1 --2- 172.21.15.112:0/2159577809 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f40680670e0 0x7f4068069590 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:30.061+0000 7f4082382700 1 --2- 172.21.15.112:0/2159577809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f407c15a120 0x7f407c0a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:30.061+0000 7f4082382700 1 --2- 172.21.15.112:0/2159577809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f407c0b0e70 0x7f407c14e570 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:30.061+0000 7f4082382700 1 --2- 172.21.15.112:0/2159577809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f407c159d50 0x7f407c0a02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:31.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:30.061+0000 7f4082382700 1 -- 172.21.15.112:0/2159577809 >> 172.21.15.112:0/2159577809 conn(0x7f407c099b60 msgr2=0x7f407c155830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:31.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:30.061+0000 7f4082382700 1 -- 172.21.15.112:0/2159577809 shutdown_connections 2023-10-06T04:40:31.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:30.061+0000 7f4082382700 1 -- 172.21.15.112:0/2159577809 wait complete. 2023-10-06T04:40:31.072 DEBUG:tasks.check_counter:Getting stats from y 2023-10-06T04:40:31.072 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mgr.y.asok perf dump 2023-10-06T04:40:31.199 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-10-06T04:40:31.199 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-0": { 2023-10-06T04:40:31.200 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 797, 2023-10-06T04:40:31.200 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 619, 2023-10-06T04:40:31.200 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 3073312, 2023-10-06T04:40:31.200 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 5378800, 2023-10-06T04:40:31.200 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 120, 2023-10-06T04:40:31.200 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 21, 2023-10-06T04:40:31.201 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.114097340, 2023-10-06T04:40:31.201 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.026746257, 2023-10-06T04:40:31.201 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.077421294, 2023-10-06T04:40:31.201 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.003208403, 2023-10-06T04:40:31.201 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T04:40:31.201 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 602, 2023-10-06T04:40:31.202 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.025774446, 2023-10-06T04:40:31.202 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000042814 2023-10-06T04:40:31.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.202 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2023-10-06T04:40:31.202 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 281, 2023-10-06T04:40:31.202 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000028105, 2023-10-06T04:40:31.203 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000100 2023-10-06T04:40:31.203 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.203 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-1": { 2023-10-06T04:40:31.203 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 231, 2023-10-06T04:40:31.203 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 77, 2023-10-06T04:40:31.203 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 2867920, 2023-10-06T04:40:31.204 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 53792, 2023-10-06T04:40:31.204 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 56, 2023-10-06T04:40:31.204 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 19, 2023-10-06T04:40:31.204 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.033283478, 2023-10-06T04:40:31.204 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.001724331, 2023-10-06T04:40:31.204 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.042027767, 2023-10-06T04:40:31.205 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000077379, 2023-10-06T04:40:31.205 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T04:40:31.205 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 64, 2023-10-06T04:40:31.205 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.011913892, 2023-10-06T04:40:31.205 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000186154 2023-10-06T04:40:31.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.206 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2023-10-06T04:40:31.206 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.206 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.206 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.206 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.207 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-2": { 2023-10-06T04:40:31.207 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 312, 2023-10-06T04:40:31.207 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 154, 2023-10-06T04:40:31.207 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 1859186, 2023-10-06T04:40:31.207 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 1186694, 2023-10-06T04:40:31.207 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 140, 2023-10-06T04:40:31.207 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 21, 2023-10-06T04:40:31.208 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.063475972, 2023-10-06T04:40:31.208 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.003864296, 2023-10-06T04:40:31.208 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.065091642, 2023-10-06T04:40:31.208 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000040203, 2023-10-06T04:40:31.208 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T04:40:31.208 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 142, 2023-10-06T04:40:31.208 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.011731468, 2023-10-06T04:40:31.209 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000082615 2023-10-06T04:40:31.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.209 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2023-10-06T04:40:31.209 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 199, 2023-10-06T04:40:31.209 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000021180, 2023-10-06T04:40:31.209 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000106 2023-10-06T04:40:31.209 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.210 INFO:teuthology.orchestra.run.smithi112.stdout: "cct": { 2023-10-06T04:40:31.210 INFO:teuthology.orchestra.run.smithi112.stdout: "total_workers": 0, 2023-10-06T04:40:31.210 INFO:teuthology.orchestra.run.smithi112.stdout: "unhealthy_workers": 0 2023-10-06T04:40:31.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.210 INFO:teuthology.orchestra.run.smithi112.stdout: "client": { 2023-10-06T04:40:31.210 INFO:teuthology.orchestra.run.smithi112.stdout: "reply": { 2023-10-06T04:40:31.211 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.211 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.211 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.211 INFO:teuthology.orchestra.run.smithi112.stdout: "lat": { 2023-10-06T04:40:31.211 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.211 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.211 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.212 INFO:teuthology.orchestra.run.smithi112.stdout: "wrlat": { 2023-10-06T04:40:31.212 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.212 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.212 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.212 INFO:teuthology.orchestra.run.smithi112.stdout: "rdlat": { 2023-10-06T04:40:31.212 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.213 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.213 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.213 INFO:teuthology.orchestra.run.smithi112.stdout: "fsync": { 2023-10-06T04:40:31.213 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.213 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.214 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.214 INFO:teuthology.orchestra.run.smithi112.stdout: "mdavg": 0.000000000, 2023-10-06T04:40:31.214 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsqsum": 0, 2023-10-06T04:40:31.214 INFO:teuthology.orchestra.run.smithi112.stdout: "mdops": 0, 2023-10-06T04:40:31.214 INFO:teuthology.orchestra.run.smithi112.stdout: "readavg": 0.000000000, 2023-10-06T04:40:31.214 INFO:teuthology.orchestra.run.smithi112.stdout: "readsqsum": 0, 2023-10-06T04:40:31.215 INFO:teuthology.orchestra.run.smithi112.stdout: "rdops": 0, 2023-10-06T04:40:31.215 INFO:teuthology.orchestra.run.smithi112.stdout: "writeavg": 0.000000000, 2023-10-06T04:40:31.215 INFO:teuthology.orchestra.run.smithi112.stdout: "writesqsum": 0, 2023-10-06T04:40:31.215 INFO:teuthology.orchestra.run.smithi112.stdout: "rdops": 0 2023-10-06T04:40:31.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.215 INFO:teuthology.orchestra.run.smithi112.stdout: "client-0x5616edd16280": { 2023-10-06T04:40:31.216 INFO:teuthology.orchestra.run.smithi112.stdout: "reply": { 2023-10-06T04:40:31.216 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 23, 2023-10-06T04:40:31.216 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.496033393, 2023-10-06T04:40:31.216 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.021566669 2023-10-06T04:40:31.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.216 INFO:teuthology.orchestra.run.smithi112.stdout: "lat": { 2023-10-06T04:40:31.216 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 23, 2023-10-06T04:40:31.216 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.496033393, 2023-10-06T04:40:31.217 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.021566669 2023-10-06T04:40:31.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.217 INFO:teuthology.orchestra.run.smithi112.stdout: "wrlat": { 2023-10-06T04:40:31.217 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.217 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.217 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.218 INFO:teuthology.orchestra.run.smithi112.stdout: "rdlat": { 2023-10-06T04:40:31.218 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.218 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.218 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.218 INFO:teuthology.orchestra.run.smithi112.stdout: "fsync": { 2023-10-06T04:40:31.218 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.218 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.219 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.219 INFO:teuthology.orchestra.run.smithi112.stdout: "mdavg": 0.021566664, 2023-10-06T04:40:31.219 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsqsum": 217941479881637472, 2023-10-06T04:40:31.219 INFO:teuthology.orchestra.run.smithi112.stdout: "mdops": 23, 2023-10-06T04:40:31.219 INFO:teuthology.orchestra.run.smithi112.stdout: "readavg": 0.000000000, 2023-10-06T04:40:31.219 INFO:teuthology.orchestra.run.smithi112.stdout: "readsqsum": 0, 2023-10-06T04:40:31.219 INFO:teuthology.orchestra.run.smithi112.stdout: "rdops": 0, 2023-10-06T04:40:31.220 INFO:teuthology.orchestra.run.smithi112.stdout: "writeavg": 0.000000000, 2023-10-06T04:40:31.220 INFO:teuthology.orchestra.run.smithi112.stdout: "writesqsum": 0, 2023-10-06T04:40:31.220 INFO:teuthology.orchestra.run.smithi112.stdout: "rdops": 0 2023-10-06T04:40:31.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client-0x5616edd16a00": { 2023-10-06T04:40:31.220 INFO:teuthology.orchestra.run.smithi112.stdout: "reply": { 2023-10-06T04:40:31.220 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 70, 2023-10-06T04:40:31.220 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.234409315, 2023-10-06T04:40:31.221 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.003348704 2023-10-06T04:40:31.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.221 INFO:teuthology.orchestra.run.smithi112.stdout: "lat": { 2023-10-06T04:40:31.221 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 70, 2023-10-06T04:40:31.221 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.234409315, 2023-10-06T04:40:31.221 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.003348704 2023-10-06T04:40:31.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.222 INFO:teuthology.orchestra.run.smithi112.stdout: "wrlat": { 2023-10-06T04:40:31.222 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 18, 2023-10-06T04:40:31.222 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000396935, 2023-10-06T04:40:31.222 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000022051 2023-10-06T04:40:31.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.222 INFO:teuthology.orchestra.run.smithi112.stdout: "rdlat": { 2023-10-06T04:40:31.222 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 18, 2023-10-06T04:40:31.223 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000304174, 2023-10-06T04:40:31.223 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000016898 2023-10-06T04:40:31.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.223 INFO:teuthology.orchestra.run.smithi112.stdout: "fsync": { 2023-10-06T04:40:31.223 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 3, 2023-10-06T04:40:31.223 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.008460279, 2023-10-06T04:40:31.223 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.002820093 2023-10-06T04:40:31.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.224 INFO:teuthology.orchestra.run.smithi112.stdout: "mdavg": 0.003348687, 2023-10-06T04:40:31.224 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsqsum": 18100696564167968, 2023-10-06T04:40:31.224 INFO:teuthology.orchestra.run.smithi112.stdout: "mdops": 70, 2023-10-06T04:40:31.224 INFO:teuthology.orchestra.run.smithi112.stdout: "readavg": 0.000016896, 2023-10-06T04:40:31.224 INFO:teuthology.orchestra.run.smithi112.stdout: "readsqsum": 396405405, 2023-10-06T04:40:31.225 INFO:teuthology.orchestra.run.smithi112.stdout: "rdops": 18, 2023-10-06T04:40:31.225 INFO:teuthology.orchestra.run.smithi112.stdout: "writeavg": 0.000022048, 2023-10-06T04:40:31.225 INFO:teuthology.orchestra.run.smithi112.stdout: "writesqsum": 1714888238, 2023-10-06T04:40:31.225 INFO:teuthology.orchestra.run.smithi112.stdout: "rdops": 18 2023-10-06T04:40:31.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.225 INFO:teuthology.orchestra.run.smithi112.stdout: "client-0x5616edd17180": { 2023-10-06T04:40:31.225 INFO:teuthology.orchestra.run.smithi112.stdout: "reply": { 2023-10-06T04:40:31.226 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 51, 2023-10-06T04:40:31.226 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.073822570, 2023-10-06T04:40:31.226 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.001447501 2023-10-06T04:40:31.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.226 INFO:teuthology.orchestra.run.smithi112.stdout: "lat": { 2023-10-06T04:40:31.226 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 51, 2023-10-06T04:40:31.226 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.073822570, 2023-10-06T04:40:31.227 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.001447501 2023-10-06T04:40:31.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.227 INFO:teuthology.orchestra.run.smithi112.stdout: "wrlat": { 2023-10-06T04:40:31.227 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.227 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.227 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.228 INFO:teuthology.orchestra.run.smithi112.stdout: "rdlat": { 2023-10-06T04:40:31.228 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.228 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.228 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.228 INFO:teuthology.orchestra.run.smithi112.stdout: "fsync": { 2023-10-06T04:40:31.228 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.228 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.229 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.229 INFO:teuthology.orchestra.run.smithi112.stdout: "mdavg": 0.001447488, 2023-10-06T04:40:31.229 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsqsum": 121205060770748, 2023-10-06T04:40:31.229 INFO:teuthology.orchestra.run.smithi112.stdout: "mdops": 51, 2023-10-06T04:40:31.229 INFO:teuthology.orchestra.run.smithi112.stdout: "readavg": 0.000000000, 2023-10-06T04:40:31.229 INFO:teuthology.orchestra.run.smithi112.stdout: "readsqsum": 0, 2023-10-06T04:40:31.230 INFO:teuthology.orchestra.run.smithi112.stdout: "rdops": 0, 2023-10-06T04:40:31.230 INFO:teuthology.orchestra.run.smithi112.stdout: "writeavg": 0.000000000, 2023-10-06T04:40:31.230 INFO:teuthology.orchestra.run.smithi112.stdout: "writesqsum": 0, 2023-10-06T04:40:31.230 INFO:teuthology.orchestra.run.smithi112.stdout: "rdops": 0 2023-10-06T04:40:31.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.230 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-Mgr": { 2023-10-06T04:40:31.231 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-06T04:40:31.231 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-06T04:40:31.231 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2, 2023-10-06T04:40:31.231 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.047656464, 2023-10-06T04:40:31.231 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.023828232 2023-10-06T04:40:31.231 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.232 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-MgrStandby": { 2023-10-06T04:40:31.232 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-06T04:40:31.232 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-06T04:40:31.232 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.232 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.232 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.232 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.233 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-balancer": { 2023-10-06T04:40:31.233 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-06T04:40:31.233 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-06T04:40:31.233 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.233 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.234 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.234 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.234 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-cmd_finisher": { 2023-10-06T04:40:31.234 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-06T04:40:31.234 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-06T04:40:31.235 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 13, 2023-10-06T04:40:31.235 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000745088, 2023-10-06T04:40:31.235 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000057314 2023-10-06T04:40:31.235 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.235 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-crash": { 2023-10-06T04:40:31.235 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-06T04:40:31.236 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-06T04:40:31.236 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.236 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.236 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.236 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.236 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-devicehealth": { 2023-10-06T04:40:31.237 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-06T04:40:31.237 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-06T04:40:31.237 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.237 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.237 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.237 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.237 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-iostat": { 2023-10-06T04:40:31.238 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-06T04:40:31.238 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-06T04:40:31.238 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.238 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.238 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.238 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.239 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-nfs": { 2023-10-06T04:40:31.239 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-06T04:40:31.239 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-06T04:40:31.239 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.239 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.239 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.239 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.240 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-orchestrator": { 2023-10-06T04:40:31.240 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-06T04:40:31.240 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-06T04:40:31.240 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.240 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.240 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.240 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.241 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-pg_autoscaler": { 2023-10-06T04:40:31.241 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-06T04:40:31.241 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-06T04:40:31.241 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.241 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.241 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.242 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.242 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-progress": { 2023-10-06T04:40:31.242 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-06T04:40:31.242 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-06T04:40:31.242 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.243 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.243 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.243 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.243 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-rbd_support": { 2023-10-06T04:40:31.243 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-06T04:40:31.243 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-06T04:40:31.243 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.244 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.244 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.244 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.244 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-restful": { 2023-10-06T04:40:31.244 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-06T04:40:31.245 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-06T04:40:31.245 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 13, 2023-10-06T04:40:31.245 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.003411986, 2023-10-06T04:40:31.245 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000262460 2023-10-06T04:40:31.245 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.246 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-status": { 2023-10-06T04:40:31.246 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-06T04:40:31.246 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-06T04:40:31.246 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.246 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.246 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.246 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.247 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-telemetry": { 2023-10-06T04:40:31.247 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-06T04:40:31.247 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-06T04:40:31.247 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.247 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.247 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.248 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.248 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-volumes": { 2023-10-06T04:40:31.248 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2023-10-06T04:40:31.248 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2023-10-06T04:40:31.248 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 9, 2023-10-06T04:40:31.248 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.283764970, 2023-10-06T04:40:31.249 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.031529441 2023-10-06T04:40:31.249 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.249 INFO:teuthology.orchestra.run.smithi112.stdout: "libcephsqlite_striper": { 2023-10-06T04:40:31.249 INFO:teuthology.orchestra.run.smithi112.stdout: "update_metadata": 8, 2023-10-06T04:40:31.249 INFO:teuthology.orchestra.run.smithi112.stdout: "update_allocated": 2, 2023-10-06T04:40:31.249 INFO:teuthology.orchestra.run.smithi112.stdout: "update_size": 6, 2023-10-06T04:40:31.250 INFO:teuthology.orchestra.run.smithi112.stdout: "update_version": 8, 2023-10-06T04:40:31.250 INFO:teuthology.orchestra.run.smithi112.stdout: "shrink": 0, 2023-10-06T04:40:31.250 INFO:teuthology.orchestra.run.smithi112.stdout: "shrink_bytes": 0, 2023-10-06T04:40:31.250 INFO:teuthology.orchestra.run.smithi112.stdout: "lock": 11, 2023-10-06T04:40:31.250 INFO:teuthology.orchestra.run.smithi112.stdout: "unlock": 11 2023-10-06T04:40:31.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.250 INFO:teuthology.orchestra.run.smithi112.stdout: "libcephsqlite_vfs": { 2023-10-06T04:40:31.251 INFO:teuthology.orchestra.run.smithi112.stdout: "op_open": { 2023-10-06T04:40:31.251 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2, 2023-10-06T04:40:31.251 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.008999769, 2023-10-06T04:40:31.251 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.004499884 2023-10-06T04:40:31.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.251 INFO:teuthology.orchestra.run.smithi112.stdout: "op_delete": { 2023-10-06T04:40:31.251 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.252 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.252 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.252 INFO:teuthology.orchestra.run.smithi112.stdout: "op_access": { 2023-10-06T04:40:31.252 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.252 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.252 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.253 INFO:teuthology.orchestra.run.smithi112.stdout: "op_fullpathname": { 2023-10-06T04:40:31.253 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 1, 2023-10-06T04:40:31.253 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.253 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.253 INFO:teuthology.orchestra.run.smithi112.stdout: "op_currenttime": { 2023-10-06T04:40:31.254 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 4, 2023-10-06T04:40:31.254 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.254 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.254 INFO:teuthology.orchestra.run.smithi112.stdout: "opf_close": { 2023-10-06T04:40:31.254 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.255 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.255 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.255 INFO:teuthology.orchestra.run.smithi112.stdout: "opf_read": { 2023-10-06T04:40:31.255 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 20, 2023-10-06T04:40:31.255 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.005999845, 2023-10-06T04:40:31.256 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000299992 2023-10-06T04:40:31.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.256 INFO:teuthology.orchestra.run.smithi112.stdout: "opf_write": { 2023-10-06T04:40:31.256 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 85, 2023-10-06T04:40:31.256 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.002999923, 2023-10-06T04:40:31.256 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000035293 2023-10-06T04:40:31.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.257 INFO:teuthology.orchestra.run.smithi112.stdout: "opf_truncate": { 2023-10-06T04:40:31.257 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.257 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.257 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.258 INFO:teuthology.orchestra.run.smithi112.stdout: "opf_sync": { 2023-10-06T04:40:31.258 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 24, 2023-10-06T04:40:31.258 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.114997049, 2023-10-06T04:40:31.258 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.004791543 2023-10-06T04:40:31.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.259 INFO:teuthology.orchestra.run.smithi112.stdout: "opf_filesize": { 2023-10-06T04:40:31.259 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 20, 2023-10-06T04:40:31.259 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.259 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.259 INFO:teuthology.orchestra.run.smithi112.stdout: "opf_lock": { 2023-10-06T04:40:31.260 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 27, 2023-10-06T04:40:31.260 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.027999284, 2023-10-06T04:40:31.260 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.001037010 2023-10-06T04:40:31.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.260 INFO:teuthology.orchestra.run.smithi112.stdout: "opf_unlock": { 2023-10-06T04:40:31.260 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 19, 2023-10-06T04:40:31.260 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.020999463, 2023-10-06T04:40:31.260 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.001105234 2023-10-06T04:40:31.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.260 INFO:teuthology.orchestra.run.smithi112.stdout: "opf_checkreservedlock": { 2023-10-06T04:40:31.260 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 9, 2023-10-06T04:40:31.261 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.261 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.261 INFO:teuthology.orchestra.run.smithi112.stdout: "opf_filecontrol": { 2023-10-06T04:40:31.261 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 26, 2023-10-06T04:40:31.261 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.261 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.261 INFO:teuthology.orchestra.run.smithi112.stdout: "opf_sectorsize": { 2023-10-06T04:40:31.262 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.262 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.262 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.262 INFO:teuthology.orchestra.run.smithi112.stdout: "opf_devicecharacteristics": { 2023-10-06T04:40:31.262 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 30, 2023-10-06T04:40:31.262 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.262 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.263 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.263 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool": { 2023-10-06T04:40:31.263 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_bytes": 0, 2023-10-06T04:40:31.263 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_items": 0, 2023-10-06T04:40:31.263 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_bytes": 0, 2023-10-06T04:40:31.263 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_items": 0, 2023-10-06T04:40:31.263 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_bytes": 0, 2023-10-06T04:40:31.264 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_items": 0, 2023-10-06T04:40:31.264 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-06T04:40:31.264 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_items": 0, 2023-10-06T04:40:31.264 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-06T04:40:31.264 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_items": 0, 2023-10-06T04:40:31.264 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_bytes": 0, 2023-10-06T04:40:31.264 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_items": 0, 2023-10-06T04:40:31.264 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_Buffer_bytes": 0, 2023-10-06T04:40:31.265 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_Buffer_items": 0, 2023-10-06T04:40:31.265 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_Extent_bytes": 0, 2023-10-06T04:40:31.265 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_Extent_items": 0, 2023-10-06T04:40:31.265 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_Blob_bytes": 0, 2023-10-06T04:40:31.265 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_Blob_items": 0, 2023-10-06T04:40:31.265 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_SharedBlob_bytes": 0, 2023-10-06T04:40:31.265 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_SharedBlob_items": 0, 2023-10-06T04:40:31.266 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-06T04:40:31.266 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_items": 0, 2023-10-06T04:40:31.266 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_bytes": 0, 2023-10-06T04:40:31.266 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_items": 0, 2023-10-06T04:40:31.266 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_bytes": 0, 2023-10-06T04:40:31.266 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_items": 0, 2023-10-06T04:40:31.266 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-06T04:40:31.266 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_items": 0, 2023-10-06T04:40:31.266 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_bytes": 0, 2023-10-06T04:40:31.266 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_items": 0, 2023-10-06T04:40:31.266 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_bytes": 0, 2023-10-06T04:40:31.266 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_items": 0, 2023-10-06T04:40:31.267 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_bytes": 0, 2023-10-06T04:40:31.267 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_items": 0, 2023-10-06T04:40:31.267 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_bytes": 0, 2023-10-06T04:40:31.267 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_items": 0, 2023-10-06T04:40:31.267 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_bytes": 1595405, 2023-10-06T04:40:31.267 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_items": 338, 2023-10-06T04:40:31.267 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_bytes": 1496, 2023-10-06T04:40:31.267 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_items": 17, 2023-10-06T04:40:31.267 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bytes": 0, 2023-10-06T04:40:31.267 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_items": 0, 2023-10-06T04:40:31.267 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_bytes": 0, 2023-10-06T04:40:31.267 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_items": 0, 2023-10-06T04:40:31.268 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_bytes": 0, 2023-10-06T04:40:31.268 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_items": 0, 2023-10-06T04:40:31.268 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_bytes": 51288, 2023-10-06T04:40:31.268 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_items": 750, 2023-10-06T04:40:31.268 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_bytes": 0, 2023-10-06T04:40:31.268 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_items": 0, 2023-10-06T04:40:31.268 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_bytes": 22832, 2023-10-06T04:40:31.268 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_items": 345, 2023-10-06T04:40:31.268 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_bytes": 0, 2023-10-06T04:40:31.268 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_items": 0, 2023-10-06T04:40:31.268 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_bytes": 0, 2023-10-06T04:40:31.268 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_items": 0, 2023-10-06T04:40:31.268 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_bytes": 0, 2023-10-06T04:40:31.269 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_items": 0 2023-10-06T04:40:31.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.269 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2023-10-06T04:40:31.269 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_hit": 0, 2023-10-06T04:40:31.269 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_miss": 0 2023-10-06T04:40:31.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.269 INFO:teuthology.orchestra.run.smithi112.stdout: "objectcacher-libcephfs": { 2023-10-06T04:40:31.269 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_ops_hit": 0, 2023-10-06T04:40:31.269 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_ops_miss": 0, 2023-10-06T04:40:31.269 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_bytes_hit": 0, 2023-10-06T04:40:31.269 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_bytes_miss": 0, 2023-10-06T04:40:31.269 INFO:teuthology.orchestra.run.smithi112.stdout: "data_read": 0, 2023-10-06T04:40:31.270 INFO:teuthology.orchestra.run.smithi112.stdout: "data_written": 0, 2023-10-06T04:40:31.270 INFO:teuthology.orchestra.run.smithi112.stdout: "data_flushed": 0, 2023-10-06T04:40:31.270 INFO:teuthology.orchestra.run.smithi112.stdout: "data_overwritten_while_flushing": 0, 2023-10-06T04:40:31.270 INFO:teuthology.orchestra.run.smithi112.stdout: "write_ops_blocked": 0, 2023-10-06T04:40:31.270 INFO:teuthology.orchestra.run.smithi112.stdout: "write_bytes_blocked": 0, 2023-10-06T04:40:31.270 INFO:teuthology.orchestra.run.smithi112.stdout: "write_time_blocked": 0.000000000 2023-10-06T04:40:31.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.270 INFO:teuthology.orchestra.run.smithi112.stdout: "objectcacher-libcephfs-0x5616edd16000": { 2023-10-06T04:40:31.270 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_ops_hit": 0, 2023-10-06T04:40:31.270 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_ops_miss": 0, 2023-10-06T04:40:31.270 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_bytes_hit": 0, 2023-10-06T04:40:31.270 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_bytes_miss": 0, 2023-10-06T04:40:31.271 INFO:teuthology.orchestra.run.smithi112.stdout: "data_read": 0, 2023-10-06T04:40:31.271 INFO:teuthology.orchestra.run.smithi112.stdout: "data_written": 0, 2023-10-06T04:40:31.271 INFO:teuthology.orchestra.run.smithi112.stdout: "data_flushed": 0, 2023-10-06T04:40:31.271 INFO:teuthology.orchestra.run.smithi112.stdout: "data_overwritten_while_flushing": 0, 2023-10-06T04:40:31.271 INFO:teuthology.orchestra.run.smithi112.stdout: "write_ops_blocked": 0, 2023-10-06T04:40:31.271 INFO:teuthology.orchestra.run.smithi112.stdout: "write_bytes_blocked": 0, 2023-10-06T04:40:31.271 INFO:teuthology.orchestra.run.smithi112.stdout: "write_time_blocked": 0.000000000 2023-10-06T04:40:31.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.271 INFO:teuthology.orchestra.run.smithi112.stdout: "objectcacher-libcephfs-0x5616edd168c0": { 2023-10-06T04:40:31.271 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_ops_hit": 9, 2023-10-06T04:40:31.271 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_ops_miss": 0, 2023-10-06T04:40:31.271 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_bytes_hit": 1431, 2023-10-06T04:40:31.273 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_bytes_miss": 0, 2023-10-06T04:40:31.273 INFO:teuthology.orchestra.run.smithi112.stdout: "data_read": 1431, 2023-10-06T04:40:31.273 INFO:teuthology.orchestra.run.smithi112.stdout: "data_written": 477, 2023-10-06T04:40:31.273 INFO:teuthology.orchestra.run.smithi112.stdout: "data_flushed": 477, 2023-10-06T04:40:31.273 INFO:teuthology.orchestra.run.smithi112.stdout: "data_overwritten_while_flushing": 0, 2023-10-06T04:40:31.273 INFO:teuthology.orchestra.run.smithi112.stdout: "write_ops_blocked": 0, 2023-10-06T04:40:31.273 INFO:teuthology.orchestra.run.smithi112.stdout: "write_bytes_blocked": 0, 2023-10-06T04:40:31.274 INFO:teuthology.orchestra.run.smithi112.stdout: "write_time_blocked": 0.000000000 2023-10-06T04:40:31.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.274 INFO:teuthology.orchestra.run.smithi112.stdout: "objectcacher-libcephfs-0x5616edd172c0": { 2023-10-06T04:40:31.274 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_ops_hit": 0, 2023-10-06T04:40:31.274 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_ops_miss": 0, 2023-10-06T04:40:31.274 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_bytes_hit": 0, 2023-10-06T04:40:31.274 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_bytes_miss": 0, 2023-10-06T04:40:31.274 INFO:teuthology.orchestra.run.smithi112.stdout: "data_read": 0, 2023-10-06T04:40:31.274 INFO:teuthology.orchestra.run.smithi112.stdout: "data_written": 0, 2023-10-06T04:40:31.274 INFO:teuthology.orchestra.run.smithi112.stdout: "data_flushed": 0, 2023-10-06T04:40:31.274 INFO:teuthology.orchestra.run.smithi112.stdout: "data_overwritten_while_flushing": 0, 2023-10-06T04:40:31.275 INFO:teuthology.orchestra.run.smithi112.stdout: "write_ops_blocked": 0, 2023-10-06T04:40:31.275 INFO:teuthology.orchestra.run.smithi112.stdout: "write_bytes_blocked": 0, 2023-10-06T04:40:31.275 INFO:teuthology.orchestra.run.smithi112.stdout: "write_time_blocked": 0.000000000 2023-10-06T04:40:31.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.275 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter": { 2023-10-06T04:40:31.275 INFO:teuthology.orchestra.run.smithi112.stdout: "op_active": 0, 2023-10-06T04:40:31.275 INFO:teuthology.orchestra.run.smithi112.stdout: "op_laggy": 0, 2023-10-06T04:40:31.275 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send": 0, 2023-10-06T04:40:31.275 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send_bytes": 0, 2023-10-06T04:40:31.275 INFO:teuthology.orchestra.run.smithi112.stdout: "op_resend": 0, 2023-10-06T04:40:31.275 INFO:teuthology.orchestra.run.smithi112.stdout: "op_reply": 0, 2023-10-06T04:40:31.275 INFO:teuthology.orchestra.run.smithi112.stdout: "oplen_avg": { 2023-10-06T04:40:31.276 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.276 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0 2023-10-06T04:40:31.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.276 INFO:teuthology.orchestra.run.smithi112.stdout: "op": 0, 2023-10-06T04:40:31.276 INFO:teuthology.orchestra.run.smithi112.stdout: "op_r": 0, 2023-10-06T04:40:31.276 INFO:teuthology.orchestra.run.smithi112.stdout: "op_w": 0, 2023-10-06T04:40:31.276 INFO:teuthology.orchestra.run.smithi112.stdout: "op_rmw": 0, 2023-10-06T04:40:31.276 INFO:teuthology.orchestra.run.smithi112.stdout: "op_pg": 0, 2023-10-06T04:40:31.276 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_stat": 0, 2023-10-06T04:40:31.276 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_create": 0, 2023-10-06T04:40:31.276 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_read": 0, 2023-10-06T04:40:31.276 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_write": 0, 2023-10-06T04:40:31.277 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writefull": 0, 2023-10-06T04:40:31.277 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writesame": 0, 2023-10-06T04:40:31.277 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_append": 0, 2023-10-06T04:40:31.277 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_zero": 0, 2023-10-06T04:40:31.277 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_truncate": 0, 2023-10-06T04:40:31.277 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_delete": 0, 2023-10-06T04:40:31.277 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_mapext": 0, 2023-10-06T04:40:31.277 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_sparse_read": 0, 2023-10-06T04:40:31.277 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_clonerange": 0, 2023-10-06T04:40:31.277 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_getxattr": 0, 2023-10-06T04:40:31.277 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_setxattr": 0, 2023-10-06T04:40:31.277 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_cmpxattr": 0, 2023-10-06T04:40:31.278 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_rmxattr": 0, 2023-10-06T04:40:31.278 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_resetxattrs": 0, 2023-10-06T04:40:31.278 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_call": 0, 2023-10-06T04:40:31.278 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_watch": 0, 2023-10-06T04:40:31.278 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_notify": 0, 2023-10-06T04:40:31.278 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T04:40:31.278 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls": 0, 2023-10-06T04:40:31.278 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls_filter": 0, 2023-10-06T04:40:31.278 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_other": 0, 2023-10-06T04:40:31.278 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_active": 0, 2023-10-06T04:40:31.278 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_send": 0, 2023-10-06T04:40:31.278 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_resend": 0, 2023-10-06T04:40:31.279 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ping": 0, 2023-10-06T04:40:31.279 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_active": 0, 2023-10-06T04:40:31.279 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_send": 0, 2023-10-06T04:40:31.279 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_resend": 0, 2023-10-06T04:40:31.279 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_active": 0, 2023-10-06T04:40:31.279 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_send": 0, 2023-10-06T04:40:31.279 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_resend": 0, 2023-10-06T04:40:31.279 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_active": 0, 2023-10-06T04:40:31.279 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_send": 0, 2023-10-06T04:40:31.279 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_resend": 0, 2023-10-06T04:40:31.279 INFO:teuthology.orchestra.run.smithi112.stdout: "command_active": 0, 2023-10-06T04:40:31.280 INFO:teuthology.orchestra.run.smithi112.stdout: "command_send": 8, 2023-10-06T04:40:31.280 INFO:teuthology.orchestra.run.smithi112.stdout: "command_resend": 0, 2023-10-06T04:40:31.280 INFO:teuthology.orchestra.run.smithi112.stdout: "map_epoch": 34, 2023-10-06T04:40:31.280 INFO:teuthology.orchestra.run.smithi112.stdout: "map_full": 0, 2023-10-06T04:40:31.280 INFO:teuthology.orchestra.run.smithi112.stdout: "map_inc": 33, 2023-10-06T04:40:31.280 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_sessions": 8, 2023-10-06T04:40:31.280 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_open": 8, 2023-10-06T04:40:31.280 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_close": 0, 2023-10-06T04:40:31.280 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_laggy": 0, 2023-10-06T04:40:31.280 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_wr": 0, 2023-10-06T04:40:31.280 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_rd": 0, 2023-10-06T04:40:31.280 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_del": 0 2023-10-06T04:40:31.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.281 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter-0x5616edc46320": { 2023-10-06T04:40:31.281 INFO:teuthology.orchestra.run.smithi112.stdout: "op_active": 0, 2023-10-06T04:40:31.281 INFO:teuthology.orchestra.run.smithi112.stdout: "op_laggy": 0, 2023-10-06T04:40:31.281 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send": 163, 2023-10-06T04:40:31.281 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send_bytes": 2434738, 2023-10-06T04:40:31.281 INFO:teuthology.orchestra.run.smithi112.stdout: "op_resend": 0, 2023-10-06T04:40:31.281 INFO:teuthology.orchestra.run.smithi112.stdout: "op_reply": 163, 2023-10-06T04:40:31.281 INFO:teuthology.orchestra.run.smithi112.stdout: "oplen_avg": { 2023-10-06T04:40:31.281 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 163, 2023-10-06T04:40:31.281 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 307 2023-10-06T04:40:31.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.282 INFO:teuthology.orchestra.run.smithi112.stdout: "op": 163, 2023-10-06T04:40:31.282 INFO:teuthology.orchestra.run.smithi112.stdout: "op_r": 46, 2023-10-06T04:40:31.282 INFO:teuthology.orchestra.run.smithi112.stdout: "op_w": 117, 2023-10-06T04:40:31.282 INFO:teuthology.orchestra.run.smithi112.stdout: "op_rmw": 0, 2023-10-06T04:40:31.282 INFO:teuthology.orchestra.run.smithi112.stdout: "op_pg": 0, 2023-10-06T04:40:31.282 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_stat": 0, 2023-10-06T04:40:31.282 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_create": 2, 2023-10-06T04:40:31.282 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_read": 20, 2023-10-06T04:40:31.282 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_write": 85, 2023-10-06T04:40:31.282 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writefull": 0, 2023-10-06T04:40:31.282 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writesame": 0, 2023-10-06T04:40:31.282 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_append": 0, 2023-10-06T04:40:31.283 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_zero": 0, 2023-10-06T04:40:31.283 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_truncate": 0, 2023-10-06T04:40:31.283 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_delete": 0, 2023-10-06T04:40:31.283 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_mapext": 0, 2023-10-06T04:40:31.283 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_sparse_read": 0, 2023-10-06T04:40:31.283 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_clonerange": 0, 2023-10-06T04:40:31.283 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_getxattr": 104, 2023-10-06T04:40:31.283 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_setxattr": 52, 2023-10-06T04:40:31.283 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_cmpxattr": 22, 2023-10-06T04:40:31.283 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_rmxattr": 0, 2023-10-06T04:40:31.283 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_resetxattrs": 0, 2023-10-06T04:40:31.283 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_call": 22, 2023-10-06T04:40:31.284 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_watch": 0, 2023-10-06T04:40:31.284 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_notify": 0, 2023-10-06T04:40:31.284 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T04:40:31.284 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls": 0, 2023-10-06T04:40:31.284 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls_filter": 0, 2023-10-06T04:40:31.284 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_other": 0, 2023-10-06T04:40:31.284 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_active": 0, 2023-10-06T04:40:31.284 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_send": 0, 2023-10-06T04:40:31.284 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_resend": 0, 2023-10-06T04:40:31.284 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ping": 0, 2023-10-06T04:40:31.284 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_active": 0, 2023-10-06T04:40:31.284 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_send": 0, 2023-10-06T04:40:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_resend": 0, 2023-10-06T04:40:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_active": 0, 2023-10-06T04:40:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_send": 0, 2023-10-06T04:40:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_resend": 0, 2023-10-06T04:40:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_active": 0, 2023-10-06T04:40:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_send": 0, 2023-10-06T04:40:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_resend": 0, 2023-10-06T04:40:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "command_active": 0, 2023-10-06T04:40:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "command_send": 0, 2023-10-06T04:40:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "command_resend": 0, 2023-10-06T04:40:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "map_epoch": 15, 2023-10-06T04:40:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "map_full": 0, 2023-10-06T04:40:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "map_inc": 5, 2023-10-06T04:40:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_sessions": 1, 2023-10-06T04:40:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_open": 1, 2023-10-06T04:40:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_close": 0, 2023-10-06T04:40:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_laggy": 0, 2023-10-06T04:40:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_wr": 0, 2023-10-06T04:40:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_rd": 0, 2023-10-06T04:40:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_del": 0 2023-10-06T04:40:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter-0x5616edc466e0": { 2023-10-06T04:40:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "op_active": 0, 2023-10-06T04:40:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "op_laggy": 0, 2023-10-06T04:40:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send": 0, 2023-10-06T04:40:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send_bytes": 0, 2023-10-06T04:40:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "op_resend": 0, 2023-10-06T04:40:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "op_reply": 0, 2023-10-06T04:40:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "oplen_avg": { 2023-10-06T04:40:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0 2023-10-06T04:40:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "op": 0, 2023-10-06T04:40:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "op_r": 0, 2023-10-06T04:40:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "op_w": 0, 2023-10-06T04:40:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "op_rmw": 0, 2023-10-06T04:40:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "op_pg": 0, 2023-10-06T04:40:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_stat": 0, 2023-10-06T04:40:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_create": 0, 2023-10-06T04:40:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_read": 0, 2023-10-06T04:40:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_write": 0, 2023-10-06T04:40:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writefull": 0, 2023-10-06T04:40:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writesame": 0, 2023-10-06T04:40:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_append": 0, 2023-10-06T04:40:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_zero": 0, 2023-10-06T04:40:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_truncate": 0, 2023-10-06T04:40:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_delete": 0, 2023-10-06T04:40:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_mapext": 0, 2023-10-06T04:40:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_sparse_read": 0, 2023-10-06T04:40:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_clonerange": 0, 2023-10-06T04:40:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_getxattr": 0, 2023-10-06T04:40:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_setxattr": 0, 2023-10-06T04:40:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_cmpxattr": 0, 2023-10-06T04:40:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_rmxattr": 0, 2023-10-06T04:40:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_resetxattrs": 0, 2023-10-06T04:40:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_call": 0, 2023-10-06T04:40:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_watch": 0, 2023-10-06T04:40:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_notify": 0, 2023-10-06T04:40:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T04:40:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls": 0, 2023-10-06T04:40:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls_filter": 0, 2023-10-06T04:40:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_other": 0, 2023-10-06T04:40:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_active": 0, 2023-10-06T04:40:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_send": 0, 2023-10-06T04:40:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_resend": 0, 2023-10-06T04:40:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ping": 0, 2023-10-06T04:40:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_active": 0, 2023-10-06T04:40:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_send": 0, 2023-10-06T04:40:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_resend": 0, 2023-10-06T04:40:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_active": 0, 2023-10-06T04:40:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_send": 0, 2023-10-06T04:40:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_resend": 0, 2023-10-06T04:40:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_active": 0, 2023-10-06T04:40:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_send": 0, 2023-10-06T04:40:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_resend": 0, 2023-10-06T04:40:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "command_active": 0, 2023-10-06T04:40:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "command_send": 0, 2023-10-06T04:40:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "command_resend": 0, 2023-10-06T04:40:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "map_epoch": 0, 2023-10-06T04:40:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "map_full": 0, 2023-10-06T04:40:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "map_inc": 0, 2023-10-06T04:40:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_sessions": 0, 2023-10-06T04:40:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_open": 0, 2023-10-06T04:40:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_close": 0, 2023-10-06T04:40:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_laggy": 0, 2023-10-06T04:40:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_wr": 0, 2023-10-06T04:40:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_rd": 0, 2023-10-06T04:40:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_del": 0 2023-10-06T04:40:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter-0x5616edc46960": { 2023-10-06T04:40:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "op_active": 0, 2023-10-06T04:40:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "op_laggy": 0, 2023-10-06T04:40:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send": 2, 2023-10-06T04:40:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send_bytes": 32, 2023-10-06T04:40:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "op_resend": 0, 2023-10-06T04:40:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "op_reply": 2, 2023-10-06T04:40:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "oplen_avg": { 2023-10-06T04:40:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2, 2023-10-06T04:40:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 2 2023-10-06T04:40:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "op": 2, 2023-10-06T04:40:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "op_r": 2, 2023-10-06T04:40:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "op_w": 0, 2023-10-06T04:40:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "op_rmw": 0, 2023-10-06T04:40:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "op_pg": 0, 2023-10-06T04:40:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_stat": 0, 2023-10-06T04:40:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_create": 0, 2023-10-06T04:40:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_read": 0, 2023-10-06T04:40:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_write": 0, 2023-10-06T04:40:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writefull": 0, 2023-10-06T04:40:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writesame": 0, 2023-10-06T04:40:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_append": 0, 2023-10-06T04:40:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_zero": 0, 2023-10-06T04:40:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_truncate": 0, 2023-10-06T04:40:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_delete": 0, 2023-10-06T04:40:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_mapext": 0, 2023-10-06T04:40:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_sparse_read": 0, 2023-10-06T04:40:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_clonerange": 0, 2023-10-06T04:40:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_getxattr": 0, 2023-10-06T04:40:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_setxattr": 0, 2023-10-06T04:40:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_cmpxattr": 0, 2023-10-06T04:40:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_rmxattr": 0, 2023-10-06T04:40:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_resetxattrs": 0, 2023-10-06T04:40:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_call": 0, 2023-10-06T04:40:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_watch": 0, 2023-10-06T04:40:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_notify": 0, 2023-10-06T04:40:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T04:40:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls": 0, 2023-10-06T04:40:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls_filter": 0, 2023-10-06T04:40:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_other": 0, 2023-10-06T04:40:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_active": 0, 2023-10-06T04:40:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_send": 0, 2023-10-06T04:40:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_resend": 0, 2023-10-06T04:40:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ping": 0, 2023-10-06T04:40:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_active": 0, 2023-10-06T04:40:31.296 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_send": 0, 2023-10-06T04:40:31.296 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_resend": 0, 2023-10-06T04:40:31.296 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_active": 0, 2023-10-06T04:40:31.296 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_send": 0, 2023-10-06T04:40:31.296 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_resend": 0, 2023-10-06T04:40:31.296 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_active": 0, 2023-10-06T04:40:31.296 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_send": 0, 2023-10-06T04:40:31.296 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_resend": 0, 2023-10-06T04:40:31.296 INFO:teuthology.orchestra.run.smithi112.stdout: "command_active": 0, 2023-10-06T04:40:31.296 INFO:teuthology.orchestra.run.smithi112.stdout: "command_send": 0, 2023-10-06T04:40:31.296 INFO:teuthology.orchestra.run.smithi112.stdout: "command_resend": 0, 2023-10-06T04:40:31.296 INFO:teuthology.orchestra.run.smithi112.stdout: "map_epoch": 31, 2023-10-06T04:40:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "map_full": 0, 2023-10-06T04:40:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "map_inc": 21, 2023-10-06T04:40:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_sessions": 2, 2023-10-06T04:40:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_open": 2, 2023-10-06T04:40:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_close": 0, 2023-10-06T04:40:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_laggy": 0, 2023-10-06T04:40:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_wr": 0, 2023-10-06T04:40:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_rd": 2, 2023-10-06T04:40:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_del": 0 2023-10-06T04:40:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter-0x5616edc477c0": { 2023-10-06T04:40:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "op_active": 0, 2023-10-06T04:40:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "op_laggy": 0, 2023-10-06T04:40:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send": 1, 2023-10-06T04:40:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send_bytes": 39, 2023-10-06T04:40:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: "op_resend": 0, 2023-10-06T04:40:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: "op_reply": 1, 2023-10-06T04:40:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: "oplen_avg": { 2023-10-06T04:40:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 1, 2023-10-06T04:40:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 1 2023-10-06T04:40:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: "op": 1, 2023-10-06T04:40:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: "op_r": 1, 2023-10-06T04:40:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: "op_w": 0, 2023-10-06T04:40:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: "op_rmw": 0, 2023-10-06T04:40:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "op_pg": 0, 2023-10-06T04:40:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_stat": 0, 2023-10-06T04:40:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_create": 0, 2023-10-06T04:40:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_read": 0, 2023-10-06T04:40:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_write": 0, 2023-10-06T04:40:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writefull": 0, 2023-10-06T04:40:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writesame": 0, 2023-10-06T04:40:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_append": 0, 2023-10-06T04:40:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_zero": 0, 2023-10-06T04:40:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_truncate": 0, 2023-10-06T04:40:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_delete": 0, 2023-10-06T04:40:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_mapext": 0, 2023-10-06T04:40:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_sparse_read": 0, 2023-10-06T04:40:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_clonerange": 0, 2023-10-06T04:40:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_getxattr": 0, 2023-10-06T04:40:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_setxattr": 0, 2023-10-06T04:40:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_cmpxattr": 0, 2023-10-06T04:40:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_rmxattr": 0, 2023-10-06T04:40:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_resetxattrs": 0, 2023-10-06T04:40:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_call": 0, 2023-10-06T04:40:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_watch": 0, 2023-10-06T04:40:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_notify": 0, 2023-10-06T04:40:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T04:40:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls": 0, 2023-10-06T04:40:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls_filter": 0, 2023-10-06T04:40:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_other": 1, 2023-10-06T04:40:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_active": 0, 2023-10-06T04:40:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_send": 0, 2023-10-06T04:40:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_resend": 0, 2023-10-06T04:40:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ping": 0, 2023-10-06T04:40:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_active": 0, 2023-10-06T04:40:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_send": 0, 2023-10-06T04:40:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_resend": 0, 2023-10-06T04:40:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_active": 0, 2023-10-06T04:40:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_send": 0, 2023-10-06T04:40:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_resend": 0, 2023-10-06T04:40:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_active": 0, 2023-10-06T04:40:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_send": 0, 2023-10-06T04:40:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_resend": 0, 2023-10-06T04:40:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "command_active": 0, 2023-10-06T04:40:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "command_send": 0, 2023-10-06T04:40:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "command_resend": 0, 2023-10-06T04:40:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "map_epoch": 0, 2023-10-06T04:40:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "map_full": 0, 2023-10-06T04:40:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "map_inc": 0, 2023-10-06T04:40:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_sessions": 1, 2023-10-06T04:40:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_open": 1, 2023-10-06T04:40:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_close": 0, 2023-10-06T04:40:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_laggy": 0, 2023-10-06T04:40:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_wr": 0, 2023-10-06T04:40:31.303 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_rd": 0, 2023-10-06T04:40:31.303 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_del": 0 2023-10-06T04:40:31.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.303 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter-0x5616edd16640": { 2023-10-06T04:40:31.303 INFO:teuthology.orchestra.run.smithi112.stdout: "op_active": 0, 2023-10-06T04:40:31.303 INFO:teuthology.orchestra.run.smithi112.stdout: "op_laggy": 0, 2023-10-06T04:40:31.303 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send": 0, 2023-10-06T04:40:31.303 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send_bytes": 0, 2023-10-06T04:40:31.303 INFO:teuthology.orchestra.run.smithi112.stdout: "op_resend": 0, 2023-10-06T04:40:31.303 INFO:teuthology.orchestra.run.smithi112.stdout: "op_reply": 0, 2023-10-06T04:40:31.303 INFO:teuthology.orchestra.run.smithi112.stdout: "oplen_avg": { 2023-10-06T04:40:31.303 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.303 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0 2023-10-06T04:40:31.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.304 INFO:teuthology.orchestra.run.smithi112.stdout: "op": 0, 2023-10-06T04:40:31.304 INFO:teuthology.orchestra.run.smithi112.stdout: "op_r": 0, 2023-10-06T04:40:31.304 INFO:teuthology.orchestra.run.smithi112.stdout: "op_w": 0, 2023-10-06T04:40:31.304 INFO:teuthology.orchestra.run.smithi112.stdout: "op_rmw": 0, 2023-10-06T04:40:31.304 INFO:teuthology.orchestra.run.smithi112.stdout: "op_pg": 0, 2023-10-06T04:40:31.304 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_stat": 0, 2023-10-06T04:40:31.304 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_create": 0, 2023-10-06T04:40:31.304 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_read": 0, 2023-10-06T04:40:31.304 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_write": 0, 2023-10-06T04:40:31.304 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writefull": 0, 2023-10-06T04:40:31.304 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writesame": 0, 2023-10-06T04:40:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_append": 0, 2023-10-06T04:40:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_zero": 0, 2023-10-06T04:40:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_truncate": 0, 2023-10-06T04:40:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_delete": 0, 2023-10-06T04:40:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_mapext": 0, 2023-10-06T04:40:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_sparse_read": 0, 2023-10-06T04:40:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_clonerange": 0, 2023-10-06T04:40:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_getxattr": 0, 2023-10-06T04:40:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_setxattr": 0, 2023-10-06T04:40:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_cmpxattr": 0, 2023-10-06T04:40:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_rmxattr": 0, 2023-10-06T04:40:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_resetxattrs": 0, 2023-10-06T04:40:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_call": 0, 2023-10-06T04:40:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_watch": 0, 2023-10-06T04:40:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_notify": 0, 2023-10-06T04:40:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T04:40:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls": 0, 2023-10-06T04:40:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls_filter": 0, 2023-10-06T04:40:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_other": 0, 2023-10-06T04:40:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_active": 0, 2023-10-06T04:40:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_send": 0, 2023-10-06T04:40:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_resend": 0, 2023-10-06T04:40:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ping": 0, 2023-10-06T04:40:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_active": 0, 2023-10-06T04:40:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_send": 0, 2023-10-06T04:40:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_resend": 0, 2023-10-06T04:40:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_active": 0, 2023-10-06T04:40:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_send": 0, 2023-10-06T04:40:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_resend": 0, 2023-10-06T04:40:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_active": 0, 2023-10-06T04:40:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_send": 0, 2023-10-06T04:40:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_resend": 0, 2023-10-06T04:40:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "command_active": 0, 2023-10-06T04:40:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "command_send": 0, 2023-10-06T04:40:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "command_resend": 0, 2023-10-06T04:40:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "map_epoch": 0, 2023-10-06T04:40:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "map_full": 0, 2023-10-06T04:40:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "map_inc": 0, 2023-10-06T04:40:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_sessions": 0, 2023-10-06T04:40:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_open": 0, 2023-10-06T04:40:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_close": 0, 2023-10-06T04:40:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_laggy": 0, 2023-10-06T04:40:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_wr": 0, 2023-10-06T04:40:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_rd": 0, 2023-10-06T04:40:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_del": 0 2023-10-06T04:40:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter-0x5616edd16960": { 2023-10-06T04:40:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "op_active": 0, 2023-10-06T04:40:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "op_laggy": 0, 2023-10-06T04:40:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send": 3, 2023-10-06T04:40:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send_bytes": 477, 2023-10-06T04:40:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: "op_resend": 0, 2023-10-06T04:40:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: "op_reply": 3, 2023-10-06T04:40:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: "oplen_avg": { 2023-10-06T04:40:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 3, 2023-10-06T04:40:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 3 2023-10-06T04:40:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: "op": 3, 2023-10-06T04:40:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: "op_r": 0, 2023-10-06T04:40:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: "op_w": 3, 2023-10-06T04:40:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: "op_rmw": 0, 2023-10-06T04:40:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: "op_pg": 0, 2023-10-06T04:40:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_stat": 0, 2023-10-06T04:40:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_create": 0, 2023-10-06T04:40:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_read": 0, 2023-10-06T04:40:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_write": 3, 2023-10-06T04:40:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writefull": 0, 2023-10-06T04:40:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writesame": 0, 2023-10-06T04:40:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_append": 0, 2023-10-06T04:40:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_zero": 0, 2023-10-06T04:40:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_truncate": 0, 2023-10-06T04:40:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_delete": 0, 2023-10-06T04:40:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_mapext": 0, 2023-10-06T04:40:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_sparse_read": 0, 2023-10-06T04:40:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_clonerange": 0, 2023-10-06T04:40:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_getxattr": 0, 2023-10-06T04:40:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_setxattr": 0, 2023-10-06T04:40:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_cmpxattr": 0, 2023-10-06T04:40:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_rmxattr": 0, 2023-10-06T04:40:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_resetxattrs": 0, 2023-10-06T04:40:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_call": 0, 2023-10-06T04:40:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_watch": 0, 2023-10-06T04:40:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_notify": 0, 2023-10-06T04:40:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T04:40:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls": 0, 2023-10-06T04:40:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls_filter": 0, 2023-10-06T04:40:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_other": 0, 2023-10-06T04:40:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_active": 0, 2023-10-06T04:40:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_send": 0, 2023-10-06T04:40:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_resend": 0, 2023-10-06T04:40:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ping": 0, 2023-10-06T04:40:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_active": 0, 2023-10-06T04:40:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_send": 0, 2023-10-06T04:40:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_resend": 0, 2023-10-06T04:40:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_active": 0, 2023-10-06T04:40:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_send": 0, 2023-10-06T04:40:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_resend": 0, 2023-10-06T04:40:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_active": 0, 2023-10-06T04:40:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_send": 0, 2023-10-06T04:40:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_resend": 0, 2023-10-06T04:40:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "command_active": 0, 2023-10-06T04:40:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "command_send": 0, 2023-10-06T04:40:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "command_resend": 0, 2023-10-06T04:40:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "map_epoch": 0, 2023-10-06T04:40:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "map_full": 0, 2023-10-06T04:40:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "map_inc": 0, 2023-10-06T04:40:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_sessions": 3, 2023-10-06T04:40:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_open": 3, 2023-10-06T04:40:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_close": 0, 2023-10-06T04:40:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_laggy": 0, 2023-10-06T04:40:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_wr": 0, 2023-10-06T04:40:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_rd": 0, 2023-10-06T04:40:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_del": 0 2023-10-06T04:40:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter-0x5616edd17360": { 2023-10-06T04:40:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "op_active": 0, 2023-10-06T04:40:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "op_laggy": 0, 2023-10-06T04:40:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send": 0, 2023-10-06T04:40:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send_bytes": 0, 2023-10-06T04:40:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "op_resend": 0, 2023-10-06T04:40:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "op_reply": 0, 2023-10-06T04:40:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "oplen_avg": { 2023-10-06T04:40:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0 2023-10-06T04:40:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: "op": 0, 2023-10-06T04:40:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: "op_r": 0, 2023-10-06T04:40:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: "op_w": 0, 2023-10-06T04:40:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: "op_rmw": 0, 2023-10-06T04:40:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: "op_pg": 0, 2023-10-06T04:40:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_stat": 0, 2023-10-06T04:40:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_create": 0, 2023-10-06T04:40:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_read": 0, 2023-10-06T04:40:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_write": 0, 2023-10-06T04:40:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writefull": 0, 2023-10-06T04:40:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writesame": 0, 2023-10-06T04:40:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_append": 0, 2023-10-06T04:40:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_zero": 0, 2023-10-06T04:40:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_truncate": 0, 2023-10-06T04:40:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_delete": 0, 2023-10-06T04:40:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_mapext": 0, 2023-10-06T04:40:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_sparse_read": 0, 2023-10-06T04:40:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_clonerange": 0, 2023-10-06T04:40:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_getxattr": 0, 2023-10-06T04:40:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_setxattr": 0, 2023-10-06T04:40:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_cmpxattr": 0, 2023-10-06T04:40:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_rmxattr": 0, 2023-10-06T04:40:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_resetxattrs": 0, 2023-10-06T04:40:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_call": 0, 2023-10-06T04:40:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_watch": 0, 2023-10-06T04:40:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_notify": 0, 2023-10-06T04:40:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T04:40:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls": 0, 2023-10-06T04:40:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls_filter": 0, 2023-10-06T04:40:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_other": 0, 2023-10-06T04:40:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_active": 0, 2023-10-06T04:40:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_send": 0, 2023-10-06T04:40:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_resend": 0, 2023-10-06T04:40:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ping": 0, 2023-10-06T04:40:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_active": 0, 2023-10-06T04:40:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_send": 0, 2023-10-06T04:40:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_resend": 0, 2023-10-06T04:40:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_active": 0, 2023-10-06T04:40:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_send": 0, 2023-10-06T04:40:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_resend": 0, 2023-10-06T04:40:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_active": 0, 2023-10-06T04:40:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_send": 0, 2023-10-06T04:40:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_resend": 0, 2023-10-06T04:40:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "command_active": 0, 2023-10-06T04:40:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "command_send": 0, 2023-10-06T04:40:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "command_resend": 0, 2023-10-06T04:40:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "map_epoch": 0, 2023-10-06T04:40:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "map_full": 0, 2023-10-06T04:40:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "map_inc": 0, 2023-10-06T04:40:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_sessions": 0, 2023-10-06T04:40:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_open": 0, 2023-10-06T04:40:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_close": 0, 2023-10-06T04:40:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_laggy": 0, 2023-10-06T04:40:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_wr": 0, 2023-10-06T04:40:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_rd": 0, 2023-10-06T04:40:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_del": 0 2023-10-06T04:40:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-mgr_client_bytes": { 2023-10-06T04:40:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 134217728, 2023-10-06T04:40:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-06T04:40:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-06T04:40:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-06T04:40:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2023-10-06T04:40:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-06T04:40:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-mgr_client_messages": { 2023-10-06T04:40:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 512, 2023-10-06T04:40:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-06T04:40:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-06T04:40:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-06T04:40:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2023-10-06T04:40:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-06T04:40:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-mgr_mds_bytes": { 2023-10-06T04:40:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 134217728, 2023-10-06T04:40:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-06T04:40:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-06T04:40:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-06T04:40:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2023-10-06T04:40:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-06T04:40:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-mgr_mds_messsages": { 2023-10-06T04:40:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 128, 2023-10-06T04:40:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-06T04:40:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-06T04:40:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-06T04:40:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2023-10-06T04:40:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-06T04:40:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-mgr_mon_bytes": { 2023-10-06T04:40:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 134217728, 2023-10-06T04:40:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 475, 2023-10-06T04:40:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 5292855, 2023-10-06T04:40:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 475, 2023-10-06T04:40:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 475, 2023-10-06T04:40:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 5292855, 2023-10-06T04:40:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-mgr_mon_messsages": { 2023-10-06T04:40:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 128, 2023-10-06T04:40:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 475, 2023-10-06T04:40:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 475, 2023-10-06T04:40:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 475, 2023-10-06T04:40:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 475, 2023-10-06T04:40:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 475, 2023-10-06T04:40:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-mgr_osd_bytes": { 2023-10-06T04:40:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 536870912, 2023-10-06T04:40:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-06T04:40:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-06T04:40:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-06T04:40:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2023-10-06T04:40:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-06T04:40:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-mgr_osd_messsages": { 2023-10-06T04:40:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 8192, 2023-10-06T04:40:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-06T04:40:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-06T04:40:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-06T04:40:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2023-10-06T04:40:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-06T04:40:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-client": { 2023-10-06T04:40:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-06T04:40:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 173, 2023-10-06T04:40:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 63653, 2023-10-06T04:40:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 173, 2023-10-06T04:40:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 173, 2023-10-06T04:40:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 63653, 2023-10-06T04:40:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-client-0x5616edd16780": { 2023-10-06T04:40:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-06T04:40:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 41, 2023-10-06T04:40:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 22629, 2023-10-06T04:40:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 41, 2023-10-06T04:40:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 41, 2023-10-06T04:40:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 22629, 2023-10-06T04:40:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-client-0x5616edd16820": { 2023-10-06T04:40:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-06T04:40:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 80, 2023-10-06T04:40:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 41307, 2023-10-06T04:40:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 80, 2023-10-06T04:40:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 80, 2023-10-06T04:40:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 41307, 2023-10-06T04:40:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mgr": { 2023-10-06T04:40:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-06T04:40:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 328, 2023-10-06T04:40:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 718705, 2023-10-06T04:40:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 328, 2023-10-06T04:40:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 328, 2023-10-06T04:40:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 718705, 2023-10-06T04:40:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mgr-0x5616ea1c5720": { 2023-10-06T04:40:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-06T04:40:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 475, 2023-10-06T04:40:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 5292855, 2023-10-06T04:40:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 475, 2023-10-06T04:40:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 475, 2023-10-06T04:40:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 5292855, 2023-10-06T04:40:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-radosclient": { 2023-10-06T04:40:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-06T04:40:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 175, 2023-10-06T04:40:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 426672, 2023-10-06T04:40:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 175, 2023-10-06T04:40:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 175, 2023-10-06T04:40:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 426672, 2023-10-06T04:40:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x5616edc468c0": { 2023-10-06T04:40:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-06T04:40:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 10, 2023-10-06T04:40:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 383812, 2023-10-06T04:40:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 10, 2023-10-06T04:40:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 10, 2023-10-06T04:40:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 383812, 2023-10-06T04:40:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x5616edc46b40": { 2023-10-06T04:40:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-06T04:40:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 15, 2023-10-06T04:40:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 400771, 2023-10-06T04:40:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 15, 2023-10-06T04:40:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 15, 2023-10-06T04:40:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 400771, 2023-10-06T04:40:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x5616edc47540": { 2023-10-06T04:40:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-06T04:40:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 9, 2023-10-06T04:40:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 260740, 2023-10-06T04:40:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 9, 2023-10-06T04:40:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 9, 2023-10-06T04:40:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 260740, 2023-10-06T04:40:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_bytes": { 2023-10-06T04:40:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-06T04:40:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-06T04:40:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-06T04:40:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-06T04:40:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2023-10-06T04:40:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-06T04:40:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_bytes-0x5616edc461e0": { 2023-10-06T04:40:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-06T04:40:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 163, 2023-10-06T04:40:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 2433049, 2023-10-06T04:40:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 163, 2023-10-06T04:40:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 163, 2023-10-06T04:40:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 2433049, 2023-10-06T04:40:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_bytes-0x5616edc46820": { 2023-10-06T04:40:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-06T04:40:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-06T04:40:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-06T04:40:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-06T04:40:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2023-10-06T04:40:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-06T04:40:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_bytes-0x5616edc46aa0": { 2023-10-06T04:40:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-06T04:40:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 2, 2023-10-06T04:40:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-06T04:40:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 2, 2023-10-06T04:40:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2, 2023-10-06T04:40:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-06T04:40:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_bytes-0x5616edc47220": { 2023-10-06T04:40:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-06T04:40:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-06T04:40:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-06T04:40:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-06T04:40:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2023-10-06T04:40:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-06T04:40:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_bytes-0x5616edc475e0": { 2023-10-06T04:40:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-06T04:40:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 1, 2023-10-06T04:40:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-06T04:40:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 1, 2023-10-06T04:40:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 1, 2023-10-06T04:40:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-06T04:40:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_bytes-0x5616edd16140": { 2023-10-06T04:40:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-06T04:40:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-06T04:40:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-06T04:40:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-06T04:40:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2023-10-06T04:40:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-06T04:40:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_bytes-0x5616edd163c0": { 2023-10-06T04:40:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2023-10-06T04:40:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-06T04:40:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-06T04:40:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-06T04:40:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 3, 2023-10-06T04:40:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 477, 2023-10-06T04:40:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 3, 2023-10-06T04:40:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 477, 2023-10-06T04:40:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_ops": { 2023-10-06T04:40:31.357 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.357 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 1024, 2023-10-06T04:40:31.357 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.357 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-06T04:40:31.357 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-06T04:40:31.357 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.357 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-06T04:40:31.357 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.357 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.357 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2023-10-06T04:40:31.357 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-06T04:40:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_ops-0x5616edc46280": { 2023-10-06T04:40:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 1024, 2023-10-06T04:40:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 163, 2023-10-06T04:40:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 163, 2023-10-06T04:40:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 163, 2023-10-06T04:40:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 163, 2023-10-06T04:40:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 163, 2023-10-06T04:40:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_ops-0x5616edc463c0": { 2023-10-06T04:40:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 1024, 2023-10-06T04:40:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 1, 2023-10-06T04:40:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 1, 2023-10-06T04:40:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 1, 2023-10-06T04:40:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 1, 2023-10-06T04:40:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 1, 2023-10-06T04:40:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_ops-0x5616edc46780": { 2023-10-06T04:40:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 1024, 2023-10-06T04:40:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-06T04:40:31.362 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-06T04:40:31.362 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.362 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-06T04:40:31.362 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.362 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.362 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2023-10-06T04:40:31.362 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-06T04:40:31.362 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.362 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.362 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.362 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.363 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_ops-0x5616edc46a00": { 2023-10-06T04:40:31.363 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.363 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 1024, 2023-10-06T04:40:31.363 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.363 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 2, 2023-10-06T04:40:31.363 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 2, 2023-10-06T04:40:31.363 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.363 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 2, 2023-10-06T04:40:31.363 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.363 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.363 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2, 2023-10-06T04:40:31.364 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 2, 2023-10-06T04:40:31.364 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.364 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.364 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.364 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.364 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.364 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_ops-0x5616edd160a0": { 2023-10-06T04:40:31.364 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.364 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 1024, 2023-10-06T04:40:31.364 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.365 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-06T04:40:31.365 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-06T04:40:31.365 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.365 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-06T04:40:31.365 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.365 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.365 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2023-10-06T04:40:31.365 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-06T04:40:31.365 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.365 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.365 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.365 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.366 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.366 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_ops-0x5616edd16320": { 2023-10-06T04:40:31.366 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.366 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 1024, 2023-10-06T04:40:31.366 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.366 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-06T04:40:31.366 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-06T04:40:31.366 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.366 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-06T04:40:31.366 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 3, 2023-10-06T04:40:31.366 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 3, 2023-10-06T04:40:31.367 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 3, 2023-10-06T04:40:31.367 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 3, 2023-10-06T04:40:31.367 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.367 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.367 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.367 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.367 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-10-06T04:40:31.367 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_ops-0x5616edd17220": { 2023-10-06T04:40:31.367 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2023-10-06T04:40:31.367 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 1024, 2023-10-06T04:40:31.367 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2023-10-06T04:40:31.368 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2023-10-06T04:40:31.368 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2023-10-06T04:40:31.368 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2023-10-06T04:40:31.368 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2023-10-06T04:40:31.368 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2023-10-06T04:40:31.368 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2023-10-06T04:40:31.368 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2023-10-06T04:40:31.368 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2023-10-06T04:40:31.368 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2023-10-06T04:40:31.368 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2023-10-06T04:40:31.368 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2023-10-06T04:40:31.368 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2023-10-06T04:40:31.369 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.369 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-10-06T04:40:31.369 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-10-06T04:40:31.371 INFO:tasks.check_counter:Daemon mgr.y finisher-volumes.complete_latency.avgcount=9 2023-10-06T04:40:31.371 INFO:tasks.check_counter:Daemon mgr.y finisher-volumes.queue_len=0 2023-10-06T04:40:31.371 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-06T04:40:31.380 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-06T04:40:31.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:31.380 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-10-06T04:40:31.395 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T04:40:31.396 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:40:31.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:31.396 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:40:31.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:31.467 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:40:31.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:31.540 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2023-10-06T04:40:31.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:31.646 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-10-06T04:40:31.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:31.661 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2023-10-06T04:40:31.728 INFO:teuthology.orchestra.run.smithi112.stderr:Cannot find device "ceph-brx" 2023-10-06T04:40:31.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:40:31.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:31.730 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-10-06T04:40:31.748 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T04:40:31.748 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T04:40:31.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:31.749 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T04:40:31.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:31.826 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:40:31.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:31.904 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2023-10-06T04:40:32.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:32.005 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-10-06T04:40:32.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:40:32.020 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2023-10-06T04:40:32.088 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2023-10-06T04:40:32.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:40:32.089 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T04:40:32.098 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T04:40:32.099 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:32.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.212+0000 7f5d52c7b700 1 Processor -- start 2023-10-06T04:40:32.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.212+0000 7f5d52c7b700 1 -- start start 2023-10-06T04:40:32.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.213+0000 7f5d52c7b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5d4c156440 0x7f5d4c0ad620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:32.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.213+0000 7f5d52c7b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d4c0adb60 0x7f5d4c06a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:32.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.213+0000 7f5d52c7b700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4c0adfd0 con 0x7f5d4c06aad0 2023-10-06T04:40:32.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.213+0000 7f5d52c7b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d4c0c9870 con 0x7f5d4c156440 2023-10-06T04:40:32.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.213+0000 7f5d52c7b700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c06b2b0 con 0x7f5d4c0adb60 2023-10-06T04:40:32.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.213+0000 7f5d50a17700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5d4c156440 0x7f5d4c0ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:32.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.213+0000 7f5d50a17700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5d4c156440 0x7f5d4c0ad620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54668/0 (socket says 172.21.15.112:54668) 2023-10-06T04:40:32.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.213+0000 7f5d50a17700 1 -- 172.21.15.112:0/2721203975 learned_addr learned my addr 172.21.15.112:0/2721203975 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:32.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.213+0000 7f5d50a17700 1 -- 172.21.15.112:0/2721203975 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d4c0adb60 msgr2=0x7f5d4c06a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:32.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.213+0000 7f5d50a17700 1 --2- 172.21.15.112:0/2721203975 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d4c0adb60 0x7f5d4c06a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.213+0000 7f5d50a17700 1 -- 172.21.15.112:0/2721203975 >> v1:172.21.15.179:6789/0 conn(0x7f5d4c06aad0 legacy=0x7f5d4c15a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:32.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.213+0000 7f5d50a17700 1 -- 172.21.15.112:0/2721203975 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c06b590 con 0x7f5d4c156440 2023-10-06T04:40:32.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.213+0000 7f5d50a17700 1 --2- 172.21.15.112:0/2721203975 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d4c156440 0x7f5d4c0ad620 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5d400099b0 tx=0x7f5d40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df115e48de481167 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:32.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.213+0000 7f5d4b7fe700 1 -- 172.21.15.112:0/2721203975 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4000b820 con 0x7f5d4c156440 2023-10-06T04:40:32.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.213+0000 7f5d4b7fe700 1 -- 172.21.15.112:0/2721203975 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4000b980 con 0x7f5d4c156440 2023-10-06T04:40:32.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.214+0000 7f5d4b7fe700 1 -- 172.21.15.112:0/2721203975 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4000bd20 con 0x7f5d4c156440 2023-10-06T04:40:32.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.214+0000 7f5d52c7b700 1 -- 172.21.15.112:0/2721203975 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d4c156440 msgr2=0x7f5d4c0ad620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:32.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.214+0000 7f5d52c7b700 1 --2- 172.21.15.112:0/2721203975 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d4c156440 0x7f5d4c0ad620 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5d400099b0 tx=0x7f5d40009250 comp rx=0 tx=0).stop 2023-10-06T04:40:32.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.214+0000 7f5d52c7b700 1 -- 172.21.15.112:0/2721203975 shutdown_connections 2023-10-06T04:40:32.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.214+0000 7f5d52c7b700 1 --2- 172.21.15.112:0/2721203975 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d4c156440 0x7f5d4c0ad620 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.214+0000 7f5d52c7b700 1 --2- 172.21.15.112:0/2721203975 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d4c0adb60 0x7f5d4c06a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.214+0000 7f5d52c7b700 1 -- 172.21.15.112:0/2721203975 >> 172.21.15.112:0/2721203975 conn(0x7f5d4c06d230 msgr2=0x7f5d4c0af580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:32.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.214+0000 7f5d52c7b700 1 -- 172.21.15.112:0/2721203975 shutdown_connections 2023-10-06T04:40:32.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.214+0000 7f5d52c7b700 1 -- 172.21.15.112:0/2721203975 wait complete. 2023-10-06T04:40:32.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.215+0000 7f5d52c7b700 1 Processor -- start 2023-10-06T04:40:32.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.216+0000 7f5d52c7b700 1 -- start start 2023-10-06T04:40:32.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.216+0000 7f5d52c7b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d4c06aad0 0x7f5d4c168f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:32.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.216+0000 7f5d52c7b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d4c0adb60 0x7f5d4c1687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:32.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.216+0000 7f5d52c7b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d4c156440 0x7f5d4c16aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:32.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.216+0000 7f5d52c7b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c168d10 con 0x7f5d4c156440 2023-10-06T04:40:32.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.216+0000 7f5d52c7b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c0c17b0 con 0x7f5d4c0adb60 2023-10-06T04:40:32.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.216+0000 7f5d52c7b700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c0c1a90 con 0x7f5d4c06aad0 2023-10-06T04:40:32.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.216+0000 7f5d51218700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d4c156440 0x7f5d4c16aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:32.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.216+0000 7f5d51218700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d4c156440 0x7f5d4c16aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54680/0 (socket says 172.21.15.112:54680) 2023-10-06T04:40:32.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.216+0000 7f5d51218700 1 -- 172.21.15.112:0/1668744055 learned_addr learned my addr 172.21.15.112:0/1668744055 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.217+0000 7f5d50a17700 1 --2- 172.21.15.112:0/1668744055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d4c06aad0 0x7f5d4c168f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.217+0000 7f5d4bfff700 1 --2- 172.21.15.112:0/1668744055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d4c0adb60 0x7f5d4c1687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.217+0000 7f5d51218700 1 -- 172.21.15.112:0/1668744055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d4c06aad0 msgr2=0x7f5d4c168f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.217+0000 7f5d51218700 1 --2- 172.21.15.112:0/1668744055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d4c06aad0 0x7f5d4c168f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.217+0000 7f5d51218700 1 -- 172.21.15.112:0/1668744055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d4c0adb60 msgr2=0x7f5d4c1687d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.217+0000 7f5d51218700 1 --2- 172.21.15.112:0/1668744055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d4c0adb60 0x7f5d4c1687d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.217+0000 7f5d51218700 1 -- 172.21.15.112:0/1668744055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d400094f0 con 0x7f5d4c156440 2023-10-06T04:40:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.217+0000 7f5d51218700 1 --2- 172.21.15.112:0/1668744055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d4c156440 0x7f5d4c16aab0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400bbb0 tx=0x7f5d44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.217+0000 7f5d48ff9700 1 -- 172.21.15.112:0/1668744055 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d440092e0 con 0x7f5d4c156440 2023-10-06T04:40:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.217+0000 7f5d48ff9700 1 -- 172.21.15.112:0/1668744055 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4400c7a0 con 0x7f5d4c156440 2023-10-06T04:40:32.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.217+0000 7f5d52c7b700 1 -- 172.21.15.112:0/1668744055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4c0c1d70 con 0x7f5d4c156440 2023-10-06T04:40:32.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.217+0000 7f5d48ff9700 1 -- 172.21.15.112:0/1668744055 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4400cb40 con 0x7f5d4c156440 2023-10-06T04:40:32.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.217+0000 7f5d52c7b700 1 -- 172.21.15.112:0/1668744055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4c0c2330 con 0x7f5d4c156440 2023-10-06T04:40:32.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.218+0000 7f5d52c7b700 1 -- 172.21.15.112:0/1668744055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d4c05f230 con 0x7f5d4c156440 2023-10-06T04:40:32.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.218+0000 7f5d48ff9700 1 -- 172.21.15.112:0/1668744055 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f5d44012070 con 0x7f5d4c156440 2023-10-06T04:40:32.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.219+0000 7f5d48ff9700 1 --2- 172.21.15.112:0/1668744055 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5d30067110 0x7f5d300695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:32.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.219+0000 7f5d48ff9700 1 -- 172.21.15.112:0/1668744055 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f5d44084400 con 0x7f5d4c156440 2023-10-06T04:40:32.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.219+0000 7f5d50a17700 1 --2- 172.21.15.112:0/1668744055 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5d30067110 0x7f5d300695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:32.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.219+0000 7f5d50a17700 1 --2- 172.21.15.112:0/1668744055 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5d30067110 0x7f5d300695c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5d400099b0 tx=0x7f5d40016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:32.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.223+0000 7f5d48ff9700 1 -- 172.21.15.112:0/1668744055 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d440514f0 con 0x7f5d4c156440 2023-10-06T04:40:32.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.406+0000 7f5d52c7b700 1 -- 172.21.15.112:0/1668744055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d4c06b870 con 0x7f5d4c156440 2023-10-06T04:40:32.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.407+0000 7f5d48ff9700 1 -- 172.21.15.112:0/1668744055 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13829 (secure 0 0 0) 0x7f5d44054b10 con 0x7f5d4c156440 2023-10-06T04:40:32.409 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:32.409 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":34,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:40:27.576548+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6834/1886371745":"2023-10-07T04:40:24.312231+0000","172.21.15.179:6832/1886371745":"2023-10-07T04:40:24.312231+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:32.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.409+0000 7f5d52c7b700 1 -- 172.21.15.112:0/1668744055 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5d30067110 msgr2=0x7f5d300695c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:32.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.409+0000 7f5d52c7b700 1 --2- 172.21.15.112:0/1668744055 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5d30067110 0x7f5d300695c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5d400099b0 tx=0x7f5d40016000 comp rx=0 tx=0).stop 2023-10-06T04:40:32.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.409+0000 7f5d52c7b700 1 -- 172.21.15.112:0/1668744055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d4c156440 msgr2=0x7f5d4c16aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:32.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.409+0000 7f5d52c7b700 1 --2- 172.21.15.112:0/1668744055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d4c156440 0x7f5d4c16aab0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400bbb0 tx=0x7f5d44009840 comp rx=0 tx=0).stop 2023-10-06T04:40:32.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.409+0000 7f5d52c7b700 1 -- 172.21.15.112:0/1668744055 shutdown_connections 2023-10-06T04:40:32.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.409+0000 7f5d52c7b700 1 --2- 172.21.15.112:0/1668744055 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f5d30067110 0x7f5d300695c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.409+0000 7f5d52c7b700 1 --2- 172.21.15.112:0/1668744055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d4c156440 0x7f5d4c16aab0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.409+0000 7f5d52c7b700 1 --2- 172.21.15.112:0/1668744055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d4c06aad0 0x7f5d4c168f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.409+0000 7f5d52c7b700 1 --2- 172.21.15.112:0/1668744055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d4c0adb60 0x7f5d4c1687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.409+0000 7f5d52c7b700 1 -- 172.21.15.112:0/1668744055 >> 172.21.15.112:0/1668744055 conn(0x7f5d4c06d230 msgr2=0x7f5d4c14fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:32.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.409+0000 7f5d52c7b700 1 -- 172.21.15.112:0/1668744055 shutdown_connections 2023-10-06T04:40:32.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.409+0000 7f5d52c7b700 1 -- 172.21.15.112:0/1668744055 wait complete. 2023-10-06T04:40:32.423 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T04:40:32.424 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:40:32.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.535+0000 7f88c5eed700 1 Processor -- start 2023-10-06T04:40:32.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.535+0000 7f88c5eed700 1 -- start start 2023-10-06T04:40:32.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.536+0000 7f88c5eed700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88c00b11a0 0x7f88c00d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:32.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.536+0000 7f88c5eed700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f88c00b3810 0x7f88c00b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:32.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.536+0000 7f88c5eed700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c00afed0 con 0x7f88c006d3b0 2023-10-06T04:40:32.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.536+0000 7f88c5eed700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c00b6170 con 0x7f88c00b3810 2023-10-06T04:40:32.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.536+0000 7f88c5eed700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c00b6450 con 0x7f88c00b11a0 2023-10-06T04:40:32.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.536+0000 7f88c56ec700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f88c00b3810 0x7f88c00b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:32.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.536+0000 7f88c56ec700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f88c00b3810 0x7f88c00b3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54696/0 (socket says 172.21.15.112:54696) 2023-10-06T04:40:32.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.536+0000 7f88c56ec700 1 -- 172.21.15.112:0/2462477597 learned_addr learned my addr 172.21.15.112:0/2462477597 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:32.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.536+0000 7f88c4eeb700 1 --2- 172.21.15.112:0/2462477597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88c00b11a0 0x7f88c00d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:32.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.536+0000 7f88c56ec700 1 -- 172.21.15.112:0/2462477597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88c00b11a0 msgr2=0x7f88c00d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:32.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.536+0000 7f88c56ec700 1 --2- 172.21.15.112:0/2462477597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88c00b11a0 0x7f88c00d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.536+0000 7f88c56ec700 1 -- 172.21.15.112:0/2462477597 >> v1:172.21.15.179:6789/0 conn(0x7f88c006d3b0 legacy=0x7f88c00b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:32.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.536+0000 7f88c56ec700 1 -- 172.21.15.112:0/2462477597 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c00b6730 con 0x7f88c00b3810 2023-10-06T04:40:32.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.536+0000 7f88c4eeb700 1 --2- 172.21.15.112:0/2462477597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88c00b11a0 0x7f88c00d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:32.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.536+0000 7f88c56ec700 1 --2- 172.21.15.112:0/2462477597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c00b3810 0x7f88c00b3cb0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f88a80099b0 tx=0x7f88a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbbd07f07fc4808 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:32.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.537+0000 7f88bf7fe700 1 -- 172.21.15.112:0/2462477597 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a800b860 con 0x7f88c00b3810 2023-10-06T04:40:32.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.537+0000 7f88bf7fe700 1 -- 172.21.15.112:0/2462477597 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a800b9c0 con 0x7f88c00b3810 2023-10-06T04:40:32.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.537+0000 7f88bf7fe700 1 -- 172.21.15.112:0/2462477597 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a800bd60 con 0x7f88c00b3810 2023-10-06T04:40:32.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.537+0000 7f88c5eed700 1 -- 172.21.15.112:0/2462477597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c00b3810 msgr2=0x7f88c00b3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:32.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.537+0000 7f88c5eed700 1 --2- 172.21.15.112:0/2462477597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c00b3810 0x7f88c00b3cb0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f88a80099b0 tx=0x7f88a8009250 comp rx=0 tx=0).stop 2023-10-06T04:40:32.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.537+0000 7f88c5eed700 1 -- 172.21.15.112:0/2462477597 shutdown_connections 2023-10-06T04:40:32.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.537+0000 7f88c5eed700 1 --2- 172.21.15.112:0/2462477597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c00b3810 0x7f88c00b3cb0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.537+0000 7f88c5eed700 1 --2- 172.21.15.112:0/2462477597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88c00b11a0 0x7f88c00d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.537+0000 7f88c5eed700 1 -- 172.21.15.112:0/2462477597 >> 172.21.15.112:0/2462477597 conn(0x7f88c006cfb0 msgr2=0x7f88c00d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:32.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.537+0000 7f88c5eed700 1 -- 172.21.15.112:0/2462477597 shutdown_connections 2023-10-06T04:40:32.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.537+0000 7f88c5eed700 1 -- 172.21.15.112:0/2462477597 wait complete. 2023-10-06T04:40:32.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.538+0000 7f88c5eed700 1 Processor -- start 2023-10-06T04:40:32.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.538+0000 7f88c5eed700 1 -- start start 2023-10-06T04:40:32.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.539+0000 7f88c5eed700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88c006d3b0 0x7f88c01599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:32.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.539+0000 7f88c5eed700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88c00b11a0 0x7f88c0156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:32.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.540+0000 7f88c5eed700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c00b3810 0x7f88c015a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:32.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.540+0000 7f88c5eed700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c015a200 con 0x7f88c00b3810 2023-10-06T04:40:32.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.540+0000 7f88c5eed700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c009e090 con 0x7f88c006d3b0 2023-10-06T04:40:32.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.540+0000 7f88c5eed700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c009d520 con 0x7f88c00b11a0 2023-10-06T04:40:32.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.540+0000 7f88c56ec700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c00b3810 0x7f88c015a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:32.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.540+0000 7f88c56ec700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c00b3810 0x7f88c015a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54698/0 (socket says 172.21.15.112:54698) 2023-10-06T04:40:32.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.540+0000 7f88c56ec700 1 -- 172.21.15.112:0/3843993436 learned_addr learned my addr 172.21.15.112:0/3843993436 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:32.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.540+0000 7f88c4eeb700 1 --2- 172.21.15.112:0/3843993436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88c006d3b0 0x7f88c01599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:32.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.540+0000 7f88bffff700 1 --2- 172.21.15.112:0/3843993436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88c00b11a0 0x7f88c0156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:32.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.540+0000 7f88c56ec700 1 -- 172.21.15.112:0/3843993436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88c00b11a0 msgr2=0x7f88c0156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:32.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.540+0000 7f88c56ec700 1 --2- 172.21.15.112:0/3843993436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88c00b11a0 0x7f88c0156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.540+0000 7f88c56ec700 1 -- 172.21.15.112:0/3843993436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88c006d3b0 msgr2=0x7f88c01599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:32.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.540+0000 7f88c56ec700 1 --2- 172.21.15.112:0/3843993436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88c006d3b0 0x7f88c01599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.540+0000 7f88c56ec700 1 -- 172.21.15.112:0/3843993436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a80094f0 con 0x7f88c00b3810 2023-10-06T04:40:32.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.540+0000 7f88c56ec700 1 --2- 172.21.15.112:0/3843993436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c00b3810 0x7f88c015a590 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f88c0064200 tx=0x7f88a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:32.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.540+0000 7f88bcff9700 1 -- 172.21.15.112:0/3843993436 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a800b860 con 0x7f88c00b3810 2023-10-06T04:40:32.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.540+0000 7f88bcff9700 1 -- 172.21.15.112:0/3843993436 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a801a630 con 0x7f88c00b3810 2023-10-06T04:40:32.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.540+0000 7f88c5eed700 1 -- 172.21.15.112:0/3843993436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c009d7a0 con 0x7f88c00b3810 2023-10-06T04:40:32.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.540+0000 7f88bcff9700 1 -- 172.21.15.112:0/3843993436 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a801a9f0 con 0x7f88c00b3810 2023-10-06T04:40:32.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.540+0000 7f88c5eed700 1 -- 172.21.15.112:0/3843993436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c009dac0 con 0x7f88c00b3810 2023-10-06T04:40:32.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.541+0000 7f88c5eed700 1 -- 172.21.15.112:0/3843993436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c009e200 con 0x7f88c00b3810 2023-10-06T04:40:32.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.542+0000 7f88bcff9700 1 -- 172.21.15.112:0/3843993436 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f88a80253f0 con 0x7f88c00b3810 2023-10-06T04:40:32.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.542+0000 7f88bcff9700 1 --2- 172.21.15.112:0/3843993436 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f88a00670e0 0x7f88a0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:32.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.542+0000 7f88bcff9700 1 -- 172.21.15.112:0/3843993436 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f88a8086210 con 0x7f88c00b3810 2023-10-06T04:40:32.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.542+0000 7f88c4eeb700 1 --2- 172.21.15.112:0/3843993436 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f88a00670e0 0x7f88a0069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:32.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.542+0000 7f88c4eeb700 1 --2- 172.21.15.112:0/3843993436 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f88a00670e0 0x7f88a0069590 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f88b8006f00 tx=0x7f88b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:32.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.547+0000 7f88bcff9700 1 -- 172.21.15.112:0/3843993436 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88a80533a0 con 0x7f88c00b3810 2023-10-06T04:40:32.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.728+0000 7f88c5eed700 1 -- 172.21.15.112:0/3843993436 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88c005f230 con 0x7f88a00670e0 2023-10-06T04:40:32.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.731+0000 7f88bcff9700 1 -- 172.21.15.112:0/3843993436 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73396 (secure 0 0 0) 0x7f88c005f230 con 0x7f88a00670e0 2023-10-06T04:40:32.734 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:32.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.733+0000 7f88c5eed700 1 -- 172.21.15.112:0/3843993436 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f88a00670e0 msgr2=0x7f88a0069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:32.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.733+0000 7f88c5eed700 1 --2- 172.21.15.112:0/3843993436 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f88a00670e0 0x7f88a0069590 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f88b8006f00 tx=0x7f88b8008040 comp rx=0 tx=0).stop 2023-10-06T04:40:32.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.733+0000 7f88c5eed700 1 -- 172.21.15.112:0/3843993436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c00b3810 msgr2=0x7f88c015a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:32.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.733+0000 7f88c5eed700 1 --2- 172.21.15.112:0/3843993436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c00b3810 0x7f88c015a590 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f88c0064200 tx=0x7f88a8017000 comp rx=0 tx=0).stop 2023-10-06T04:40:32.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.733+0000 7f88c5eed700 1 -- 172.21.15.112:0/3843993436 shutdown_connections 2023-10-06T04:40:32.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.733+0000 7f88c5eed700 1 --2- 172.21.15.112:0/3843993436 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f88a00670e0 0x7f88a0069590 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.733+0000 7f88c5eed700 1 --2- 172.21.15.112:0/3843993436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c00b3810 0x7f88c015a590 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.733+0000 7f88c5eed700 1 --2- 172.21.15.112:0/3843993436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88c006d3b0 0x7f88c01599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.733+0000 7f88c5eed700 1 --2- 172.21.15.112:0/3843993436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88c00b11a0 0x7f88c0156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.733+0000 7f88c5eed700 1 -- 172.21.15.112:0/3843993436 >> 172.21.15.112:0/3843993436 conn(0x7f88c006cfb0 msgr2=0x7f88c006e150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:32.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.733+0000 7f88c5eed700 1 -- 172.21.15.112:0/3843993436 shutdown_connections 2023-10-06T04:40:32.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.733+0000 7f88c5eed700 1 -- 172.21.15.112:0/3843993436 wait complete. 2023-10-06T04:40:32.737 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-10-06T04:40:32.747 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-10-06T04:40:32.292187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382516,"kb_used_data":4212,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592204,"statfs":{"total":773094113280,"available":770654416896,"internally_reserved":0,"allocated":4313088,"data_stored":2451933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-132759,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-3,"num_read_kb":-3,"num_write":-93,"num_write_kb":-162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.975676"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.579743+0000","last_change":"2023-10-06T04:39:16.067723+0000","last_active":"2023-10-06T04:40:26.579743+0000","last_peered":"2023-10-06T04:40:26.579743+0000","last_clean":"2023-10-06T04:40:26.579743+0000","last_became_active":"2023-10-06T04:39:16.067325+0000","last_became_peered":"2023-10-06T04:39:16.067325+0000","last_unstale":"2023-10-06T04:40:26.579743+0000","last_undegraded":"2023-10-06T04:40:26.579743+0000","last_fullsized":"2023-10-06T04:40:26.579743+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.888084+0000","last_change":"2023-10-06T04:39:15.592391+0000","last_active":"2023-10-06T04:40:26.888084+0000","last_peered":"2023-10-06T04:40:26.888084+0000","last_clean":"2023-10-06T04:40:26.888084+0000","last_became_active":"2023-10-06T04:39:15.592094+0000","last_became_peered":"2023-10-06T04:39:15.592094+0000","last_unstale":"2023-10-06T04:40:26.888084+0000","last_undegraded":"2023-10-06T04:40:26.888084+0000","last_fullsized":"2023-10-06T04:40:26.888084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.280766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.887209+0000","last_change":"2023-10-06T04:39:15.585112+0000","last_active":"2023-10-06T04:40:26.887209+0000","last_peered":"2023-10-06T04:40:26.887209+0000","last_clean":"2023-10-06T04:40:26.887209+0000","last_became_active":"2023-10-06T04:39:15.584853+0000","last_became_peered":"2023-10-06T04:39:15.584853+0000","last_unstale":"2023-10-06T04:40:26.887209+0000","last_undegraded":"2023-10-06T04:40:26.887209+0000","last_fullsized":"2023-10-06T04:40:26.887209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.888595+0000","last_change":"2023-10-06T04:39:15.588017+0000","last_active":"2023-10-06T04:40:26.888595+0000","last_peered":"2023-10-06T04:40:26.888595+0000","last_clean":"2023-10-06T04:40:26.888595+0000","last_became_active":"2023-10-06T04:39:15.586771+0000","last_became_peered":"2023-10-06T04:39:15.586771+0000","last_unstale":"2023-10-06T04:40:26.888595+0000","last_undegraded":"2023-10-06T04:40:26.888595+0000","last_fullsized":"2023-10-06T04:40:26.888595+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:35.225282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.888672+0000","last_change":"2023-10-06T04:39:16.252521+0000","last_active":"2023-10-06T04:40:26.888672+0000","last_peered":"2023-10-06T04:40:26.888672+0000","last_clean":"2023-10-06T04:40:26.888672+0000","last_became_active":"2023-10-06T04:39:16.252245+0000","last_became_peered":"2023-10-06T04:39:16.252245+0000","last_unstale":"2023-10-06T04:40:26.888672+0000","last_undegraded":"2023-10-06T04:40:26.888672+0000","last_fullsized":"2023-10-06T04:40:26.888672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:17.694713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.888541+0000","last_change":"2023-10-06T04:39:16.252493+0000","last_active":"2023-10-06T04:40:26.888541+0000","last_peered":"2023-10-06T04:40:26.888541+0000","last_clean":"2023-10-06T04:40:26.888541+0000","last_became_active":"2023-10-06T04:39:16.252190+0000","last_became_peered":"2023-10-06T04:39:16.252190+0000","last_unstale":"2023-10-06T04:40:26.888541+0000","last_undegraded":"2023-10-06T04:40:26.888541+0000","last_fullsized":"2023-10-06T04:40:26.888541+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:59.554724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.889435+0000","last_change":"2023-10-06T04:39:16.252554+0000","last_active":"2023-10-06T04:40:26.889435+0000","last_peered":"2023-10-06T04:40:26.889435+0000","last_clean":"2023-10-06T04:40:26.889435+0000","last_became_active":"2023-10-06T04:39:16.252225+0000","last_became_peered":"2023-10-06T04:39:16.252225+0000","last_unstale":"2023-10-06T04:40:26.889435+0000","last_undegraded":"2023-10-06T04:40:26.889435+0000","last_fullsized":"2023-10-06T04:40:26.889435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.280766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.889301+0000","last_change":"2023-10-06T04:39:16.253021+0000","last_active":"2023-10-06T04:40:26.889301+0000","last_peered":"2023-10-06T04:40:26.889301+0000","last_clean":"2023-10-06T04:40:26.889301+0000","last_became_active":"2023-10-06T04:39:16.252478+0000","last_became_peered":"2023-10-06T04:39:16.252478+0000","last_unstale":"2023-10-06T04:40:26.889301+0000","last_undegraded":"2023-10-06T04:40:26.889301+0000","last_fullsized":"2023-10-06T04:40:26.889301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:07.439434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.889151+0000","last_change":"2023-10-06T04:39:15.587681+0000","last_active":"2023-10-06T04:40:26.889151+0000","last_peered":"2023-10-06T04:40:26.889151+0000","last_clean":"2023-10-06T04:40:26.889151+0000","last_became_active":"2023-10-06T04:39:15.587313+0000","last_became_peered":"2023-10-06T04:39:15.587313+0000","last_unstale":"2023-10-06T04:40:26.889151+0000","last_undegraded":"2023-10-06T04:40:26.889151+0000","last_fullsized":"2023-10-06T04:40:26.889151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298252,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073588,"statfs":{"total":96636764160,"available":96331354112,"internally_reserved":0,"allocated":987136,"data_stored":750175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.53400000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.51300000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.59799999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":0.55300000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":0.628}]},{"osd":6,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.4209999999999998,"5min":2.4209999999999998,"15min":2.4209999999999998},"last":0.58699999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":8.1910000000000007,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":0.67300000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.7910000000000004,"5min":7.7910000000000004,"15min":7.7910000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.621,"5min":2.621,"15min":2.621},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.851,"5min":2.851,"15min":2.851},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.9569999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":0.629},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.45500000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.439},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.59899999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.503},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.65400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298252,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073588,"statfs":{"total":96636764160,"available":96331354112,"internally_reserved":0,"allocated":987136,"data_stored":750175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"last":0.33800000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"last":0.307},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"last":0.315}]},{"osd":3,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.374}]},{"osd":4,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.51900000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.63},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.52900000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.54900000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.69299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":153901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"last":0.378},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.35499999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.29299999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.32400000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.746}]},{"osd":5,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.77100000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.80700000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.315}]},{"osd":1,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.36199999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.376},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.30399999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.623},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.66300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.35199999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.373}]},{"osd":2,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.317},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.42799999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":1.153},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":1.1259999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":1.0649999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":1.044},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.54100000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":1.093}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.80500000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.377},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.57299999999999995}]},{"osd":2,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.65300000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.54100000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.755}]},{"osd":7,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.69699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":158454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.70399999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.718,"5min":4.718,"15min":4.718},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.747},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.498},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.54700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:40:32.750 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:40:32.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.862+0000 7fd65c674700 1 Processor -- start 2023-10-06T04:40:32.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.862+0000 7fd65c674700 1 -- start start 2023-10-06T04:40:32.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.863+0000 7fd65c674700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd654159d50 0x7fd6540b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:32.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.863+0000 7fd65c674700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6540b0e70 0x7fd6540b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:32.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.863+0000 7fd65c674700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6540b1810 con 0x7fd65415a120 2023-10-06T04:40:32.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.863+0000 7fd65c674700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6540cd740 con 0x7fd654159d50 2023-10-06T04:40:32.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.863+0000 7fd65c674700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6540ccb30 con 0x7fd6540b0e70 2023-10-06T04:40:32.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.863+0000 7fd65a410700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd654159d50 0x7fd6540b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:32.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.863+0000 7fd65a410700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd654159d50 0x7fd6540b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54710/0 (socket says 172.21.15.112:54710) 2023-10-06T04:40:32.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.863+0000 7fd65a410700 1 -- 172.21.15.112:0/525912936 learned_addr learned my addr 172.21.15.112:0/525912936 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:32.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.863+0000 7fd65ac11700 1 --2- 172.21.15.112:0/525912936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6540b0e70 0x7fd6540b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:32.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.864+0000 7fd65a410700 1 -- 172.21.15.112:0/525912936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6540b0e70 msgr2=0x7fd6540b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:32.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.864+0000 7fd65a410700 1 --2- 172.21.15.112:0/525912936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6540b0e70 0x7fd6540b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.864+0000 7fd65a410700 1 -- 172.21.15.112:0/525912936 >> v1:172.21.15.179:6789/0 conn(0x7fd65415a120 legacy=0x7fd6540cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:32.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.864+0000 7fd65a410700 1 -- 172.21.15.112:0/525912936 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6540cce10 con 0x7fd654159d50 2023-10-06T04:40:32.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.864+0000 7fd65a410700 1 --2- 172.21.15.112:0/525912936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd654159d50 0x7fd6540b3040 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd6440099b0 tx=0x7fd644009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4a01b7604628bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:32.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.864+0000 7fd65940e700 1 -- 172.21.15.112:0/525912936 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644009ea0 con 0x7fd654159d50 2023-10-06T04:40:32.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.864+0000 7fd65940e700 1 -- 172.21.15.112:0/525912936 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64400b860 con 0x7fd654159d50 2023-10-06T04:40:32.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.864+0000 7fd65940e700 1 -- 172.21.15.112:0/525912936 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64400bc00 con 0x7fd654159d50 2023-10-06T04:40:32.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.864+0000 7fd65c674700 1 -- 172.21.15.112:0/525912936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd654159d50 msgr2=0x7fd6540b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:32.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.864+0000 7fd65c674700 1 --2- 172.21.15.112:0/525912936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd654159d50 0x7fd6540b3040 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd6440099b0 tx=0x7fd644009250 comp rx=0 tx=0).stop 2023-10-06T04:40:32.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.865+0000 7fd65c674700 1 -- 172.21.15.112:0/525912936 shutdown_connections 2023-10-06T04:40:32.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.865+0000 7fd65c674700 1 --2- 172.21.15.112:0/525912936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6540b0e70 0x7fd6540b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.865+0000 7fd65c674700 1 --2- 172.21.15.112:0/525912936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd654159d50 0x7fd6540b3040 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.865+0000 7fd65c674700 1 -- 172.21.15.112:0/525912936 >> 172.21.15.112:0/525912936 conn(0x7fd654099b60 msgr2=0x7fd65406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:32.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.865+0000 7fd65c674700 1 -- 172.21.15.112:0/525912936 shutdown_connections 2023-10-06T04:40:32.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.865+0000 7fd65c674700 1 -- 172.21.15.112:0/525912936 wait complete. 2023-10-06T04:40:32.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.866+0000 7fd65c674700 1 Processor -- start 2023-10-06T04:40:32.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.866+0000 7fd65c674700 1 -- start start 2023-10-06T04:40:32.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.866+0000 7fd65c674700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6540b0e70 0x7fd654154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:32.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.866+0000 7fd65c674700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd654159d50 0x7fd6540a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:32.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.866+0000 7fd65c674700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd65415a120 0x7fd65409da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:32.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.866+0000 7fd65c674700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd654154940 con 0x7fd65415a120 2023-10-06T04:40:32.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.866+0000 7fd65c674700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6540a0d10 con 0x7fd6540b0e70 2023-10-06T04:40:32.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.866+0000 7fd65c674700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6540a16e0 con 0x7fd654159d50 2023-10-06T04:40:32.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.867+0000 7fd65ac11700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd65415a120 0x7fd65409da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:32.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.867+0000 7fd65ac11700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd65415a120 0x7fd65409da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54718/0 (socket says 172.21.15.112:54718) 2023-10-06T04:40:32.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.867+0000 7fd65ac11700 1 -- 172.21.15.112:0/1497248305 learned_addr learned my addr 172.21.15.112:0/1497248305 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:32.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.867+0000 7fd65a410700 1 --2- 172.21.15.112:0/1497248305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6540b0e70 0x7fd654154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:32.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.867+0000 7fd659c0f700 1 --2- 172.21.15.112:0/1497248305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd654159d50 0x7fd6540a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:32.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.867+0000 7fd65ac11700 1 -- 172.21.15.112:0/1497248305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd654159d50 msgr2=0x7fd6540a11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:32.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.867+0000 7fd65ac11700 1 --2- 172.21.15.112:0/1497248305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd654159d50 0x7fd6540a11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.867+0000 7fd65ac11700 1 -- 172.21.15.112:0/1497248305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6540b0e70 msgr2=0x7fd654154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:32.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.867+0000 7fd65ac11700 1 --2- 172.21.15.112:0/1497248305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6540b0e70 0x7fd654154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:32.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.867+0000 7fd65ac11700 1 -- 172.21.15.112:0/1497248305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6440094f0 con 0x7fd65415a120 2023-10-06T04:40:32.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.867+0000 7fd65ac11700 1 --2- 172.21.15.112:0/1497248305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd65415a120 0x7fd65409da10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009df0 tx=0x7fd64c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:32.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.867+0000 7fd64a7fc700 1 -- 172.21.15.112:0/1497248305 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c00caa0 con 0x7fd65415a120 2023-10-06T04:40:32.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.867+0000 7fd64a7fc700 1 -- 172.21.15.112:0/1497248305 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64c00f040 con 0x7fd65415a120 2023-10-06T04:40:32.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.867+0000 7fd65c674700 1 -- 172.21.15.112:0/1497248305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6540a0100 con 0x7fd65415a120 2023-10-06T04:40:32.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.867+0000 7fd64a7fc700 1 -- 172.21.15.112:0/1497248305 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c00ce70 con 0x7fd65415a120 2023-10-06T04:40:32.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.867+0000 7fd65c674700 1 -- 172.21.15.112:0/1497248305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6540a06c0 con 0x7fd65415a120 2023-10-06T04:40:32.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.868+0000 7fd65c674700 1 -- 172.21.15.112:0/1497248305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65405f230 con 0x7fd65415a120 2023-10-06T04:40:32.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.868+0000 7fd64a7fc700 1 -- 172.21.15.112:0/1497248305 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fd64c014690 con 0x7fd65415a120 2023-10-06T04:40:32.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.869+0000 7fd64a7fc700 1 --2- 172.21.15.112:0/1497248305 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd6380670e0 0x7fd638069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:32.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.869+0000 7fd64a7fc700 1 -- 172.21.15.112:0/1497248305 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fd64c085290 con 0x7fd65415a120 2023-10-06T04:40:32.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.869+0000 7fd65a410700 1 --2- 172.21.15.112:0/1497248305 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd6380670e0 0x7fd638069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:32.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.869+0000 7fd65a410700 1 --2- 172.21.15.112:0/1497248305 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd6380670e0 0x7fd638069590 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd6440099b0 tx=0x7fd644017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:32.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:32.873+0000 7fd64a7fc700 1 -- 172.21.15.112:0/1497248305 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd64c055da0 con 0x7fd65415a120 2023-10-06T04:40:33.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.051+0000 7fd65c674700 1 -- 172.21.15.112:0/1497248305 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd6540b0a90 con 0x7fd6380670e0 2023-10-06T04:40:33.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.054+0000 7fd64a7fc700 1 -- 172.21.15.112:0/1497248305 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73396 (secure 0 0 0) 0x7fd6540b0a90 con 0x7fd6380670e0 2023-10-06T04:40:33.057 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:33.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.056+0000 7fd65c674700 1 -- 172.21.15.112:0/1497248305 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd6380670e0 msgr2=0x7fd638069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:33.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.056+0000 7fd65c674700 1 --2- 172.21.15.112:0/1497248305 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd6380670e0 0x7fd638069590 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd6440099b0 tx=0x7fd644017000 comp rx=0 tx=0).stop 2023-10-06T04:40:33.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.056+0000 7fd65c674700 1 -- 172.21.15.112:0/1497248305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd65415a120 msgr2=0x7fd65409da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:33.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.056+0000 7fd65c674700 1 --2- 172.21.15.112:0/1497248305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd65415a120 0x7fd65409da10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009df0 tx=0x7fd64c00b040 comp rx=0 tx=0).stop 2023-10-06T04:40:33.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.056+0000 7fd65c674700 1 -- 172.21.15.112:0/1497248305 shutdown_connections 2023-10-06T04:40:33.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.056+0000 7fd65c674700 1 --2- 172.21.15.112:0/1497248305 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd6380670e0 0x7fd638069590 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.056+0000 7fd65c674700 1 --2- 172.21.15.112:0/1497248305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd65415a120 0x7fd65409da10 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.056+0000 7fd65c674700 1 --2- 172.21.15.112:0/1497248305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6540b0e70 0x7fd654154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.056+0000 7fd65c674700 1 --2- 172.21.15.112:0/1497248305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd654159d50 0x7fd6540a11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.056+0000 7fd65c674700 1 -- 172.21.15.112:0/1497248305 >> 172.21.15.112:0/1497248305 conn(0x7fd654099b60 msgr2=0x7fd65406db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:33.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.056+0000 7fd65c674700 1 -- 172.21.15.112:0/1497248305 shutdown_connections 2023-10-06T04:40:33.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.056+0000 7fd65c674700 1 -- 172.21.15.112:0/1497248305 wait complete. 2023-10-06T04:40:33.060 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-10-06T04:40:33.070 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-10-06T04:40:32.292187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382516,"kb_used_data":4212,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592204,"statfs":{"total":773094113280,"available":770654416896,"internally_reserved":0,"allocated":4313088,"data_stored":2451933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-132759,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-3,"num_read_kb":-3,"num_write":-93,"num_write_kb":-162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.975676"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.579743+0000","last_change":"2023-10-06T04:39:16.067723+0000","last_active":"2023-10-06T04:40:26.579743+0000","last_peered":"2023-10-06T04:40:26.579743+0000","last_clean":"2023-10-06T04:40:26.579743+0000","last_became_active":"2023-10-06T04:39:16.067325+0000","last_became_peered":"2023-10-06T04:39:16.067325+0000","last_unstale":"2023-10-06T04:40:26.579743+0000","last_undegraded":"2023-10-06T04:40:26.579743+0000","last_fullsized":"2023-10-06T04:40:26.579743+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.888084+0000","last_change":"2023-10-06T04:39:15.592391+0000","last_active":"2023-10-06T04:40:26.888084+0000","last_peered":"2023-10-06T04:40:26.888084+0000","last_clean":"2023-10-06T04:40:26.888084+0000","last_became_active":"2023-10-06T04:39:15.592094+0000","last_became_peered":"2023-10-06T04:39:15.592094+0000","last_unstale":"2023-10-06T04:40:26.888084+0000","last_undegraded":"2023-10-06T04:40:26.888084+0000","last_fullsized":"2023-10-06T04:40:26.888084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.280766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.887209+0000","last_change":"2023-10-06T04:39:15.585112+0000","last_active":"2023-10-06T04:40:26.887209+0000","last_peered":"2023-10-06T04:40:26.887209+0000","last_clean":"2023-10-06T04:40:26.887209+0000","last_became_active":"2023-10-06T04:39:15.584853+0000","last_became_peered":"2023-10-06T04:39:15.584853+0000","last_unstale":"2023-10-06T04:40:26.887209+0000","last_undegraded":"2023-10-06T04:40:26.887209+0000","last_fullsized":"2023-10-06T04:40:26.887209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.888595+0000","last_change":"2023-10-06T04:39:15.588017+0000","last_active":"2023-10-06T04:40:26.888595+0000","last_peered":"2023-10-06T04:40:26.888595+0000","last_clean":"2023-10-06T04:40:26.888595+0000","last_became_active":"2023-10-06T04:39:15.586771+0000","last_became_peered":"2023-10-06T04:39:15.586771+0000","last_unstale":"2023-10-06T04:40:26.888595+0000","last_undegraded":"2023-10-06T04:40:26.888595+0000","last_fullsized":"2023-10-06T04:40:26.888595+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:35.225282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.888672+0000","last_change":"2023-10-06T04:39:16.252521+0000","last_active":"2023-10-06T04:40:26.888672+0000","last_peered":"2023-10-06T04:40:26.888672+0000","last_clean":"2023-10-06T04:40:26.888672+0000","last_became_active":"2023-10-06T04:39:16.252245+0000","last_became_peered":"2023-10-06T04:39:16.252245+0000","last_unstale":"2023-10-06T04:40:26.888672+0000","last_undegraded":"2023-10-06T04:40:26.888672+0000","last_fullsized":"2023-10-06T04:40:26.888672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:17.694713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.888541+0000","last_change":"2023-10-06T04:39:16.252493+0000","last_active":"2023-10-06T04:40:26.888541+0000","last_peered":"2023-10-06T04:40:26.888541+0000","last_clean":"2023-10-06T04:40:26.888541+0000","last_became_active":"2023-10-06T04:39:16.252190+0000","last_became_peered":"2023-10-06T04:39:16.252190+0000","last_unstale":"2023-10-06T04:40:26.888541+0000","last_undegraded":"2023-10-06T04:40:26.888541+0000","last_fullsized":"2023-10-06T04:40:26.888541+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:59.554724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.889435+0000","last_change":"2023-10-06T04:39:16.252554+0000","last_active":"2023-10-06T04:40:26.889435+0000","last_peered":"2023-10-06T04:40:26.889435+0000","last_clean":"2023-10-06T04:40:26.889435+0000","last_became_active":"2023-10-06T04:39:16.252225+0000","last_became_peered":"2023-10-06T04:39:16.252225+0000","last_unstale":"2023-10-06T04:40:26.889435+0000","last_undegraded":"2023-10-06T04:40:26.889435+0000","last_fullsized":"2023-10-06T04:40:26.889435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.280766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.889301+0000","last_change":"2023-10-06T04:39:16.253021+0000","last_active":"2023-10-06T04:40:26.889301+0000","last_peered":"2023-10-06T04:40:26.889301+0000","last_clean":"2023-10-06T04:40:26.889301+0000","last_became_active":"2023-10-06T04:39:16.252478+0000","last_became_peered":"2023-10-06T04:39:16.252478+0000","last_unstale":"2023-10-06T04:40:26.889301+0000","last_undegraded":"2023-10-06T04:40:26.889301+0000","last_fullsized":"2023-10-06T04:40:26.889301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:07.439434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.889151+0000","last_change":"2023-10-06T04:39:15.587681+0000","last_active":"2023-10-06T04:40:26.889151+0000","last_peered":"2023-10-06T04:40:26.889151+0000","last_clean":"2023-10-06T04:40:26.889151+0000","last_became_active":"2023-10-06T04:39:15.587313+0000","last_became_peered":"2023-10-06T04:39:15.587313+0000","last_unstale":"2023-10-06T04:40:26.889151+0000","last_undegraded":"2023-10-06T04:40:26.889151+0000","last_fullsized":"2023-10-06T04:40:26.889151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298252,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073588,"statfs":{"total":96636764160,"available":96331354112,"internally_reserved":0,"allocated":987136,"data_stored":750175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.53400000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.51300000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.59799999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":0.55300000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":0.628}]},{"osd":6,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.4209999999999998,"5min":2.4209999999999998,"15min":2.4209999999999998},"last":0.58699999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":8.1910000000000007,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":0.67300000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.7910000000000004,"5min":7.7910000000000004,"15min":7.7910000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.621,"5min":2.621,"15min":2.621},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.851,"5min":2.851,"15min":2.851},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.9569999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":0.629},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.45500000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.439},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.59899999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.503},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.65400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298252,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073588,"statfs":{"total":96636764160,"available":96331354112,"internally_reserved":0,"allocated":987136,"data_stored":750175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"last":0.33800000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"last":0.307},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"last":0.315}]},{"osd":3,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.374}]},{"osd":4,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.51900000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.63},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.52900000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.54900000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.69299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":153901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"last":0.378},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.35499999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.29299999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.32400000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.746}]},{"osd":5,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.77100000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.80700000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.315}]},{"osd":1,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.36199999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.376},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.30399999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.623},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.66300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.35199999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.373}]},{"osd":2,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.317},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.42799999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":1.153},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":1.1259999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":1.0649999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":1.044},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.54100000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":1.093}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.80500000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.377},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.57299999999999995}]},{"osd":2,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.65300000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.54100000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.755}]},{"osd":7,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.69699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":158454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.70399999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.718,"5min":4.718,"15min":4.718},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.747},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.498},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.54700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:40:33.073 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T04:40:33.073 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:40:33.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.185+0000 7fd4309c4700 1 Processor -- start 2023-10-06T04:40:33.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.185+0000 7fd4309c4700 1 -- start start 2023-10-06T04:40:33.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.186+0000 7fd4309c4700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd42c0b3040 0x7fd42c0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:33.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.186+0000 7fd4309c4700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42c0cd740 con 0x7fd42c0b0e70 2023-10-06T04:40:33.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.186+0000 7fd4309c4700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42c0ccb30 con 0x7fd42c159d50 2023-10-06T04:40:33.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.186+0000 7fd4309c4700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42c0b3490 con 0x7fd42c0b3040 2023-10-06T04:40:33.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.186+0000 7fd42ad9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd42c0b0e70 0x7fd42c0b1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45656/0 (socket says 172.21.15.112:45656) 2023-10-06T04:40:33.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.186+0000 7fd42ad9d700 1 -- 172.21.15.112:0/2251410244 learned_addr learned my addr 172.21.15.112:0/2251410244 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:33.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.186+0000 7fd421d9b700 1 --2- 172.21.15.112:0/2251410244 >> v2:172.21.15.179:3300/0 conn(0x7fd42c0b3040 0x7fd42c0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:33.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.186+0000 7fd429d9b700 1 -- 172.21.15.112:0/2251410244 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3899829762 0 0) 0x7fd42c0cd740 con 0x7fd42c0b0e70 2023-10-06T04:40:33.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.186+0000 7fd429d9b700 1 -- 172.21.15.112:0/2251410244 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd418003570 con 0x7fd42c0b0e70 2023-10-06T04:40:33.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd429d9b700 1 -- 172.21.15.112:0/2251410244 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006940001 0 0) 0x7fd42c0ccb30 con 0x7fd42c159d50 2023-10-06T04:40:33.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd429d9b700 1 -- 172.21.15.112:0/2251410244 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd42c0cd740 con 0x7fd42c159d50 2023-10-06T04:40:33.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd429d9b700 1 -- 172.21.15.112:0/2251410244 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2625346064 0 0) 0x7fd418003570 con 0x7fd42c0b0e70 2023-10-06T04:40:33.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd429d9b700 1 -- 172.21.15.112:0/2251410244 >> v2:172.21.15.179:3300/0 conn(0x7fd42c0b3040 msgr2=0x7fd42c0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:33.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd429d9b700 1 --2- 172.21.15.112:0/2251410244 >> v2:172.21.15.179:3300/0 conn(0x7fd42c0b3040 0x7fd42c0cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd429d9b700 1 -- 172.21.15.112:0/2251410244 >> v1:172.21.15.179:6789/0 conn(0x7fd42c159d50 legacy=0x7fd42c15a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:33.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd429d9b700 1 -- 172.21.15.112:0/2251410244 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c0cce10 con 0x7fd42c0b0e70 2023-10-06T04:40:33.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd429d9b700 1 -- 172.21.15.112:0/2251410244 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7fd4240017f0 con 0x7fd42c0b0e70 2023-10-06T04:40:33.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd429d9b700 1 -- 172.21.15.112:0/2251410244 >> v1:172.21.15.112:6789/0 conn(0x7fd42c0b0e70 legacy=0x7fd42c0b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:33.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd429d9b700 1 --2- 172.21.15.112:0/2251410244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd418003bf0 0x7fd418003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:33.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd429d9b700 1 --2- 172.21.15.112:0/2251410244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd418004810 0x7fd418004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:33.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd429d9b700 1 --2- 172.21.15.112:0/2251410244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4180051c0 0x7fd41800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:33.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd429d9b700 1 -- 172.21.15.112:0/2251410244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c0b3490 con 0x7fd418003bf0 2023-10-06T04:40:33.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd429d9b700 1 -- 172.21.15.112:0/2251410244 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41800c0b0 con 0x7fd418004810 2023-10-06T04:40:33.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd429d9b700 1 -- 172.21.15.112:0/2251410244 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41800c270 con 0x7fd4180051c0 2023-10-06T04:40:33.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd42a59c700 1 --2- 172.21.15.112:0/2251410244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd418003bf0 0x7fd418003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:33.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd421d9b700 1 --2- 172.21.15.112:0/2251410244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd418004810 0x7fd418004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:33.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd42ad9d700 1 --2- 172.21.15.112:0/2251410244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4180051c0 0x7fd41800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:33.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd42a59c700 1 -- 172.21.15.112:0/2251410244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4180051c0 msgr2=0x7fd41800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:33.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd42a59c700 1 --2- 172.21.15.112:0/2251410244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4180051c0 0x7fd41800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd42a59c700 1 -- 172.21.15.112:0/2251410244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd418004810 msgr2=0x7fd418004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:33.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd42a59c700 1 --2- 172.21.15.112:0/2251410244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd418004810 0x7fd418004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd42ad9d700 1 -- 172.21.15.112:0/2251410244 reap_dead start 2023-10-06T04:40:33.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd42a59c700 1 -- 172.21.15.112:0/2251410244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd418003570 con 0x7fd418003bf0 2023-10-06T04:40:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd42a59c700 1 --2- 172.21.15.112:0/2251410244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd418003bf0 0x7fd418003fe0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd41c001a10 tx=0x7fd41c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a9e677dc0f7672 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd429d9b700 1 -- 172.21.15.112:0/2251410244 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c00c590 con 0x7fd418003bf0 2023-10-06T04:40:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.187+0000 7fd429d9b700 1 -- 172.21.15.112:0/2251410244 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c00c6f0 con 0x7fd418003bf0 2023-10-06T04:40:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.188+0000 7fd429d9b700 1 -- 172.21.15.112:0/2251410244 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c00ca90 con 0x7fd418003bf0 2023-10-06T04:40:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.188+0000 7fd4309c4700 1 -- 172.21.15.112:0/2251410244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd418003bf0 msgr2=0x7fd418003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.188+0000 7fd4309c4700 1 --2- 172.21.15.112:0/2251410244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd418003bf0 0x7fd418003fe0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd41c001a10 tx=0x7fd41c007d30 comp rx=0 tx=0).stop 2023-10-06T04:40:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.188+0000 7fd4309c4700 1 -- 172.21.15.112:0/2251410244 shutdown_connections 2023-10-06T04:40:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.188+0000 7fd4309c4700 1 --2- 172.21.15.112:0/2251410244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd418003bf0 0x7fd418003fe0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.188+0000 7fd4309c4700 1 -- 172.21.15.112:0/2251410244 >> 172.21.15.112:0/2251410244 conn(0x7fd42c099b60 msgr2=0x7fd42c06cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.188+0000 7fd4309c4700 1 -- 172.21.15.112:0/2251410244 shutdown_connections 2023-10-06T04:40:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.188+0000 7fd4309c4700 1 -- 172.21.15.112:0/2251410244 wait complete. 2023-10-06T04:40:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.189+0000 7fd4309c4700 1 Processor -- start 2023-10-06T04:40:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.189+0000 7fd4309c4700 1 -- start start 2023-10-06T04:40:33.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.190+0000 7fd4309c4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd418003bf0 0x7fd42c0b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:33.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.190+0000 7fd4309c4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd42c0af640 0x7fd42c09e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:33.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.190+0000 7fd4309c4700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd42c09ec00 0x7fd42c06ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:33.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.190+0000 7fd4309c4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c09f940 con 0x7fd418003bf0 2023-10-06T04:40:33.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.190+0000 7fd4309c4700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c151790 con 0x7fd42c0af640 2023-10-06T04:40:33.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.190+0000 7fd4309c4700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c09f0a0 con 0x7fd42c09ec00 2023-10-06T04:40:33.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.190+0000 7fd42a59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd418003bf0 0x7fd42c0b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:33.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.190+0000 7fd42a59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd418003bf0 0x7fd42c0b4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54746/0 (socket says 172.21.15.112:54746) 2023-10-06T04:40:33.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.190+0000 7fd42a59c700 1 -- 172.21.15.112:0/3315719931 learned_addr learned my addr 172.21.15.112:0/3315719931 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:33.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.190+0000 7fd421d9b700 1 --2- 172.21.15.112:0/3315719931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd42c0af640 0x7fd42c09e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:33.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.190+0000 7fd42ad9d700 1 --2- 172.21.15.112:0/3315719931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd42c09ec00 0x7fd42c06ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:33.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.190+0000 7fd42a59c700 1 -- 172.21.15.112:0/3315719931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd42c09ec00 msgr2=0x7fd42c06ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:33.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.190+0000 7fd42a59c700 1 --2- 172.21.15.112:0/3315719931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd42c09ec00 0x7fd42c06ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.190+0000 7fd42a59c700 1 -- 172.21.15.112:0/3315719931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd42c0af640 msgr2=0x7fd42c09e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:33.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.190+0000 7fd42a59c700 1 --2- 172.21.15.112:0/3315719931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd42c0af640 0x7fd42c09e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.190+0000 7fd42a59c700 1 -- 172.21.15.112:0/3315719931 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c09f380 con 0x7fd418003bf0 2023-10-06T04:40:33.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.190+0000 7fd421d9b700 1 --2- 172.21.15.112:0/3315719931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd42c0af640 0x7fd42c09e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:33.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.191+0000 7fd42a59c700 1 --2- 172.21.15.112:0/3315719931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd418003bf0 0x7fd42c0b4300 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd41800c080 tx=0x7fd41c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:33.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.191+0000 7fd422ffd700 1 -- 172.21.15.112:0/3315719931 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c00c590 con 0x7fd418003bf0 2023-10-06T04:40:33.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.191+0000 7fd422ffd700 1 -- 172.21.15.112:0/3315719931 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c001360 con 0x7fd418003bf0 2023-10-06T04:40:33.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.191+0000 7fd422ffd700 1 -- 172.21.15.112:0/3315719931 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c006a50 con 0x7fd418003bf0 2023-10-06T04:40:33.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.191+0000 7fd4309c4700 1 -- 172.21.15.112:0/3315719931 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42c09f660 con 0x7fd418003bf0 2023-10-06T04:40:33.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.191+0000 7fd4309c4700 1 -- 172.21.15.112:0/3315719931 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42c0a0300 con 0x7fd418003bf0 2023-10-06T04:40:33.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.192+0000 7fd4309c4700 1 -- 172.21.15.112:0/3315719931 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42c151a70 con 0x7fd418003bf0 2023-10-06T04:40:33.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.192+0000 7fd422ffd700 1 -- 172.21.15.112:0/3315719931 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fd41c019070 con 0x7fd418003bf0 2023-10-06T04:40:33.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.192+0000 7fd422ffd700 1 --2- 172.21.15.112:0/3315719931 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd40c0670e0 0x7fd40c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:33.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.193+0000 7fd422ffd700 1 -- 172.21.15.112:0/3315719931 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fd41c0852c0 con 0x7fd418003bf0 2023-10-06T04:40:33.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.193+0000 7fd421d9b700 1 --2- 172.21.15.112:0/3315719931 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd40c0670e0 0x7fd40c069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:33.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.193+0000 7fd421d9b700 1 --2- 172.21.15.112:0/3315719931 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd40c0670e0 0x7fd40c069590 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd42c15ac80 tx=0x7fd414008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:33.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.197+0000 7fd422ffd700 1 -- 172.21.15.112:0/3315719931 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd41c0523b0 con 0x7fd418003bf0 2023-10-06T04:40:33.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.377+0000 7fd4309c4700 1 -- 172.21.15.112:0/3315719931 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd42c0a0520 con 0x7fd40c0670e0 2023-10-06T04:40:33.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.380+0000 7fd422ffd700 1 -- 172.21.15.112:0/3315719931 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73396 (secure 0 0 0) 0x7fd42c0a0520 con 0x7fd40c0670e0 2023-10-06T04:40:33.383 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:33.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.382+0000 7fd4309c4700 1 -- 172.21.15.112:0/3315719931 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd40c0670e0 msgr2=0x7fd40c069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:33.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.382+0000 7fd4309c4700 1 --2- 172.21.15.112:0/3315719931 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd40c0670e0 0x7fd40c069590 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd42c15ac80 tx=0x7fd414008040 comp rx=0 tx=0).stop 2023-10-06T04:40:33.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.382+0000 7fd4309c4700 1 -- 172.21.15.112:0/3315719931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd418003bf0 msgr2=0x7fd42c0b4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:33.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.382+0000 7fd4309c4700 1 --2- 172.21.15.112:0/3315719931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd418003bf0 0x7fd42c0b4300 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd41800c080 tx=0x7fd41c015000 comp rx=0 tx=0).stop 2023-10-06T04:40:33.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.382+0000 7fd4309c4700 1 -- 172.21.15.112:0/3315719931 shutdown_connections 2023-10-06T04:40:33.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.382+0000 7fd4309c4700 1 --2- 172.21.15.112:0/3315719931 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd40c0670e0 0x7fd40c069590 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.382+0000 7fd4309c4700 1 --2- 172.21.15.112:0/3315719931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd42c09ec00 0x7fd42c06ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.382+0000 7fd4309c4700 1 --2- 172.21.15.112:0/3315719931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd418003bf0 0x7fd42c0b4300 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.382+0000 7fd4309c4700 1 --2- 172.21.15.112:0/3315719931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd42c0af640 0x7fd42c09e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.382+0000 7fd4309c4700 1 -- 172.21.15.112:0/3315719931 >> 172.21.15.112:0/3315719931 conn(0x7fd42c099b60 msgr2=0x7fd42c153f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:33.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.382+0000 7fd4309c4700 1 -- 172.21.15.112:0/3315719931 shutdown_connections 2023-10-06T04:40:33.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.382+0000 7fd4309c4700 1 -- 172.21.15.112:0/3315719931 wait complete. 2023-10-06T04:40:33.386 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-10-06T04:40:33.396 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-10-06T04:40:32.292187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382516,"kb_used_data":4212,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592204,"statfs":{"total":773094113280,"available":770654416896,"internally_reserved":0,"allocated":4313088,"data_stored":2451933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-132759,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-3,"num_read_kb":-3,"num_write":-93,"num_write_kb":-162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.975676"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.579743+0000","last_change":"2023-10-06T04:39:16.067723+0000","last_active":"2023-10-06T04:40:26.579743+0000","last_peered":"2023-10-06T04:40:26.579743+0000","last_clean":"2023-10-06T04:40:26.579743+0000","last_became_active":"2023-10-06T04:39:16.067325+0000","last_became_peered":"2023-10-06T04:39:16.067325+0000","last_unstale":"2023-10-06T04:40:26.579743+0000","last_undegraded":"2023-10-06T04:40:26.579743+0000","last_fullsized":"2023-10-06T04:40:26.579743+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.888084+0000","last_change":"2023-10-06T04:39:15.592391+0000","last_active":"2023-10-06T04:40:26.888084+0000","last_peered":"2023-10-06T04:40:26.888084+0000","last_clean":"2023-10-06T04:40:26.888084+0000","last_became_active":"2023-10-06T04:39:15.592094+0000","last_became_peered":"2023-10-06T04:39:15.592094+0000","last_unstale":"2023-10-06T04:40:26.888084+0000","last_undegraded":"2023-10-06T04:40:26.888084+0000","last_fullsized":"2023-10-06T04:40:26.888084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.280766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.887209+0000","last_change":"2023-10-06T04:39:15.585112+0000","last_active":"2023-10-06T04:40:26.887209+0000","last_peered":"2023-10-06T04:40:26.887209+0000","last_clean":"2023-10-06T04:40:26.887209+0000","last_became_active":"2023-10-06T04:39:15.584853+0000","last_became_peered":"2023-10-06T04:39:15.584853+0000","last_unstale":"2023-10-06T04:40:26.887209+0000","last_undegraded":"2023-10-06T04:40:26.887209+0000","last_fullsized":"2023-10-06T04:40:26.887209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.888595+0000","last_change":"2023-10-06T04:39:15.588017+0000","last_active":"2023-10-06T04:40:26.888595+0000","last_peered":"2023-10-06T04:40:26.888595+0000","last_clean":"2023-10-06T04:40:26.888595+0000","last_became_active":"2023-10-06T04:39:15.586771+0000","last_became_peered":"2023-10-06T04:39:15.586771+0000","last_unstale":"2023-10-06T04:40:26.888595+0000","last_undegraded":"2023-10-06T04:40:26.888595+0000","last_fullsized":"2023-10-06T04:40:26.888595+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:35.225282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.888672+0000","last_change":"2023-10-06T04:39:16.252521+0000","last_active":"2023-10-06T04:40:26.888672+0000","last_peered":"2023-10-06T04:40:26.888672+0000","last_clean":"2023-10-06T04:40:26.888672+0000","last_became_active":"2023-10-06T04:39:16.252245+0000","last_became_peered":"2023-10-06T04:39:16.252245+0000","last_unstale":"2023-10-06T04:40:26.888672+0000","last_undegraded":"2023-10-06T04:40:26.888672+0000","last_fullsized":"2023-10-06T04:40:26.888672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:17.694713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.888541+0000","last_change":"2023-10-06T04:39:16.252493+0000","last_active":"2023-10-06T04:40:26.888541+0000","last_peered":"2023-10-06T04:40:26.888541+0000","last_clean":"2023-10-06T04:40:26.888541+0000","last_became_active":"2023-10-06T04:39:16.252190+0000","last_became_peered":"2023-10-06T04:39:16.252190+0000","last_unstale":"2023-10-06T04:40:26.888541+0000","last_undegraded":"2023-10-06T04:40:26.888541+0000","last_fullsized":"2023-10-06T04:40:26.888541+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:59.554724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.889435+0000","last_change":"2023-10-06T04:39:16.252554+0000","last_active":"2023-10-06T04:40:26.889435+0000","last_peered":"2023-10-06T04:40:26.889435+0000","last_clean":"2023-10-06T04:40:26.889435+0000","last_became_active":"2023-10-06T04:39:16.252225+0000","last_became_peered":"2023-10-06T04:39:16.252225+0000","last_unstale":"2023-10-06T04:40:26.889435+0000","last_undegraded":"2023-10-06T04:40:26.889435+0000","last_fullsized":"2023-10-06T04:40:26.889435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.280766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.889301+0000","last_change":"2023-10-06T04:39:16.253021+0000","last_active":"2023-10-06T04:40:26.889301+0000","last_peered":"2023-10-06T04:40:26.889301+0000","last_clean":"2023-10-06T04:40:26.889301+0000","last_became_active":"2023-10-06T04:39:16.252478+0000","last_became_peered":"2023-10-06T04:39:16.252478+0000","last_unstale":"2023-10-06T04:40:26.889301+0000","last_undegraded":"2023-10-06T04:40:26.889301+0000","last_fullsized":"2023-10-06T04:40:26.889301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:07.439434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.889151+0000","last_change":"2023-10-06T04:39:15.587681+0000","last_active":"2023-10-06T04:40:26.889151+0000","last_peered":"2023-10-06T04:40:26.889151+0000","last_clean":"2023-10-06T04:40:26.889151+0000","last_became_active":"2023-10-06T04:39:15.587313+0000","last_became_peered":"2023-10-06T04:39:15.587313+0000","last_unstale":"2023-10-06T04:40:26.889151+0000","last_undegraded":"2023-10-06T04:40:26.889151+0000","last_fullsized":"2023-10-06T04:40:26.889151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298252,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073588,"statfs":{"total":96636764160,"available":96331354112,"internally_reserved":0,"allocated":987136,"data_stored":750175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.53400000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.51300000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.59799999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":0.55300000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":0.628}]},{"osd":6,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.4209999999999998,"5min":2.4209999999999998,"15min":2.4209999999999998},"last":0.58699999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":8.1910000000000007,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":0.67300000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.7910000000000004,"5min":7.7910000000000004,"15min":7.7910000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.621,"5min":2.621,"15min":2.621},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.851,"5min":2.851,"15min":2.851},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.9569999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":0.629},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.45500000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.439},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.59899999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.503},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.65400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298252,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073588,"statfs":{"total":96636764160,"available":96331354112,"internally_reserved":0,"allocated":987136,"data_stored":750175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"last":0.33800000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"last":0.307},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"last":0.315}]},{"osd":3,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.374}]},{"osd":4,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.51900000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.63},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.52900000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.54900000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.69299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":153901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"last":0.378},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.35499999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.29299999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.32400000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.746}]},{"osd":5,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.77100000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.80700000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.315}]},{"osd":1,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.36199999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.376},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.30399999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.623},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.66300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.35199999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.373}]},{"osd":2,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.317},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.42799999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":1.153},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":1.1259999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":1.0649999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":1.044},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.54100000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":1.093}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.80500000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.377},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.57299999999999995}]},{"osd":2,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.65300000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.54100000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.755}]},{"osd":7,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.69699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":158454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.70399999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.718,"5min":4.718,"15min":4.718},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.747},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.498},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.54700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:40:33.399 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:40:33.512 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.510+0000 7f8316eaa700 1 Processor -- start 2023-10-06T04:40:33.512 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.510+0000 7f8316eaa700 1 -- start start 2023-10-06T04:40:33.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.511+0000 7f8316eaa700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8310159d50 0x7f83100b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:33.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.511+0000 7f8316eaa700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83100b0e70 0x7f83100b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:33.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.511+0000 7f8316eaa700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83100b1810 con 0x7f831015a120 2023-10-06T04:40:33.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.511+0000 7f8316eaa700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83100cd740 con 0x7f8310159d50 2023-10-06T04:40:33.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.511+0000 7f8316eaa700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83100ccb30 con 0x7f83100b0e70 2023-10-06T04:40:33.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.511+0000 7f8307fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f831015a120 0x7f83100cdbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45658/0 (socket says 172.21.15.112:45658) 2023-10-06T04:40:33.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.511+0000 7f8307fff700 1 -- 172.21.15.112:0/749958488 learned_addr learned my addr 172.21.15.112:0/749958488 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:33.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.511+0000 7f8314c46700 1 --2- 172.21.15.112:0/749958488 >> v2:172.21.15.179:3300/0 conn(0x7f8310159d50 0x7f83100b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:33.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.511+0000 7f8315447700 1 --2- 172.21.15.112:0/749958488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83100b0e70 0x7f83100b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:33.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.511+0000 7f83077fe700 1 -- 172.21.15.112:0/749958488 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276301333 0 0) 0x7f8300001110 con 0x7f831015a120 2023-10-06T04:40:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.511+0000 7f83077fe700 1 -- 172.21.15.112:0/749958488 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82f8003570 con 0x7f831015a120 2023-10-06T04:40:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.511+0000 7f8315447700 1 -- 172.21.15.112:0/749958488 >> v2:172.21.15.179:3300/0 conn(0x7f8310159d50 msgr2=0x7f83100b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.511+0000 7f8315447700 1 --2- 172.21.15.112:0/749958488 >> v2:172.21.15.179:3300/0 conn(0x7f8310159d50 0x7f83100b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.511+0000 7f8315447700 1 -- 172.21.15.112:0/749958488 >> v1:172.21.15.112:6789/0 conn(0x7f831015a120 legacy=0x7f83100cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.511+0000 7f8315447700 1 -- 172.21.15.112:0/749958488 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83100cce10 con 0x7f83100b0e70 2023-10-06T04:40:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.511+0000 7f8314c46700 1 --2- 172.21.15.112:0/749958488 >> v2:172.21.15.179:3300/0 conn(0x7f8310159d50 0x7f83100b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.511+0000 7f8315447700 1 --2- 172.21.15.112:0/749958488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83100b0e70 0x7f83100b12d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f83080098e0 tx=0x7f83080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbd9d988074ceb50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.512+0000 7f83077fe700 1 -- 172.21.15.112:0/749958488 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8308011630 con 0x7f83100b0e70 2023-10-06T04:40:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.512+0000 7f83077fe700 1 -- 172.21.15.112:0/749958488 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8308011790 con 0x7f83100b0e70 2023-10-06T04:40:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.512+0000 7f83077fe700 1 -- 172.21.15.112:0/749958488 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8308011b30 con 0x7f83100b0e70 2023-10-06T04:40:33.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.512+0000 7f8316eaa700 1 -- 172.21.15.112:0/749958488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83100b0e70 msgr2=0x7f83100b12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:33.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.512+0000 7f8316eaa700 1 --2- 172.21.15.112:0/749958488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83100b0e70 0x7f83100b12d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f83080098e0 tx=0x7f83080091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.512+0000 7f8316eaa700 1 -- 172.21.15.112:0/749958488 shutdown_connections 2023-10-06T04:40:33.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.512+0000 7f8316eaa700 1 --2- 172.21.15.112:0/749958488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83100b0e70 0x7f83100b12d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.512+0000 7f8316eaa700 1 --2- 172.21.15.112:0/749958488 >> v2:172.21.15.179:3300/0 conn(0x7f8310159d50 0x7f83100b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.512+0000 7f8316eaa700 1 -- 172.21.15.112:0/749958488 >> 172.21.15.112:0/749958488 conn(0x7f8310099b60 msgr2=0x7f831006cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:33.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.512+0000 7f8316eaa700 1 -- 172.21.15.112:0/749958488 shutdown_connections 2023-10-06T04:40:33.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.512+0000 7f8316eaa700 1 -- 172.21.15.112:0/749958488 wait complete. 2023-10-06T04:40:33.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.513+0000 7f8316eaa700 1 Processor -- start 2023-10-06T04:40:33.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.513+0000 7f8316eaa700 1 -- start start 2023-10-06T04:40:33.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.514+0000 7f8316eaa700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83100b0e70 0x7f831014eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:33.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.514+0000 7f8316eaa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8310159d50 0x7f831009ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:33.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.514+0000 7f8316eaa700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f831015a120 0x7f831009efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:33.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.514+0000 7f8316eaa700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8310157680 con 0x7f8310159d50 2023-10-06T04:40:33.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.514+0000 7f8316eaa700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83101584e0 con 0x7f831015a120 2023-10-06T04:40:33.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.514+0000 7f8316eaa700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83101578d0 con 0x7f83100b0e70 2023-10-06T04:40:33.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.514+0000 7f8307fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8310159d50 0x7f831009ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:33.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.514+0000 7f8307fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8310159d50 0x7f831009ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54760/0 (socket says 172.21.15.112:54760) 2023-10-06T04:40:33.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.514+0000 7f8307fff700 1 -- 172.21.15.112:0/338641130 learned_addr learned my addr 172.21.15.112:0/338641130 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:33.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.514+0000 7f8314c46700 1 --2- 172.21.15.112:0/338641130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83100b0e70 0x7f831014eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:33.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.514+0000 7f8315447700 1 --2- 172.21.15.112:0/338641130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f831015a120 0x7f831009efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:33.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.515+0000 7f8307fff700 1 -- 172.21.15.112:0/338641130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83100b0e70 msgr2=0x7f831014eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:33.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.515+0000 7f8307fff700 1 --2- 172.21.15.112:0/338641130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83100b0e70 0x7f831014eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.515+0000 7f8307fff700 1 -- 172.21.15.112:0/338641130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f831015a120 msgr2=0x7f831009efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:33.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.515+0000 7f8307fff700 1 --2- 172.21.15.112:0/338641130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f831015a120 0x7f831009efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.515+0000 7f8307fff700 1 -- 172.21.15.112:0/338641130 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830c009a20 con 0x7f8310159d50 2023-10-06T04:40:33.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.515+0000 7f8315447700 1 --2- 172.21.15.112:0/338641130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f831015a120 0x7f831009efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:33.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.515+0000 7f8314c46700 1 --2- 172.21.15.112:0/338641130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83100b0e70 0x7f831014eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:33.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.515+0000 7f8307fff700 1 --2- 172.21.15.112:0/338641130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8310159d50 0x7f831009ea90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f830000c7c0 tx=0x7f8300007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:33.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.515+0000 7f8304ff9700 1 -- 172.21.15.112:0/338641130 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8300005b30 con 0x7f8310159d50 2023-10-06T04:40:33.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.515+0000 7f8304ff9700 1 -- 172.21.15.112:0/338641130 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8300005c90 con 0x7f8310159d50 2023-10-06T04:40:33.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.515+0000 7f8316eaa700 1 -- 172.21.15.112:0/338641130 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8308009420 con 0x7f8310159d50 2023-10-06T04:40:33.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.515+0000 7f8304ff9700 1 -- 172.21.15.112:0/338641130 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8300007340 con 0x7f8310159d50 2023-10-06T04:40:33.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.515+0000 7f8316eaa700 1 -- 172.21.15.112:0/338641130 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8310157e90 con 0x7f8310159d50 2023-10-06T04:40:33.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.516+0000 7f8316eaa700 1 -- 172.21.15.112:0/338641130 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831005f230 con 0x7f8310159d50 2023-10-06T04:40:33.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.516+0000 7f8304ff9700 1 -- 172.21.15.112:0/338641130 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f83000076f0 con 0x7f8310159d50 2023-10-06T04:40:33.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.516+0000 7f8304ff9700 1 --2- 172.21.15.112:0/338641130 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f82fc0670e0 0x7f82fc069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:33.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.517+0000 7f8304ff9700 1 -- 172.21.15.112:0/338641130 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8300084080 con 0x7f8310159d50 2023-10-06T04:40:33.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.517+0000 7f8314c46700 1 --2- 172.21.15.112:0/338641130 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f82fc0670e0 0x7f82fc069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:33.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.517+0000 7f8314c46700 1 --2- 172.21.15.112:0/338641130 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f82fc0670e0 0x7f82fc069590 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f830c0099f0 tx=0x7f830c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:33.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.521+0000 7f8304ff9700 1 -- 172.21.15.112:0/338641130 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8300051210 con 0x7f8310159d50 2023-10-06T04:40:33.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.707+0000 7f8316eaa700 1 -- 172.21.15.112:0/338641130 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83100b1810 con 0x7f8310159d50 2023-10-06T04:40:33.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.708+0000 7f8304ff9700 1 -- 172.21.15.112:0/338641130 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13829 (secure 0 0 0) 0x7f83100b1810 con 0x7f8310159d50 2023-10-06T04:40:33.710 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:33.710 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":34,"fsid":"3e2b8a43-6e3c-475a-8b31-8dbcc20d6445","created":"2023-10-06T04:39:02.763619+0000","modified":"2023-10-06T04:40:27.576548+0000","last_up_change":"2023-10-06T04:39:13.474642+0000","last_in_change":"2023-10-06T04:39:05.162492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:39:13.929254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:39:14.321892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ee62e73f-1746-456a-9a1d-628f702005fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":90651},{"type":"v1","addr":"172.21.15.112:6817","nonce":90651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":90651},{"type":"v1","addr":"172.21.15.112:6819","nonce":90651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":90651},{"type":"v1","addr":"172.21.15.112:6823","nonce":90651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":90651},{"type":"v1","addr":"172.21.15.112:6821","nonce":90651}]},"public_addr":"172.21.15.112:6817/90651","cluster_addr":"172.21.15.112:6819/90651","heartbeat_back_addr":"172.21.15.112:6823/90651","heartbeat_front_addr":"172.21.15.112:6821/90651","state":["exists","up"]},{"osd":1,"uuid":"0e3f8f45-7bb4-474e-8605-c24751329738","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":90642},{"type":"v1","addr":"172.21.15.112:6809","nonce":90642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":90642},{"type":"v1","addr":"172.21.15.112:6811","nonce":90642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":90642},{"type":"v1","addr":"172.21.15.112:6815","nonce":90642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":90642},{"type":"v1","addr":"172.21.15.112:6813","nonce":90642}]},"public_addr":"172.21.15.112:6809/90642","cluster_addr":"172.21.15.112:6811/90642","heartbeat_back_addr":"172.21.15.112:6815/90642","heartbeat_front_addr":"172.21.15.112:6813/90642","state":["exists","up"]},{"osd":2,"uuid":"433ec17b-d963-4c91-8221-62c6a56a7552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":90641},{"type":"v1","addr":"172.21.15.112:6801","nonce":90641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":90641},{"type":"v1","addr":"172.21.15.112:6803","nonce":90641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":90641},{"type":"v1","addr":"172.21.15.112:6807","nonce":90641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":90641},{"type":"v1","addr":"172.21.15.112:6805","nonce":90641}]},"public_addr":"172.21.15.112:6801/90641","cluster_addr":"172.21.15.112:6803/90641","heartbeat_back_addr":"172.21.15.112:6807/90641","heartbeat_front_addr":"172.21.15.112:6805/90641","state":["exists","up"]},{"osd":3,"uuid":"971a992c-3499-4f4b-a792-8cd91076a33d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":90672},{"type":"v1","addr":"172.21.15.112:6825","nonce":90672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":90672},{"type":"v1","addr":"172.21.15.112:6827","nonce":90672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":90672},{"type":"v1","addr":"172.21.15.112:6831","nonce":90672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":90672},{"type":"v1","addr":"172.21.15.112:6829","nonce":90672}]},"public_addr":"172.21.15.112:6825/90672","cluster_addr":"172.21.15.112:6827/90672","heartbeat_back_addr":"172.21.15.112:6831/90672","heartbeat_front_addr":"172.21.15.112:6829/90672","state":["exists","up"]},{"osd":4,"uuid":"6031b367-0b9d-4928-ba70-f08242317af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":90848},{"type":"v1","addr":"172.21.15.179:6801","nonce":90848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":90848},{"type":"v1","addr":"172.21.15.179:6803","nonce":90848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":90848},{"type":"v1","addr":"172.21.15.179:6807","nonce":90848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":90848},{"type":"v1","addr":"172.21.15.179:6805","nonce":90848}]},"public_addr":"172.21.15.179:6801/90848","cluster_addr":"172.21.15.179:6803/90848","heartbeat_back_addr":"172.21.15.179:6807/90848","heartbeat_front_addr":"172.21.15.179:6805/90848","state":["exists","up"]},{"osd":5,"uuid":"a7fb2369-bb19-4d8d-8f78-c386cab59868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":90872},{"type":"v1","addr":"172.21.15.179:6817","nonce":90872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":90872},{"type":"v1","addr":"172.21.15.179:6819","nonce":90872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":90872},{"type":"v1","addr":"172.21.15.179:6823","nonce":90872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":90872},{"type":"v1","addr":"172.21.15.179:6821","nonce":90872}]},"public_addr":"172.21.15.179:6817/90872","cluster_addr":"172.21.15.179:6819/90872","heartbeat_back_addr":"172.21.15.179:6823/90872","heartbeat_front_addr":"172.21.15.179:6821/90872","state":["exists","up"]},{"osd":6,"uuid":"270ea168-0734-4c80-9c7c-1be085e9e906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":90879},{"type":"v1","addr":"172.21.15.179:6825","nonce":90879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":90879},{"type":"v1","addr":"172.21.15.179:6827","nonce":90879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":90879},{"type":"v1","addr":"172.21.15.179:6831","nonce":90879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":90879},{"type":"v1","addr":"172.21.15.179:6829","nonce":90879}]},"public_addr":"172.21.15.179:6825/90879","cluster_addr":"172.21.15.179:6827/90879","heartbeat_back_addr":"172.21.15.179:6831/90879","heartbeat_front_addr":"172.21.15.179:6829/90879","state":["exists","up"]},{"osd":7,"uuid":"57fcaee9-8dda-4cfe-90cf-ac12cc8133d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":90849},{"type":"v1","addr":"172.21.15.179:6809","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":90849},{"type":"v1","addr":"172.21.15.179:6811","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":90849},{"type":"v1","addr":"172.21.15.179:6815","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":90849},{"type":"v1","addr":"172.21.15.179:6813","nonce":90849}]},"public_addr":"172.21.15.179:6809/90849","cluster_addr":"172.21.15.179:6811/90849","heartbeat_back_addr":"172.21.15.179:6815/90849","heartbeat_front_addr":"172.21.15.179:6813/90849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320699+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.233875+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.072960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.363652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.312257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.352801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.332788+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:39:10.320988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6834/1886371745":"2023-10-07T04:40:24.312231+0000","172.21.15.179:6832/1886371745":"2023-10-07T04:40:24.312231+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:40:33.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.710+0000 7f8316eaa700 1 -- 172.21.15.112:0/338641130 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f82fc0670e0 msgr2=0x7f82fc069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:33.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.710+0000 7f8316eaa700 1 --2- 172.21.15.112:0/338641130 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f82fc0670e0 0x7f82fc069590 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f830c0099f0 tx=0x7f830c00b040 comp rx=0 tx=0).stop 2023-10-06T04:40:33.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.710+0000 7f8316eaa700 1 -- 172.21.15.112:0/338641130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8310159d50 msgr2=0x7f831009ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:33.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.710+0000 7f8316eaa700 1 --2- 172.21.15.112:0/338641130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8310159d50 0x7f831009ea90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f830000c7c0 tx=0x7f8300007c70 comp rx=0 tx=0).stop 2023-10-06T04:40:33.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.710+0000 7f8316eaa700 1 -- 172.21.15.112:0/338641130 shutdown_connections 2023-10-06T04:40:33.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.710+0000 7f8316eaa700 1 --2- 172.21.15.112:0/338641130 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f82fc0670e0 0x7f82fc069590 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.710+0000 7f8316eaa700 1 --2- 172.21.15.112:0/338641130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f831015a120 0x7f831009efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.710+0000 7f8316eaa700 1 --2- 172.21.15.112:0/338641130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83100b0e70 0x7f831014eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.710+0000 7f8316eaa700 1 --2- 172.21.15.112:0/338641130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8310159d50 0x7f831009ea90 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:33.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.710+0000 7f8316eaa700 1 -- 172.21.15.112:0/338641130 >> 172.21.15.112:0/338641130 conn(0x7f8310099b60 msgr2=0x7f8310155750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:33.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.710+0000 7f8316eaa700 1 -- 172.21.15.112:0/338641130 shutdown_connections 2023-10-06T04:40:33.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:33.710+0000 7f8316eaa700 1 -- 172.21.15.112:0/338641130 wait complete. 2023-10-06T04:40:34.725 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T04:40:34.725 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:40:34.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.855+0000 7fccea76e700 1 Processor -- start 2023-10-06T04:40:34.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.855+0000 7fccea76e700 1 -- start start 2023-10-06T04:40:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.856+0000 7fccea76e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcce4142c50 0x7fcce415a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.856+0000 7fccea76e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcce4143020 0x7fcce415dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.856+0000 7fccea76e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce40ccc70 con 0x7fcce40cbed0 2023-10-06T04:40:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.856+0000 7fccea76e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce415e240 con 0x7fcce4143020 2023-10-06T04:40:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.856+0000 7fccea76e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce415d2b0 con 0x7fcce4142c50 2023-10-06T04:40:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.856+0000 7fcce8f6b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcce4143020 0x7fcce415dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.856+0000 7fcce8f6b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcce4143020 0x7fcce415dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54764/0 (socket says 172.21.15.112:54764) 2023-10-06T04:40:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.856+0000 7fcce9f6d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fcce40cbed0 0x7fcce40caca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45672/0 (socket says 172.21.15.112:45672) 2023-10-06T04:40:34.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.856+0000 7fcce8f6b700 1 -- 172.21.15.112:0/491760691 learned_addr learned my addr 172.21.15.112:0/491760691 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:34.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.856+0000 7fcce976c700 1 --2- 172.21.15.112:0/491760691 >> v2:172.21.15.179:3300/0 conn(0x7fcce4142c50 0x7fcce415a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:34.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.856+0000 7fcce8f6b700 1 -- 172.21.15.112:0/491760691 >> v2:172.21.15.179:3300/0 conn(0x7fcce4142c50 msgr2=0x7fcce415a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:34.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.856+0000 7fcce8f6b700 1 --2- 172.21.15.112:0/491760691 >> v2:172.21.15.179:3300/0 conn(0x7fcce4142c50 0x7fcce415a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:34.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.856+0000 7fcce8f6b700 1 -- 172.21.15.112:0/491760691 >> v1:172.21.15.112:6789/0 conn(0x7fcce40cbed0 legacy=0x7fcce40caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:34.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.856+0000 7fcce8f6b700 1 -- 172.21.15.112:0/491760691 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce40cc6b0 con 0x7fcce4143020 2023-10-06T04:40:34.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.856+0000 7fccdbfff700 1 -- 172.21.15.112:0/491760691 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152941569 0 0) 0x7fcce40ccc70 con 0x7fcce40cbed0 2023-10-06T04:40:34.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.856+0000 7fcce976c700 1 --2- 172.21.15.112:0/491760691 >> v2:172.21.15.179:3300/0 conn(0x7fcce4142c50 0x7fcce415a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:34.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.857+0000 7fcce8f6b700 1 --2- 172.21.15.112:0/491760691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce4143020 0x7fcce415dd00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fcce406ba60 tx=0x7fccd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249e35740b167864 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:34.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.857+0000 7fccdbfff700 1 -- 172.21.15.112:0/491760691 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd400b860 con 0x7fcce4143020 2023-10-06T04:40:34.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.857+0000 7fccdbfff700 1 -- 172.21.15.112:0/491760691 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd400b9c0 con 0x7fcce4143020 2023-10-06T04:40:34.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.857+0000 7fccdbfff700 1 -- 172.21.15.112:0/491760691 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd400bd60 con 0x7fcce4143020 2023-10-06T04:40:34.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.857+0000 7fccea76e700 1 -- 172.21.15.112:0/491760691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce4143020 msgr2=0x7fcce415dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:34.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.857+0000 7fccea76e700 1 --2- 172.21.15.112:0/491760691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce4143020 0x7fcce415dd00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fcce406ba60 tx=0x7fccd4009250 comp rx=0 tx=0).stop 2023-10-06T04:40:34.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.857+0000 7fccea76e700 1 -- 172.21.15.112:0/491760691 shutdown_connections 2023-10-06T04:40:34.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.857+0000 7fccea76e700 1 --2- 172.21.15.112:0/491760691 >> v2:172.21.15.179:3300/0 conn(0x7fcce4142c50 0x7fcce415a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:34.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.857+0000 7fccea76e700 1 --2- 172.21.15.112:0/491760691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce4143020 0x7fcce415dd00 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:34.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.857+0000 7fccea76e700 1 -- 172.21.15.112:0/491760691 >> 172.21.15.112:0/491760691 conn(0x7fcce4068010 msgr2=0x7fcce4068410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:34.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.857+0000 7fccea76e700 1 -- 172.21.15.112:0/491760691 shutdown_connections 2023-10-06T04:40:34.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.857+0000 7fccea76e700 1 -- 172.21.15.112:0/491760691 wait complete. 2023-10-06T04:40:34.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.858+0000 7fccea76e700 1 Processor -- start 2023-10-06T04:40:34.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.858+0000 7fccea76e700 1 -- start start 2023-10-06T04:40:34.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.859+0000 7fccea76e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce40cbed0 0x7fcce40b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:34.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.859+0000 7fccea76e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce4142c50 0x7fcce413fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:34.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.859+0000 7fccea76e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcce4143020 0x7fcce40c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:34.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.859+0000 7fccea76e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce40b1cb0 con 0x7fcce4142c50 2023-10-06T04:40:34.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.859+0000 7fccea76e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce40b3c30 con 0x7fcce40cbed0 2023-10-06T04:40:34.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.859+0000 7fccea76e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce40b3080 con 0x7fcce4143020 2023-10-06T04:40:34.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.859+0000 7fcce8f6b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce4142c50 0x7fcce413fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:34.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.859+0000 7fcce8f6b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce4142c50 0x7fcce413fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54768/0 (socket says 172.21.15.112:54768) 2023-10-06T04:40:34.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.859+0000 7fcce8f6b700 1 -- 172.21.15.112:0/3458096915 learned_addr learned my addr 172.21.15.112:0/3458096915 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:34.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.860+0000 7fcce976c700 1 --2- 172.21.15.112:0/3458096915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce40cbed0 0x7fcce40b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:34.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.860+0000 7fcce9f6d700 1 --2- 172.21.15.112:0/3458096915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcce4143020 0x7fcce40c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:34.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.860+0000 7fcce8f6b700 1 -- 172.21.15.112:0/3458096915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcce4143020 msgr2=0x7fcce40c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:34.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.860+0000 7fcce8f6b700 1 --2- 172.21.15.112:0/3458096915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcce4143020 0x7fcce40c9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:34.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.860+0000 7fcce8f6b700 1 -- 172.21.15.112:0/3458096915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce40cbed0 msgr2=0x7fcce40b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:34.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.860+0000 7fcce8f6b700 1 --2- 172.21.15.112:0/3458096915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce40cbed0 0x7fcce40b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:34.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.860+0000 7fcce8f6b700 1 -- 172.21.15.112:0/3458096915 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd40094f0 con 0x7fcce4142c50 2023-10-06T04:40:34.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.860+0000 7fcce976c700 1 --2- 172.21.15.112:0/3458096915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce40cbed0 0x7fcce40b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:34.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.860+0000 7fcce8f6b700 1 --2- 172.21.15.112:0/3458096915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce4142c50 0x7fcce413fee0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fccd4006f50 tx=0x7fccd4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:34.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.860+0000 7fccd97fa700 1 -- 172.21.15.112:0/3458096915 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4011e20 con 0x7fcce4142c50 2023-10-06T04:40:34.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.860+0000 7fccd97fa700 1 -- 172.21.15.112:0/3458096915 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd401f070 con 0x7fcce4142c50 2023-10-06T04:40:34.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.860+0000 7fccd97fa700 1 -- 172.21.15.112:0/3458096915 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd401a890 con 0x7fcce4142c50 2023-10-06T04:40:34.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.860+0000 7fccea76e700 1 -- 172.21.15.112:0/3458096915 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce40b3300 con 0x7fcce4142c50 2023-10-06T04:40:34.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.860+0000 7fccea76e700 1 -- 172.21.15.112:0/3458096915 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce40b38c0 con 0x7fcce4142c50 2023-10-06T04:40:34.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.861+0000 7fccea76e700 1 -- 172.21.15.112:0/3458096915 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcce415dc00 con 0x7fcce4142c50 2023-10-06T04:40:34.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.862+0000 7fccd97fa700 1 -- 172.21.15.112:0/3458096915 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fccd401ac00 con 0x7fcce4142c50 2023-10-06T04:40:34.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.862+0000 7fccd97fa700 1 --2- 172.21.15.112:0/3458096915 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fccc80670e0 0x7fccc8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:34.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.862+0000 7fccd97fa700 1 -- 172.21.15.112:0/3458096915 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fccd4021070 con 0x7fcce4142c50 2023-10-06T04:40:34.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.862+0000 7fcce976c700 1 --2- 172.21.15.112:0/3458096915 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fccc80670e0 0x7fccc8069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:34.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.862+0000 7fccd97fa700 1 --2- 172.21.15.112:0/3458096915 >> [v2:172.21.15.112:6816/90651,v1:172.21.15.112:6817/90651] conn(0x7fccc806d550 0x7fccc806f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:34.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.862+0000 7fccd97fa700 1 -- 172.21.15.112:0/3458096915 --> [v2:172.21.15.112:6816/90651,v1:172.21.15.112:6817/90651] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fccc8070030 con 0x7fccc806d550 2023-10-06T04:40:34.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.862+0000 7fccd97fa700 1 -- 172.21.15.112:0/3458096915 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fccd40889e0 con 0x7fcce4142c50 2023-10-06T04:40:34.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.862+0000 7fcce9f6d700 1 --2- 172.21.15.112:0/3458096915 >> [v2:172.21.15.112:6816/90651,v1:172.21.15.112:6817/90651] conn(0x7fccc806d550 0x7fccc806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:34.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.862+0000 7fcce976c700 1 --2- 172.21.15.112:0/3458096915 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fccc80670e0 0x7fccc8069590 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcce0006f00 tx=0x7fcce0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:34.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.863+0000 7fcce9f6d700 1 --2- 172.21.15.112:0/3458096915 >> [v2:172.21.15.112:6816/90651,v1:172.21.15.112:6817/90651] conn(0x7fccc806d550 0x7fccc806f960 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:34.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.863+0000 7fccd97fa700 1 -- 172.21.15.112:0/3458096915 <== osd.0 v2:172.21.15.112:6816/90651 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fccc8070030 con 0x7fccc806d550 2023-10-06T04:40:34.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.877+0000 7fccea76e700 1 -- 172.21.15.112:0/3458096915 --> [v2:172.21.15.112:6816/90651,v1:172.21.15.112:6817/90651] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcce405f230 con 0x7fccc806d550 2023-10-06T04:40:34.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.877+0000 7fccd97fa700 1 -- 172.21.15.112:0/3458096915 <== osd.0 v2:172.21.15.112:6816/90651 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcce405f230 con 0x7fccc806d550 2023-10-06T04:40:34.881 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-10-06T04:40:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:40:34.881 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-10-06T04:40:34.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.877+0000 7fccea76e700 1 -- 172.21.15.112:0/3458096915 >> [v2:172.21.15.112:6816/90651,v1:172.21.15.112:6817/90651] conn(0x7fccc806d550 msgr2=0x7fccc806f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:34.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.877+0000 7fccea76e700 1 --2- 172.21.15.112:0/3458096915 >> [v2:172.21.15.112:6816/90651,v1:172.21.15.112:6817/90651] conn(0x7fccc806d550 0x7fccc806f960 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:34.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.877+0000 7fccea76e700 1 -- 172.21.15.112:0/3458096915 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fccc80670e0 msgr2=0x7fccc8069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:34.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.877+0000 7fccea76e700 1 --2- 172.21.15.112:0/3458096915 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fccc80670e0 0x7fccc8069590 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcce0006f00 tx=0x7fcce0008040 comp rx=0 tx=0).stop 2023-10-06T04:40:34.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.877+0000 7fccea76e700 1 -- 172.21.15.112:0/3458096915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce4142c50 msgr2=0x7fcce413fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:34.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.877+0000 7fccea76e700 1 --2- 172.21.15.112:0/3458096915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce4142c50 0x7fcce413fee0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fccd4006f50 tx=0x7fccd4017000 comp rx=0 tx=0).stop 2023-10-06T04:40:34.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.877+0000 7fcce9f6d700 1 -- 172.21.15.112:0/3458096915 reap_dead start 2023-10-06T04:40:34.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.878+0000 7fccea76e700 1 -- 172.21.15.112:0/3458096915 shutdown_connections 2023-10-06T04:40:34.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.878+0000 7fccea76e700 1 -- 172.21.15.112:0/3458096915 >> 172.21.15.112:0/3458096915 conn(0x7fcce4068010 msgr2=0x7fcce4069350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:34.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.878+0000 7fccea76e700 1 -- 172.21.15.112:0/3458096915 shutdown_connections 2023-10-06T04:40:34.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:34.878+0000 7fccea76e700 1 -- 172.21.15.112:0/3458096915 wait complete. 2023-10-06T04:40:34.891 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T04:40:35.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.004+0000 7f8a60a75700 1 Processor -- start 2023-10-06T04:40:35.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.004+0000 7f8a60a75700 1 -- start start 2023-10-06T04:40:35.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.005+0000 7f8a60a75700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8a5c06e0b0 0x7f8a5c0b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.005+0000 7f8a60a75700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a5c0cd100 0x7f8a5c159e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.005+0000 7f8a60a75700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a5c15a360 con 0x7f8a5c143270 2023-10-06T04:40:35.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.005+0000 7f8a60a75700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a5c143640 con 0x7f8a5c06e0b0 2023-10-06T04:40:35.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.005+0000 7f8a60a75700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c0cd650 con 0x7f8a5c0cd100 2023-10-06T04:40:35.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.005+0000 7f8a5affd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8a5c06e0b0 0x7f8a5c0b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.005+0000 7f8a5bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a5c0cd100 0x7f8a5c159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.005+0000 7f8a5b7fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f8a5c143270 0x7f8a5c06d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.112:35260/0 (socket says 172.21.15.112:35260) 2023-10-06T04:40:35.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.005+0000 7f8a5affd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8a5c06e0b0 0x7f8a5c0b64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.112:39900/0 (socket says 172.21.15.112:39900) 2023-10-06T04:40:35.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.005+0000 7f8a5b7fe700 1 -- 172.21.15.112:0/1402771539 learned_addr learned my addr 172.21.15.112:0/1402771539 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:35.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.005+0000 7f8a5affd700 1 -- 172.21.15.112:0/1402771539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a5c0cd100 msgr2=0x7f8a5c159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:35.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.005+0000 7f8a5affd700 1 --2- 172.21.15.112:0/1402771539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a5c0cd100 0x7f8a5c159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.005+0000 7f8a5affd700 1 -- 172.21.15.112:0/1402771539 >> v1:172.21.15.179:6789/0 conn(0x7f8a5c143270 legacy=0x7f8a5c06d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.005+0000 7f8a5affd700 1 -- 172.21.15.112:0/1402771539 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5c0b4350 con 0x7f8a5c06e0b0 2023-10-06T04:40:35.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.005+0000 7f8a5bfff700 1 --2- 172.21.15.112:0/1402771539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a5c0cd100 0x7f8a5c159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:40:35.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.006+0000 7f8a5affd700 1 --2- 172.21.15.112:0/1402771539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a5c06e0b0 0x7f8a5c0b64a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8a500098e0 tx=0x7f8a500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50ce0b424b53a235 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:35.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.006+0000 7f8a5a7fc700 1 -- 172.21.15.112:0/1402771539 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5000b640 con 0x7f8a5c06e0b0 2023-10-06T04:40:35.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.006+0000 7f8a5a7fc700 1 -- 172.21.15.112:0/1402771539 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5000b7a0 con 0x7f8a5c06e0b0 2023-10-06T04:40:35.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.006+0000 7f8a5a7fc700 1 -- 172.21.15.112:0/1402771539 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5000bb40 con 0x7f8a5c06e0b0 2023-10-06T04:40:35.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.006+0000 7f8a60a75700 1 -- 172.21.15.112:0/1402771539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a5c06e0b0 msgr2=0x7f8a5c0b64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.006+0000 7f8a60a75700 1 --2- 172.21.15.112:0/1402771539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a5c06e0b0 0x7f8a5c0b64a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8a500098e0 tx=0x7f8a500091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.006+0000 7f8a60a75700 1 -- 172.21.15.112:0/1402771539 shutdown_connections 2023-10-06T04:40:35.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.006+0000 7f8a60a75700 1 --2- 172.21.15.112:0/1402771539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a5c0cd100 0x7f8a5c159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.006+0000 7f8a60a75700 1 --2- 172.21.15.112:0/1402771539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a5c06e0b0 0x7f8a5c0b64a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.006+0000 7f8a60a75700 1 -- 172.21.15.112:0/1402771539 >> 172.21.15.112:0/1402771539 conn(0x7f8a5c06d2a0 msgr2=0x7f8a5c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:35.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.006+0000 7f8a60a75700 1 -- 172.21.15.112:0/1402771539 shutdown_connections 2023-10-06T04:40:35.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.006+0000 7f8a60a75700 1 -- 172.21.15.112:0/1402771539 wait complete. 2023-10-06T04:40:35.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.008+0000 7f8a60a75700 1 Processor -- start 2023-10-06T04:40:35.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.008+0000 7f8a60a75700 1 -- start start 2023-10-06T04:40:35.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.008+0000 7f8a60a75700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a5c06e0b0 0x7f8a5c16d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.008+0000 7f8a60a75700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a5c0cd100 0x7f8a5c159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.008+0000 7f8a60a75700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a5c143270 0x7f8a5c1341c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.008+0000 7f8a60a75700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c16d400 con 0x7f8a5c06e0b0 2023-10-06T04:40:35.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.008+0000 7f8a60a75700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c16cdf0 con 0x7f8a5c143270 2023-10-06T04:40:35.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.008+0000 7f8a60a75700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c134c60 con 0x7f8a5c0cd100 2023-10-06T04:40:35.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.008+0000 7f8a5b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a5c06e0b0 0x7f8a5c16d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.008+0000 7f8a5b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a5c06e0b0 0x7f8a5c16d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54770/0 (socket says 172.21.15.112:54770) 2023-10-06T04:40:35.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.008+0000 7f8a5b7fe700 1 -- 172.21.15.112:0/1962995501 learned_addr learned my addr 172.21.15.112:0/1962995501 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:35.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.009+0000 7f8a5affd700 1 --2- 172.21.15.112:0/1962995501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a5c0cd100 0x7f8a5c159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.009+0000 7f8a5bfff700 1 --2- 172.21.15.112:0/1962995501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a5c143270 0x7f8a5c1341c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.009+0000 7f8a5b7fe700 1 -- 172.21.15.112:0/1962995501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a5c0cd100 msgr2=0x7f8a5c159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.009+0000 7f8a5b7fe700 1 --2- 172.21.15.112:0/1962995501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a5c0cd100 0x7f8a5c159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.009+0000 7f8a5b7fe700 1 -- 172.21.15.112:0/1962995501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a5c143270 msgr2=0x7f8a5c1341c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.009+0000 7f8a5b7fe700 1 --2- 172.21.15.112:0/1962995501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a5c143270 0x7f8a5c1341c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.009+0000 7f8a5b7fe700 1 -- 172.21.15.112:0/1962995501 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a54009420 con 0x7f8a5c06e0b0 2023-10-06T04:40:35.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.009+0000 7f8a5affd700 1 --2- 172.21.15.112:0/1962995501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a5c0cd100 0x7f8a5c159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:35.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.009+0000 7f8a5bfff700 1 --2- 172.21.15.112:0/1962995501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a5c143270 0x7f8a5c1341c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:35.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.009+0000 7f8a5b7fe700 1 --2- 172.21.15.112:0/1962995501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a5c06e0b0 0x7f8a5c16d890 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00cc70 tx=0x7f8a4c001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:35.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.009+0000 7f8a437fe700 1 -- 172.21.15.112:0/1962995501 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c00ce80 con 0x7f8a5c06e0b0 2023-10-06T04:40:35.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.009+0000 7f8a437fe700 1 -- 172.21.15.112:0/1962995501 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4c00ab70 con 0x7f8a5c06e0b0 2023-10-06T04:40:35.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.009+0000 7f8a437fe700 1 -- 172.21.15.112:0/1962995501 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c0070f0 con 0x7f8a5c06e0b0 2023-10-06T04:40:35.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.009+0000 7f8a60a75700 1 -- 172.21.15.112:0/1962995501 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a50009420 con 0x7f8a5c06e0b0 2023-10-06T04:40:35.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.009+0000 7f8a60a75700 1 -- 172.21.15.112:0/1962995501 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a5c16d090 con 0x7f8a5c06e0b0 2023-10-06T04:40:35.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.010+0000 7f8a60a75700 1 -- 172.21.15.112:0/1962995501 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a5c16d6e0 con 0x7f8a5c06e0b0 2023-10-06T04:40:35.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.011+0000 7f8a437fe700 1 -- 172.21.15.112:0/1962995501 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f8a4c007520 con 0x7f8a5c06e0b0 2023-10-06T04:40:35.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.011+0000 7f8a437fe700 1 --2- 172.21.15.112:0/1962995501 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8a480670e0 0x7f8a48069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.011+0000 7f8a437fe700 1 -- 172.21.15.112:0/1962995501 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8a4c084a70 con 0x7f8a5c06e0b0 2023-10-06T04:40:35.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.011+0000 7f8a5affd700 1 --2- 172.21.15.112:0/1962995501 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8a480670e0 0x7f8a48069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.011+0000 7f8a5affd700 1 --2- 172.21.15.112:0/1962995501 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8a480670e0 0x7f8a48069590 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c06e4b0 tx=0x7f8a50017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:35.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.015+0000 7f8a437fe700 1 -- 172.21.15.112:0/1962995501 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a4c051c80 con 0x7f8a5c06e0b0 2023-10-06T04:40:35.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.198+0000 7f8a60a75700 1 -- 172.21.15.112:0/1962995501 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a5c16d540 con 0x7f8a480670e0 2023-10-06T04:40:35.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.199+0000 7f8a437fe700 1 -- 172.21.15.112:0/1962995501 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8a5000b910 con 0x7f8a480670e0 2023-10-06T04:40:35.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.200+0000 7f8a60a75700 1 -- 172.21.15.112:0/1962995501 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8a480670e0 msgr2=0x7f8a48069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.200+0000 7f8a60a75700 1 --2- 172.21.15.112:0/1962995501 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8a480670e0 0x7f8a48069590 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c06e4b0 tx=0x7f8a50017000 comp rx=0 tx=0).stop 2023-10-06T04:40:35.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.200+0000 7f8a60a75700 1 -- 172.21.15.112:0/1962995501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a5c06e0b0 msgr2=0x7f8a5c16d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.200+0000 7f8a60a75700 1 --2- 172.21.15.112:0/1962995501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a5c06e0b0 0x7f8a5c16d890 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00cc70 tx=0x7f8a4c001a30 comp rx=0 tx=0).stop 2023-10-06T04:40:35.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.200+0000 7f8a60a75700 1 -- 172.21.15.112:0/1962995501 shutdown_connections 2023-10-06T04:40:35.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.200+0000 7f8a60a75700 1 --2- 172.21.15.112:0/1962995501 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f8a480670e0 0x7f8a48069590 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.200+0000 7f8a60a75700 1 --2- 172.21.15.112:0/1962995501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a5c143270 0x7f8a5c1341c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.200+0000 7f8a60a75700 1 --2- 172.21.15.112:0/1962995501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a5c06e0b0 0x7f8a5c16d890 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.200+0000 7f8a60a75700 1 --2- 172.21.15.112:0/1962995501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a5c0cd100 0x7f8a5c159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.200+0000 7f8a60a75700 1 -- 172.21.15.112:0/1962995501 >> 172.21.15.112:0/1962995501 conn(0x7f8a5c06d2a0 msgr2=0x7f8a5c15a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:35.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.200+0000 7f8a60a75700 1 -- 172.21.15.112:0/1962995501 shutdown_connections 2023-10-06T04:40:35.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.200+0000 7f8a60a75700 1 -- 172.21.15.112:0/1962995501 wait complete. 2023-10-06T04:40:35.204 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T04:40:35.214 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T04:40:35.215 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:40:35.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.331+0000 7f50f6925700 1 Processor -- start 2023-10-06T04:40:35.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.331+0000 7f50f6925700 1 -- start start 2023-10-06T04:40:35.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.332+0000 7f50f6925700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f006d3b0 0x7f50f015be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.332+0000 7f50f6925700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f015af50 con 0x7f50f0159a20 2023-10-06T04:40:35.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.332+0000 7f50f6925700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f00cae50 con 0x7f50f00cbf00 2023-10-06T04:40:35.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.332+0000 7f50f6925700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f00cca70 con 0x7f50f006d3b0 2023-10-06T04:40:35.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.332+0000 7f50effff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f50f0159a20 0x7f50f00cb7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45678/0 (socket says 172.21.15.112:45678) 2023-10-06T04:40:35.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.332+0000 7f50effff700 1 -- 172.21.15.112:0/3797373646 learned_addr learned my addr 172.21.15.112:0/3797373646 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:35.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.332+0000 7f50f4ec2700 1 --2- 172.21.15.112:0/3797373646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f006d3b0 0x7f50f015be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.332+0000 7f50eeffd700 1 -- 172.21.15.112:0/3797373646 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464222737 0 0) 0x7f50f015af50 con 0x7f50f0159a20 2023-10-06T04:40:35.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.332+0000 7f50eeffd700 1 -- 172.21.15.112:0/3797373646 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50d8003570 con 0x7f50f0159a20 2023-10-06T04:40:35.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.333+0000 7f50eeffd700 1 -- 172.21.15.112:0/3797373646 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390276827 0 0) 0x7f50f00cae50 con 0x7f50f00cbf00 2023-10-06T04:40:35.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.333+0000 7f50f4ec2700 1 -- 172.21.15.112:0/3797373646 >> v1:172.21.15.179:6789/0 conn(0x7f50f00cbf00 legacy=0x7f50f015b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.333+0000 7f50f4ec2700 1 -- 172.21.15.112:0/3797373646 >> v1:172.21.15.112:6789/0 conn(0x7f50f0159a20 legacy=0x7f50f00cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.333+0000 7f50f4ec2700 1 -- 172.21.15.112:0/3797373646 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f00cb0f0 con 0x7f50f006d3b0 2023-10-06T04:40:35.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.333+0000 7f50f4ec2700 1 --2- 172.21.15.112:0/3797373646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f006d3b0 0x7f50f015be20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009e90 tx=0x7f50e8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc1ba7382693600a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:35.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.333+0000 7f50eeffd700 1 -- 172.21.15.112:0/3797373646 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e800e070 con 0x7f50f006d3b0 2023-10-06T04:40:35.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.333+0000 7f50eeffd700 1 -- 172.21.15.112:0/3797373646 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e800b920 con 0x7f50f006d3b0 2023-10-06T04:40:35.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.333+0000 7f50eeffd700 1 -- 172.21.15.112:0/3797373646 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e0001470 con 0x7f50f006d3b0 2023-10-06T04:40:35.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.333+0000 7f50f6925700 1 -- 172.21.15.112:0/3797373646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f006d3b0 msgr2=0x7f50f015be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.333+0000 7f50f6925700 1 --2- 172.21.15.112:0/3797373646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f006d3b0 0x7f50f015be20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009e90 tx=0x7f50e8009780 comp rx=0 tx=0).stop 2023-10-06T04:40:35.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.333+0000 7f50f6925700 1 -- 172.21.15.112:0/3797373646 shutdown_connections 2023-10-06T04:40:35.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.333+0000 7f50f6925700 1 --2- 172.21.15.112:0/3797373646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f006d3b0 0x7f50f015be20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.333+0000 7f50f6925700 1 -- 172.21.15.112:0/3797373646 >> 172.21.15.112:0/3797373646 conn(0x7f50f006cfb0 msgr2=0x7f50f00d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:35.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.333+0000 7f50f6925700 1 -- 172.21.15.112:0/3797373646 shutdown_connections 2023-10-06T04:40:35.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.333+0000 7f50f6925700 1 -- 172.21.15.112:0/3797373646 wait complete. 2023-10-06T04:40:35.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.335+0000 7f50f6925700 1 Processor -- start 2023-10-06T04:40:35.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.335+0000 7f50f6925700 1 -- start start 2023-10-06T04:40:35.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.335+0000 7f50f6925700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f006d3b0 0x7f50f00b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.335+0000 7f50f6925700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50f00cbf00 0x7f50f00b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.335+0000 7f50f6925700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50f0159a20 0x7f50f00b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.335+0000 7f50f6925700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f0155df0 con 0x7f50f00cbf00 2023-10-06T04:40:35.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.335+0000 7f50f6925700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f00b3d50 con 0x7f50f0159a20 2023-10-06T04:40:35.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.335+0000 7f50f6925700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f00b26b0 con 0x7f50f006d3b0 2023-10-06T04:40:35.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.336+0000 7f50ef7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50f00cbf00 0x7f50f00b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.336+0000 7f50ef7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50f00cbf00 0x7f50f00b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54786/0 (socket says 172.21.15.112:54786) 2023-10-06T04:40:35.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.336+0000 7f50ef7fe700 1 -- 172.21.15.112:0/1604441126 learned_addr learned my addr 172.21.15.112:0/1604441126 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:35.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.336+0000 7f50f4ec2700 1 --2- 172.21.15.112:0/1604441126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50f0159a20 0x7f50f00b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.336+0000 7f50effff700 1 --2- 172.21.15.112:0/1604441126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f006d3b0 0x7f50f00b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.336+0000 7f50ef7fe700 1 -- 172.21.15.112:0/1604441126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f006d3b0 msgr2=0x7f50f00b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.336+0000 7f50ef7fe700 1 --2- 172.21.15.112:0/1604441126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f006d3b0 0x7f50f00b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.336+0000 7f50ef7fe700 1 -- 172.21.15.112:0/1604441126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50f0159a20 msgr2=0x7f50f00b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.336+0000 7f50ef7fe700 1 --2- 172.21.15.112:0/1604441126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50f0159a20 0x7f50f00b3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.336+0000 7f50ef7fe700 1 -- 172.21.15.112:0/1604441126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e8009a20 con 0x7f50f00cbf00 2023-10-06T04:40:35.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.336+0000 7f50effff700 1 --2- 172.21.15.112:0/1604441126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f006d3b0 0x7f50f00b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:35.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.336+0000 7f50ef7fe700 1 --2- 172.21.15.112:0/1604441126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50f00cbf00 0x7f50f00b3810 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f50e400c590 tx=0x7f50e4007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:35.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.336+0000 7f50d7fff700 1 -- 172.21.15.112:0/1604441126 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4011590 con 0x7f50f00cbf00 2023-10-06T04:40:35.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.336+0000 7f50d7fff700 1 -- 172.21.15.112:0/1604441126 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e4011710 con 0x7f50f00cbf00 2023-10-06T04:40:35.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.336+0000 7f50f6925700 1 -- 172.21.15.112:0/1604441126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f00b1aa0 con 0x7f50f00cbf00 2023-10-06T04:40:35.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.336+0000 7f50d7fff700 1 -- 172.21.15.112:0/1604441126 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4011ad0 con 0x7f50f00cbf00 2023-10-06T04:40:35.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.336+0000 7f50f6925700 1 -- 172.21.15.112:0/1604441126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f00b2060 con 0x7f50f00cbf00 2023-10-06T04:40:35.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.337+0000 7f50f6925700 1 -- 172.21.15.112:0/1604441126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f50f005f230 con 0x7f50f00cbf00 2023-10-06T04:40:35.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.338+0000 7f50d7fff700 1 -- 172.21.15.112:0/1604441126 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f50e401b3b0 con 0x7f50f00cbf00 2023-10-06T04:40:35.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.338+0000 7f50d7fff700 1 --2- 172.21.15.112:0/1604441126 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f50dc0670e0 0x7f50dc069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.338+0000 7f50d7fff700 1 -- 172.21.15.112:0/1604441126 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f50e4083b30 con 0x7f50f00cbf00 2023-10-06T04:40:35.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.338+0000 7f50effff700 1 --2- 172.21.15.112:0/1604441126 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f50dc0670e0 0x7f50dc069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.338+0000 7f50d7fff700 1 --2- 172.21.15.112:0/1604441126 >> [v2:172.21.15.112:6808/90642,v1:172.21.15.112:6809/90642] conn(0x7f50dc06d550 0x7f50dc06f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.338+0000 7f50d7fff700 1 -- 172.21.15.112:0/1604441126 --> [v2:172.21.15.112:6808/90642,v1:172.21.15.112:6809/90642] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50dc070030 con 0x7f50dc06d550 2023-10-06T04:40:35.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.338+0000 7f50d7fff700 1 -- 172.21.15.112:0/1604441126 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50e4088220 con 0x7f50f00cbf00 2023-10-06T04:40:35.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.338+0000 7f50f4ec2700 1 --2- 172.21.15.112:0/1604441126 >> [v2:172.21.15.112:6808/90642,v1:172.21.15.112:6809/90642] conn(0x7f50dc06d550 0x7f50dc06f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.338+0000 7f50effff700 1 --2- 172.21.15.112:0/1604441126 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f50dc0670e0 0x7f50dc069590 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f50e0001ed0 tx=0x7f50e0000bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:35.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.339+0000 7f50f4ec2700 1 --2- 172.21.15.112:0/1604441126 >> [v2:172.21.15.112:6808/90642,v1:172.21.15.112:6809/90642] conn(0x7f50dc06d550 0x7f50dc06f960 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:35.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.339+0000 7f50d7fff700 1 -- 172.21.15.112:0/1604441126 <== osd.1 v2:172.21.15.112:6808/90642 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f50dc070030 con 0x7f50dc06d550 2023-10-06T04:40:35.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.353+0000 7f50f6925700 1 -- 172.21.15.112:0/1604441126 --> [v2:172.21.15.112:6808/90642,v1:172.21.15.112:6809/90642] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f50f009e400 con 0x7f50dc06d550 2023-10-06T04:40:35.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.353+0000 7f50d7fff700 1 -- 172.21.15.112:0/1604441126 <== osd.1 v2:172.21.15.112:6808/90642 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f50f009e400 con 0x7f50dc06d550 2023-10-06T04:40:35.355 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-10-06T04:40:35.355 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:40:35.356 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-10-06T04:40:35.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.353+0000 7f50f6925700 1 -- 172.21.15.112:0/1604441126 >> [v2:172.21.15.112:6808/90642,v1:172.21.15.112:6809/90642] conn(0x7f50dc06d550 msgr2=0x7f50dc06f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.353+0000 7f50f6925700 1 --2- 172.21.15.112:0/1604441126 >> [v2:172.21.15.112:6808/90642,v1:172.21.15.112:6809/90642] conn(0x7f50dc06d550 0x7f50dc06f960 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.353+0000 7f50f6925700 1 -- 172.21.15.112:0/1604441126 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f50dc0670e0 msgr2=0x7f50dc069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.353+0000 7f50f6925700 1 --2- 172.21.15.112:0/1604441126 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f50dc0670e0 0x7f50dc069590 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f50e0001ed0 tx=0x7f50e0000bc0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.353+0000 7f50f6925700 1 -- 172.21.15.112:0/1604441126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50f00cbf00 msgr2=0x7f50f00b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.353+0000 7f50f6925700 1 --2- 172.21.15.112:0/1604441126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50f00cbf00 0x7f50f00b3810 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f50e400c590 tx=0x7f50e4007f50 comp rx=0 tx=0).stop 2023-10-06T04:40:35.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.353+0000 7f50f4ec2700 1 -- 172.21.15.112:0/1604441126 reap_dead start 2023-10-06T04:40:35.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.353+0000 7f50f6925700 1 -- 172.21.15.112:0/1604441126 shutdown_connections 2023-10-06T04:40:35.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.353+0000 7f50f6925700 1 -- 172.21.15.112:0/1604441126 >> 172.21.15.112:0/1604441126 conn(0x7f50f006cfb0 msgr2=0x7f50f01552c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:35.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.353+0000 7f50f6925700 1 -- 172.21.15.112:0/1604441126 shutdown_connections 2023-10-06T04:40:35.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.353+0000 7f50f6925700 1 -- 172.21.15.112:0/1604441126 wait complete. 2023-10-06T04:40:35.367 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T04:40:35.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.479+0000 7fc1e8ebc700 1 Processor -- start 2023-10-06T04:40:35.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.479+0000 7fc1e8ebc700 1 -- start start 2023-10-06T04:40:35.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.480+0000 7fc1e8ebc700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc1e4143270 0x7fc1e40b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.480+0000 7fc1e8ebc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e4143640 con 0x7fc1e406e0b0 2023-10-06T04:40:35.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.480+0000 7fc1e8ebc700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e40cd650 con 0x7fc1e40cd100 2023-10-06T04:40:35.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.480+0000 7fc1e8ebc700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e40b4350 con 0x7fc1e4143270 2023-10-06T04:40:35.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.481+0000 7fc1e3fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc1e406e0b0 0x7fc1e40b4e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45688/0 (socket says 172.21.15.112:45688) 2023-10-06T04:40:35.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.481+0000 7fc1e3fff700 1 -- 172.21.15.112:0/2283213412 learned_addr learned my addr 172.21.15.112:0/2283213412 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:35.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.481+0000 7fc1e37fe700 1 --2- 172.21.15.112:0/2283213412 >> v2:172.21.15.179:3300/0 conn(0x7fc1e4143270 0x7fc1e40b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.481+0000 7fc1e2ffd700 1 -- 172.21.15.112:0/2283213412 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677874037 0 0) 0x7fc1e4143640 con 0x7fc1e406e0b0 2023-10-06T04:40:35.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.481+0000 7fc1e2ffd700 1 -- 172.21.15.112:0/2283213412 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1d0003570 con 0x7fc1e406e0b0 2023-10-06T04:40:35.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.481+0000 7fc1e2ffd700 1 -- 172.21.15.112:0/2283213412 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998603813 0 0) 0x7fc1e40cd650 con 0x7fc1e40cd100 2023-10-06T04:40:35.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.481+0000 7fc1e2ffd700 1 -- 172.21.15.112:0/2283213412 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1e4143640 con 0x7fc1e40cd100 2023-10-06T04:40:35.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.481+0000 7fc1e2ffd700 1 -- 172.21.15.112:0/2283213412 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3899933524 0 0) 0x7fc1d0003570 con 0x7fc1e406e0b0 2023-10-06T04:40:35.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.481+0000 7fc1e37fe700 1 -- 172.21.15.112:0/2283213412 >> v1:172.21.15.179:6789/0 conn(0x7fc1e40cd100 legacy=0x7fc1e406d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.481+0000 7fc1e37fe700 1 -- 172.21.15.112:0/2283213412 >> v1:172.21.15.112:6789/0 conn(0x7fc1e406e0b0 legacy=0x7fc1e40b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.481+0000 7fc1e37fe700 1 -- 172.21.15.112:0/2283213412 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e40b4630 con 0x7fc1e4143270 2023-10-06T04:40:35.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.481+0000 7fc1e37fe700 1 --2- 172.21.15.112:0/2283213412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e4143270 0x7fc1e40b64a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40098e0 tx=0x7fc1d40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e97a24eafe521ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:35.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.481+0000 7fc1e2ffd700 1 -- 172.21.15.112:0/2283213412 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc0017f0 con 0x7fc1e4143270 2023-10-06T04:40:35.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.481+0000 7fc1e2ffd700 1 -- 172.21.15.112:0/2283213412 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d4011420 con 0x7fc1e4143270 2023-10-06T04:40:35.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.481+0000 7fc1e2ffd700 1 -- 172.21.15.112:0/2283213412 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d40117c0 con 0x7fc1e4143270 2023-10-06T04:40:35.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.482+0000 7fc1e8ebc700 1 -- 172.21.15.112:0/2283213412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e4143270 msgr2=0x7fc1e40b64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.482+0000 7fc1e8ebc700 1 --2- 172.21.15.112:0/2283213412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e4143270 0x7fc1e40b64a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40098e0 tx=0x7fc1d40091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.482+0000 7fc1e8ebc700 1 -- 172.21.15.112:0/2283213412 shutdown_connections 2023-10-06T04:40:35.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.482+0000 7fc1e8ebc700 1 --2- 172.21.15.112:0/2283213412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e4143270 0x7fc1e40b64a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.482+0000 7fc1e8ebc700 1 -- 172.21.15.112:0/2283213412 >> 172.21.15.112:0/2283213412 conn(0x7fc1e406d2a0 msgr2=0x7fc1e40b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:35.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.482+0000 7fc1e8ebc700 1 -- 172.21.15.112:0/2283213412 shutdown_connections 2023-10-06T04:40:35.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.482+0000 7fc1e8ebc700 1 -- 172.21.15.112:0/2283213412 wait complete. 2023-10-06T04:40:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.483+0000 7fc1e8ebc700 1 Processor -- start 2023-10-06T04:40:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.483+0000 7fc1e8ebc700 1 -- start start 2023-10-06T04:40:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.484+0000 7fc1e8ebc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e406e0b0 0x7fc1e41699d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.484+0000 7fc1e8ebc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e40cd100 0x7fc1e41413c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.484+0000 7fc1e8ebc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e4143270 0x7fc1e4159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.484+0000 7fc1e8ebc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e40cb8c0 con 0x7fc1e40cd100 2023-10-06T04:40:35.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.484+0000 7fc1e8ebc700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e40a7370 con 0x7fc1e406e0b0 2023-10-06T04:40:35.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.484+0000 7fc1e8ebc700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e40cc480 con 0x7fc1e4143270 2023-10-06T04:40:35.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.484+0000 7fc1dbfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e40cd100 0x7fc1e41413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.484+0000 7fc1dbfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e40cd100 0x7fc1e41413c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54800/0 (socket says 172.21.15.112:54800) 2023-10-06T04:40:35.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.484+0000 7fc1dbfff700 1 -- 172.21.15.112:0/3275006827 learned_addr learned my addr 172.21.15.112:0/3275006827 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:35.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.484+0000 7fc1e37fe700 1 --2- 172.21.15.112:0/3275006827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e406e0b0 0x7fc1e41699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.484+0000 7fc1e3fff700 1 --2- 172.21.15.112:0/3275006827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e4143270 0x7fc1e4159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.484+0000 7fc1dbfff700 1 -- 172.21.15.112:0/3275006827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e4143270 msgr2=0x7fc1e4159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.484+0000 7fc1dbfff700 1 --2- 172.21.15.112:0/3275006827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e4143270 0x7fc1e4159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.484+0000 7fc1dbfff700 1 -- 172.21.15.112:0/3275006827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e406e0b0 msgr2=0x7fc1e41699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.484+0000 7fc1dbfff700 1 --2- 172.21.15.112:0/3275006827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e406e0b0 0x7fc1e41699d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.484+0000 7fc1dbfff700 1 -- 172.21.15.112:0/3275006827 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d4009420 con 0x7fc1e40cd100 2023-10-06T04:40:35.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.484+0000 7fc1dbfff700 1 --2- 172.21.15.112:0/3275006827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e40cd100 0x7fc1e41413c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00c7c0 tx=0x7fc1cc007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:35.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.485+0000 7fc1db7fe700 1 -- 172.21.15.112:0/3275006827 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc010510 con 0x7fc1e40cd100 2023-10-06T04:40:35.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.485+0000 7fc1db7fe700 1 -- 172.21.15.112:0/3275006827 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc0106b0 con 0x7fc1e40cd100 2023-10-06T04:40:35.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.485+0000 7fc1db7fe700 1 -- 172.21.15.112:0/3275006827 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc010a70 con 0x7fc1e40cd100 2023-10-06T04:40:35.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.485+0000 7fc1e8ebc700 1 -- 172.21.15.112:0/3275006827 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e40cb300 con 0x7fc1e40cd100 2023-10-06T04:40:35.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.485+0000 7fc1e8ebc700 1 -- 172.21.15.112:0/3275006827 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e40c9ea0 con 0x7fc1e40cd100 2023-10-06T04:40:35.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.485+0000 7fc1e8ebc700 1 -- 172.21.15.112:0/3275006827 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e405f230 con 0x7fc1e40cd100 2023-10-06T04:40:35.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.486+0000 7fc1db7fe700 1 -- 172.21.15.112:0/3275006827 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fc1cc012440 con 0x7fc1e40cd100 2023-10-06T04:40:35.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.486+0000 7fc1db7fe700 1 --2- 172.21.15.112:0/3275006827 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc1c40670e0 0x7fc1c4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.486+0000 7fc1db7fe700 1 -- 172.21.15.112:0/3275006827 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fc1cc083db0 con 0x7fc1e40cd100 2023-10-06T04:40:35.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.486+0000 7fc1e37fe700 1 --2- 172.21.15.112:0/3275006827 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc1c40670e0 0x7fc1c4069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.487+0000 7fc1e37fe700 1 --2- 172.21.15.112:0/3275006827 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc1c40670e0 0x7fc1c4069590 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40093f0 tx=0x7fc1d4016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:35.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.491+0000 7fc1db7fe700 1 -- 172.21.15.112:0/3275006827 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1cc050ff0 con 0x7fc1e40cd100 2023-10-06T04:40:35.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.676+0000 7fc1e8ebc700 1 -- 172.21.15.112:0/3275006827 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1e40b4910 con 0x7fc1c40670e0 2023-10-06T04:40:35.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.676+0000 7fc1db7fe700 1 -- 172.21.15.112:0/3275006827 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc1e40b4910 con 0x7fc1c40670e0 2023-10-06T04:40:35.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.678+0000 7fc1e8ebc700 1 -- 172.21.15.112:0/3275006827 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc1c40670e0 msgr2=0x7fc1c4069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.678+0000 7fc1e8ebc700 1 --2- 172.21.15.112:0/3275006827 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc1c40670e0 0x7fc1c4069590 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40093f0 tx=0x7fc1d4016000 comp rx=0 tx=0).stop 2023-10-06T04:40:35.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.678+0000 7fc1e8ebc700 1 -- 172.21.15.112:0/3275006827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e40cd100 msgr2=0x7fc1e41413c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.678+0000 7fc1e8ebc700 1 --2- 172.21.15.112:0/3275006827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e40cd100 0x7fc1e41413c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00c7c0 tx=0x7fc1cc007de0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.678+0000 7fc1e8ebc700 1 -- 172.21.15.112:0/3275006827 shutdown_connections 2023-10-06T04:40:35.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.678+0000 7fc1e8ebc700 1 --2- 172.21.15.112:0/3275006827 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fc1c40670e0 0x7fc1c4069590 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.678+0000 7fc1e8ebc700 1 --2- 172.21.15.112:0/3275006827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e4143270 0x7fc1e4159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.678+0000 7fc1e8ebc700 1 --2- 172.21.15.112:0/3275006827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e406e0b0 0x7fc1e41699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.678+0000 7fc1e8ebc700 1 --2- 172.21.15.112:0/3275006827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e40cd100 0x7fc1e41413c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.678+0000 7fc1e8ebc700 1 -- 172.21.15.112:0/3275006827 >> 172.21.15.112:0/3275006827 conn(0x7fc1e406d2a0 msgr2=0x7fc1e40cc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:35.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.678+0000 7fc1e8ebc700 1 -- 172.21.15.112:0/3275006827 shutdown_connections 2023-10-06T04:40:35.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.678+0000 7fc1e8ebc700 1 -- 172.21.15.112:0/3275006827 wait complete. 2023-10-06T04:40:35.682 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T04:40:35.692 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T04:40:35.692 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:40:35.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.807+0000 7f77a8db8700 1 Processor -- start 2023-10-06T04:40:35.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.808+0000 7f77a8db8700 1 -- start start 2023-10-06T04:40:35.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.808+0000 7f77a8db8700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f77a4159a20 0x7f77a40cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.808+0000 7f77a8db8700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77a406d3b0 0x7f77a40cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.808+0000 7f77a8db8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f77a415a9f0 0x7f77a415d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.809+0000 7f77a8db8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a40cca70 con 0x7f77a415a9f0 2023-10-06T04:40:35.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.809+0000 7f77a8db8700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a408a080 con 0x7f77a4159a20 2023-10-06T04:40:35.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.809+0000 7f77a8db8700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a415af50 con 0x7f77a406d3b0 2023-10-06T04:40:35.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.809+0000 7f77a2d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f77a415a9f0 0x7f77a415d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.809+0000 7f77a2d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f77a415a9f0 0x7f77a415d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54806/0 (socket says 172.21.15.112:54806) 2023-10-06T04:40:35.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.809+0000 7f77a2d9d700 1 -- 172.21.15.112:0/1450370101 learned_addr learned my addr 172.21.15.112:0/1450370101 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:35.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.809+0000 7f77a259c700 1 --2- 172.21.15.112:0/1450370101 >> v2:172.21.15.179:3300/0 conn(0x7f77a4159a20 0x7f77a40cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.809+0000 7f77a1d9b700 1 --2- 172.21.15.112:0/1450370101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77a406d3b0 0x7f77a40cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.809+0000 7f77a2d9d700 1 -- 172.21.15.112:0/1450370101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77a406d3b0 msgr2=0x7f77a40cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:35.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.809+0000 7f77a2d9d700 1 --2- 172.21.15.112:0/1450370101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77a406d3b0 0x7f77a40cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.809+0000 7f77a2d9d700 1 -- 172.21.15.112:0/1450370101 >> v2:172.21.15.179:3300/0 conn(0x7f77a4159a20 msgr2=0x7f77a40cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:35.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.809+0000 7f77a2d9d700 1 --2- 172.21.15.112:0/1450370101 >> v2:172.21.15.179:3300/0 conn(0x7f77a4159a20 0x7f77a40cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.809+0000 7f77a2d9d700 1 -- 172.21.15.112:0/1450370101 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a40cae50 con 0x7f77a415a9f0 2023-10-06T04:40:35.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.809+0000 7f77a2d9d700 1 --2- 172.21.15.112:0/1450370101 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a415a9f0 0x7f77a415d550 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f77a4088260 tx=0x7f779c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4246343b1544a39 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:35.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.809+0000 7f77a159a700 1 -- 172.21.15.112:0/1450370101 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c00b820 con 0x7f77a415a9f0 2023-10-06T04:40:35.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.809+0000 7f77a159a700 1 -- 172.21.15.112:0/1450370101 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779c00b980 con 0x7f77a415a9f0 2023-10-06T04:40:35.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.809+0000 7f77a159a700 1 -- 172.21.15.112:0/1450370101 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c00bd20 con 0x7f77a415a9f0 2023-10-06T04:40:35.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.810+0000 7f77a8db8700 1 -- 172.21.15.112:0/1450370101 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a415a9f0 msgr2=0x7f77a415d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.810+0000 7f77a8db8700 1 --2- 172.21.15.112:0/1450370101 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a415a9f0 0x7f77a415d550 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f77a4088260 tx=0x7f779c009250 comp rx=0 tx=0).stop 2023-10-06T04:40:35.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.810+0000 7f77a8db8700 1 -- 172.21.15.112:0/1450370101 shutdown_connections 2023-10-06T04:40:35.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.810+0000 7f77a8db8700 1 --2- 172.21.15.112:0/1450370101 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a415a9f0 0x7f77a415d550 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.810+0000 7f77a8db8700 1 --2- 172.21.15.112:0/1450370101 >> v2:172.21.15.179:3300/0 conn(0x7f77a4159a20 0x7f77a40cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.810+0000 7f77a8db8700 1 --2- 172.21.15.112:0/1450370101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77a406d3b0 0x7f77a40cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.810+0000 7f77a8db8700 1 -- 172.21.15.112:0/1450370101 >> 172.21.15.112:0/1450370101 conn(0x7f77a406cfb0 msgr2=0x7f77a40d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:35.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.810+0000 7f77a8db8700 1 -- 172.21.15.112:0/1450370101 shutdown_connections 2023-10-06T04:40:35.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.810+0000 7f77a8db8700 1 -- 172.21.15.112:0/1450370101 wait complete. 2023-10-06T04:40:35.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.811+0000 7f77a8db8700 1 Processor -- start 2023-10-06T04:40:35.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.811+0000 7f77a8db8700 1 -- start start 2023-10-06T04:40:35.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77a8db8700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77a406d3b0 0x7f77a40b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77a8db8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a4159a20 0x7f77a414a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77a8db8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77a415a9f0 0x7f77a4152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77a8db8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a40b5480 con 0x7f77a4159a20 2023-10-06T04:40:35.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77a8db8700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a40b5760 con 0x7f77a415a9f0 2023-10-06T04:40:35.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77a8db8700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a40b5a40 con 0x7f77a406d3b0 2023-10-06T04:40:35.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77a1d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a4159a20 0x7f77a414a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77a1d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a4159a20 0x7f77a414a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54822/0 (socket says 172.21.15.112:54822) 2023-10-06T04:40:35.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77a1d9b700 1 -- 172.21.15.112:0/4202490731 learned_addr learned my addr 172.21.15.112:0/4202490731 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:35.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77a259c700 1 --2- 172.21.15.112:0/4202490731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77a406d3b0 0x7f77a40b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77a2d9d700 1 --2- 172.21.15.112:0/4202490731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77a415a9f0 0x7f77a4152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77a1d9b700 1 -- 172.21.15.112:0/4202490731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77a406d3b0 msgr2=0x7f77a40b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77a1d9b700 1 --2- 172.21.15.112:0/4202490731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77a406d3b0 0x7f77a40b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77a1d9b700 1 -- 172.21.15.112:0/4202490731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77a415a9f0 msgr2=0x7f77a4152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77a1d9b700 1 --2- 172.21.15.112:0/4202490731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77a415a9f0 0x7f77a4152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77a1d9b700 1 -- 172.21.15.112:0/4202490731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c0094f0 con 0x7f77a4159a20 2023-10-06T04:40:35.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77a2d9d700 1 --2- 172.21.15.112:0/4202490731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77a415a9f0 0x7f77a4152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:35.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77a1d9b700 1 --2- 172.21.15.112:0/4202490731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a4159a20 0x7f77a414a070 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f779800d860 tx=0x7f7798008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:35.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77927fc700 1 -- 172.21.15.112:0/4202490731 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77980125f0 con 0x7f77a4159a20 2023-10-06T04:40:35.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77927fc700 1 -- 172.21.15.112:0/4202490731 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7798012750 con 0x7f77a4159a20 2023-10-06T04:40:35.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77927fc700 1 -- 172.21.15.112:0/4202490731 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7798012ad0 con 0x7f77a4159a20 2023-10-06T04:40:35.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77a8db8700 1 -- 172.21.15.112:0/4202490731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a40b5d20 con 0x7f77a4159a20 2023-10-06T04:40:35.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.812+0000 7f77a8db8700 1 -- 172.21.15.112:0/4202490731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a414a5b0 con 0x7f77a4159a20 2023-10-06T04:40:35.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.813+0000 7f77a8db8700 1 -- 172.21.15.112:0/4202490731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f77a416aeb0 con 0x7f77a4159a20 2023-10-06T04:40:35.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.814+0000 7f77927fc700 1 -- 172.21.15.112:0/4202490731 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f779801e460 con 0x7f77a4159a20 2023-10-06T04:40:35.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.814+0000 7f77927fc700 1 --2- 172.21.15.112:0/4202490731 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f77840670e0 0x7f7784069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.814+0000 7f77927fc700 1 -- 172.21.15.112:0/4202490731 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f7798084e00 con 0x7f77a4159a20 2023-10-06T04:40:35.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.814+0000 7f77a259c700 1 --2- 172.21.15.112:0/4202490731 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f77840670e0 0x7f7784069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.814+0000 7f77927fc700 1 --2- 172.21.15.112:0/4202490731 >> [v2:172.21.15.112:6800/90641,v1:172.21.15.112:6801/90641] conn(0x7f778406d550 0x7f778406f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.814+0000 7f77927fc700 1 -- 172.21.15.112:0/4202490731 --> [v2:172.21.15.112:6800/90641,v1:172.21.15.112:6801/90641] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7784070030 con 0x7f778406d550 2023-10-06T04:40:35.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.814+0000 7f77927fc700 1 -- 172.21.15.112:0/4202490731 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7798087300 con 0x7f77a4159a20 2023-10-06T04:40:35.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.814+0000 7f77a2d9d700 1 --2- 172.21.15.112:0/4202490731 >> [v2:172.21.15.112:6800/90641,v1:172.21.15.112:6801/90641] conn(0x7f778406d550 0x7f778406f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.815+0000 7f77a259c700 1 --2- 172.21.15.112:0/4202490731 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f77840670e0 0x7f7784069590 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f77940075a0 tx=0x7f77940097a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:35.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.815+0000 7f77a2d9d700 1 --2- 172.21.15.112:0/4202490731 >> [v2:172.21.15.112:6800/90641,v1:172.21.15.112:6801/90641] conn(0x7f778406d550 0x7f778406f960 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:35.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.815+0000 7f77927fc700 1 -- 172.21.15.112:0/4202490731 <== osd.2 v2:172.21.15.112:6800/90641 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f7784070030 con 0x7f778406d550 2023-10-06T04:40:35.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.829+0000 7f77a8db8700 1 -- 172.21.15.112:0/4202490731 --> [v2:172.21.15.112:6800/90641,v1:172.21.15.112:6801/90641] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f77a405f230 con 0x7f778406d550 2023-10-06T04:40:35.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.829+0000 7f77927fc700 1 -- 172.21.15.112:0/4202490731 <== osd.2 v2:172.21.15.112:6800/90641 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f77a405f230 con 0x7f778406d550 2023-10-06T04:40:35.831 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-10-06T04:40:35.832 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:40:35.832 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-10-06T04:40:35.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.829+0000 7f77a8db8700 1 -- 172.21.15.112:0/4202490731 >> [v2:172.21.15.112:6800/90641,v1:172.21.15.112:6801/90641] conn(0x7f778406d550 msgr2=0x7f778406f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.829+0000 7f77a8db8700 1 --2- 172.21.15.112:0/4202490731 >> [v2:172.21.15.112:6800/90641,v1:172.21.15.112:6801/90641] conn(0x7f778406d550 0x7f778406f960 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.829+0000 7f77a8db8700 1 -- 172.21.15.112:0/4202490731 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f77840670e0 msgr2=0x7f7784069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.829+0000 7f77a8db8700 1 --2- 172.21.15.112:0/4202490731 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f77840670e0 0x7f7784069590 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f77940075a0 tx=0x7f77940097a0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.829+0000 7f77a8db8700 1 -- 172.21.15.112:0/4202490731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a4159a20 msgr2=0x7f77a414a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.829+0000 7f77a8db8700 1 --2- 172.21.15.112:0/4202490731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a4159a20 0x7f77a414a070 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f779800d860 tx=0x7f7798008040 comp rx=0 tx=0).stop 2023-10-06T04:40:35.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.829+0000 7f77a2d9d700 1 -- 172.21.15.112:0/4202490731 reap_dead start 2023-10-06T04:40:35.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.829+0000 7f77a8db8700 1 -- 172.21.15.112:0/4202490731 shutdown_connections 2023-10-06T04:40:35.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.829+0000 7f77a8db8700 1 -- 172.21.15.112:0/4202490731 >> 172.21.15.112:0/4202490731 conn(0x7f77a406cfb0 msgr2=0x7f77a415ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:35.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.830+0000 7f77a8db8700 1 -- 172.21.15.112:0/4202490731 shutdown_connections 2023-10-06T04:40:35.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.830+0000 7f77a8db8700 1 -- 172.21.15.112:0/4202490731 wait complete. 2023-10-06T04:40:35.843 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T04:40:35.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.956+0000 7f1c67fff700 1 Processor -- start 2023-10-06T04:40:35.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.956+0000 7f1c67fff700 1 -- start start 2023-10-06T04:40:35.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.957+0000 7f1c67fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1c68143270 0x7f1c680b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.957+0000 7f1c67fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c680cd100 0x7f1c68159e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.957+0000 7f1c67fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1c6806d9a0 0x7f1c6806de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.957+0000 7f1c67fff700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6806e380 con 0x7f1c68143270 2023-10-06T04:40:35.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.957+0000 7f1c67fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6815a360 con 0x7f1c6806d9a0 2023-10-06T04:40:35.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.957+0000 7f1c67fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68143640 con 0x7f1c680cd100 2023-10-06T04:40:35.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.957+0000 7f1c66ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1c68143270 0x7f1c680b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.957+0000 7f1c66ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1c68143270 0x7f1c680b64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54832/0 (socket says 172.21.15.112:54832) 2023-10-06T04:40:35.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.957+0000 7f1c66ffd700 1 -- 172.21.15.112:0/611068152 learned_addr learned my addr 172.21.15.112:0/611068152 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:35.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.957+0000 7f1c667fc700 1 --2- 172.21.15.112:0/611068152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c680cd100 0x7f1c68159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.957+0000 7f1c677fe700 1 --2- 172.21.15.112:0/611068152 >> v2:172.21.15.179:3300/0 conn(0x7f1c6806d9a0 0x7f1c6806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.957+0000 7f1c66ffd700 1 -- 172.21.15.112:0/611068152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c680cd100 msgr2=0x7f1c68159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:35.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.957+0000 7f1c66ffd700 1 --2- 172.21.15.112:0/611068152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c680cd100 0x7f1c68159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.957+0000 7f1c66ffd700 1 -- 172.21.15.112:0/611068152 >> v2:172.21.15.179:3300/0 conn(0x7f1c6806d9a0 msgr2=0x7f1c6806de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:35.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.957+0000 7f1c66ffd700 1 --2- 172.21.15.112:0/611068152 >> v2:172.21.15.179:3300/0 conn(0x7f1c6806d9a0 0x7f1c6806de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.957+0000 7f1c66ffd700 1 -- 172.21.15.112:0/611068152 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c680cd650 con 0x7f1c68143270 2023-10-06T04:40:35.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.958+0000 7f1c66ffd700 1 --2- 172.21.15.112:0/611068152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c68143270 0x7f1c680b64a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1c68089b00 tx=0x7f1c58009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745071d8498471a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:35.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.958+0000 7f1c65ffb700 1 -- 172.21.15.112:0/611068152 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5800e070 con 0x7f1c68143270 2023-10-06T04:40:35.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.958+0000 7f1c65ffb700 1 -- 172.21.15.112:0/611068152 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5800ba50 con 0x7f1c68143270 2023-10-06T04:40:35.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.958+0000 7f1c65ffb700 1 -- 172.21.15.112:0/611068152 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c580092e0 con 0x7f1c68143270 2023-10-06T04:40:35.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.958+0000 7f1c67fff700 1 -- 172.21.15.112:0/611068152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c68143270 msgr2=0x7f1c680b64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.958+0000 7f1c67fff700 1 --2- 172.21.15.112:0/611068152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c68143270 0x7f1c680b64a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1c68089b00 tx=0x7f1c58009840 comp rx=0 tx=0).stop 2023-10-06T04:40:35.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.958+0000 7f1c67fff700 1 -- 172.21.15.112:0/611068152 shutdown_connections 2023-10-06T04:40:35.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.958+0000 7f1c67fff700 1 --2- 172.21.15.112:0/611068152 >> v2:172.21.15.179:3300/0 conn(0x7f1c6806d9a0 0x7f1c6806de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.958+0000 7f1c67fff700 1 --2- 172.21.15.112:0/611068152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c68143270 0x7f1c680b64a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.958+0000 7f1c67fff700 1 --2- 172.21.15.112:0/611068152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c680cd100 0x7f1c68159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.958+0000 7f1c67fff700 1 -- 172.21.15.112:0/611068152 >> 172.21.15.112:0/611068152 conn(0x7f1c6806d2a0 msgr2=0x7f1c680b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:35.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.958+0000 7f1c67fff700 1 -- 172.21.15.112:0/611068152 shutdown_connections 2023-10-06T04:40:35.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.958+0000 7f1c67fff700 1 -- 172.21.15.112:0/611068152 wait complete. 2023-10-06T04:40:35.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.959+0000 7f1c67fff700 1 Processor -- start 2023-10-06T04:40:35.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.959+0000 7f1c67fff700 1 -- start start 2023-10-06T04:40:35.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.960+0000 7f1c67fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c6806d9a0 0x7f1c68169620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.960+0000 7f1c67fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c680cd100 0x7f1c680cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.960+0000 7f1c67fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c68143270 0x7f1c680b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.960+0000 7f1c67fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6816a850 con 0x7f1c680cd100 2023-10-06T04:40:35.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.960+0000 7f1c67fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68169c20 con 0x7f1c6806d9a0 2023-10-06T04:40:35.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.960+0000 7f1c67fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68169f00 con 0x7f1c68143270 2023-10-06T04:40:35.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.960+0000 7f1c667fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c680cd100 0x7f1c680cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.960+0000 7f1c667fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c680cd100 0x7f1c680cc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54834/0 (socket says 172.21.15.112:54834) 2023-10-06T04:40:35.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.960+0000 7f1c667fc700 1 -- 172.21.15.112:0/160278813 learned_addr learned my addr 172.21.15.112:0/160278813 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:35.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.961+0000 7f1c677fe700 1 --2- 172.21.15.112:0/160278813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c68143270 0x7f1c680b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.961+0000 7f1c66ffd700 1 --2- 172.21.15.112:0/160278813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c6806d9a0 0x7f1c68169620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.961+0000 7f1c667fc700 1 -- 172.21.15.112:0/160278813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c68143270 msgr2=0x7f1c680b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.961+0000 7f1c667fc700 1 --2- 172.21.15.112:0/160278813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c68143270 0x7f1c680b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.961+0000 7f1c667fc700 1 -- 172.21.15.112:0/160278813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c6806d9a0 msgr2=0x7f1c68169620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:35.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.961+0000 7f1c667fc700 1 --2- 172.21.15.112:0/160278813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c6806d9a0 0x7f1c68169620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:35.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.961+0000 7f1c667fc700 1 -- 172.21.15.112:0/160278813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c58009ae0 con 0x7f1c680cd100 2023-10-06T04:40:35.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.961+0000 7f1c677fe700 1 --2- 172.21.15.112:0/160278813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c68143270 0x7f1c680b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:35.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.961+0000 7f1c667fc700 1 --2- 172.21.15.112:0/160278813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c680cd100 0x7f1c680cc8c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00d860 tx=0x7f1c5c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:35.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.961+0000 7f1c4effd700 1 -- 172.21.15.112:0/160278813 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c018070 con 0x7f1c680cd100 2023-10-06T04:40:35.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.961+0000 7f1c4effd700 1 -- 172.21.15.112:0/160278813 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c0125f0 con 0x7f1c680cd100 2023-10-06T04:40:35.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.961+0000 7f1c4effd700 1 -- 172.21.15.112:0/160278813 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c0129b0 con 0x7f1c680cd100 2023-10-06T04:40:35.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.961+0000 7f1c67fff700 1 -- 172.21.15.112:0/160278813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6816a1e0 con 0x7f1c680cd100 2023-10-06T04:40:35.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.961+0000 7f1c67fff700 1 -- 172.21.15.112:0/160278813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c680cce00 con 0x7f1c680cd100 2023-10-06T04:40:35.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.962+0000 7f1c67fff700 1 -- 172.21.15.112:0/160278813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6805f230 con 0x7f1c680cd100 2023-10-06T04:40:35.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.962+0000 7f1c4effd700 1 -- 172.21.15.112:0/160278813 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f1c5c012d20 con 0x7f1c680cd100 2023-10-06T04:40:35.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.963+0000 7f1c4effd700 1 --2- 172.21.15.112:0/160278813 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1c540670e0 0x7f1c54069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:35.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.963+0000 7f1c4effd700 1 -- 172.21.15.112:0/160278813 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f1c5c084970 con 0x7f1c680cd100 2023-10-06T04:40:35.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.963+0000 7f1c66ffd700 1 --2- 172.21.15.112:0/160278813 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1c540670e0 0x7f1c54069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:35.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.963+0000 7f1c66ffd700 1 --2- 172.21.15.112:0/160278813 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1c540670e0 0x7f1c54069590 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1c58009880 tx=0x7f1c58018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:35.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:35.967+0000 7f1c4effd700 1 -- 172.21.15.112:0/160278813 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c5c051b00 con 0x7f1c680cd100 2023-10-06T04:40:36.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.149+0000 7f1c67fff700 1 -- 172.21.15.112:0/160278813 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c6816a990 con 0x7f1c540670e0 2023-10-06T04:40:36.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.149+0000 7f1c4effd700 1 -- 172.21.15.112:0/160278813 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1c58021070 con 0x7f1c540670e0 2023-10-06T04:40:36.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.151+0000 7f1c67fff700 1 -- 172.21.15.112:0/160278813 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1c540670e0 msgr2=0x7f1c54069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.151+0000 7f1c67fff700 1 --2- 172.21.15.112:0/160278813 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1c540670e0 0x7f1c54069590 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1c58009880 tx=0x7f1c58018000 comp rx=0 tx=0).stop 2023-10-06T04:40:36.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.151+0000 7f1c67fff700 1 -- 172.21.15.112:0/160278813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c680cd100 msgr2=0x7f1c680cc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.151+0000 7f1c67fff700 1 --2- 172.21.15.112:0/160278813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c680cd100 0x7f1c680cc8c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00d860 tx=0x7f1c5c008040 comp rx=0 tx=0).stop 2023-10-06T04:40:36.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.151+0000 7f1c67fff700 1 -- 172.21.15.112:0/160278813 shutdown_connections 2023-10-06T04:40:36.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.151+0000 7f1c67fff700 1 --2- 172.21.15.112:0/160278813 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f1c540670e0 0x7f1c54069590 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.151+0000 7f1c67fff700 1 --2- 172.21.15.112:0/160278813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c68143270 0x7f1c680b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.151+0000 7f1c67fff700 1 --2- 172.21.15.112:0/160278813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c6806d9a0 0x7f1c68169620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.151+0000 7f1c67fff700 1 --2- 172.21.15.112:0/160278813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c680cd100 0x7f1c680cc8c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.151+0000 7f1c67fff700 1 -- 172.21.15.112:0/160278813 >> 172.21.15.112:0/160278813 conn(0x7f1c6806d2a0 msgr2=0x7f1c680b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:36.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.151+0000 7f1c67fff700 1 -- 172.21.15.112:0/160278813 shutdown_connections 2023-10-06T04:40:36.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.151+0000 7f1c67fff700 1 -- 172.21.15.112:0/160278813 wait complete. 2023-10-06T04:40:36.155 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T04:40:36.165 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T04:40:36.165 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:40:36.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.281+0000 7f88473a1700 1 Processor -- start 2023-10-06T04:40:36.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.281+0000 7f88473a1700 1 -- start start 2023-10-06T04:40:36.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.282+0000 7f88473a1700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88400c5e00 0x7f88400d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.282+0000 7f88473a1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88400c5970 con 0x7f88400d08c0 2023-10-06T04:40:36.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.282+0000 7f88473a1700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88400d0ce0 con 0x7f8840157030 2023-10-06T04:40:36.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.282+0000 7f88473a1700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884015d950 con 0x7f88400c5e00 2023-10-06T04:40:36.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.282+0000 7f8846ba0700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f88400d08c0 0x7f88400cc7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45694/0 (socket says 172.21.15.112:45694) 2023-10-06T04:40:36.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.282+0000 7f8846ba0700 1 -- 172.21.15.112:0/2555889292 learned_addr learned my addr 172.21.15.112:0/2555889292 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:36.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.282+0000 7f8845b9e700 1 --2- 172.21.15.112:0/2555889292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88400c5e00 0x7f88400d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.283+0000 7f884539d700 1 -- 172.21.15.112:0/2555889292 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3658521415 0 0) 0x7f88400c5970 con 0x7f88400d08c0 2023-10-06T04:40:36.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.283+0000 7f884539d700 1 -- 172.21.15.112:0/2555889292 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f882c003570 con 0x7f88400d08c0 2023-10-06T04:40:36.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.283+0000 7f884539d700 1 -- 172.21.15.112:0/2555889292 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167672602 0 0) 0x7f88400d0ce0 con 0x7f8840157030 2023-10-06T04:40:36.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.283+0000 7f884539d700 1 -- 172.21.15.112:0/2555889292 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88400c5970 con 0x7f8840157030 2023-10-06T04:40:36.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.283+0000 7f884539d700 1 -- 172.21.15.112:0/2555889292 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 982872909 0 0) 0x7f882c003570 con 0x7f88400d08c0 2023-10-06T04:40:36.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.283+0000 7f8845b9e700 1 -- 172.21.15.112:0/2555889292 >> v1:172.21.15.179:6789/0 conn(0x7f8840157030 legacy=0x7f884015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.283+0000 7f8845b9e700 1 -- 172.21.15.112:0/2555889292 >> v1:172.21.15.112:6789/0 conn(0x7f88400d08c0 legacy=0x7f88400cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.283+0000 7f8845b9e700 1 -- 172.21.15.112:0/2555889292 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884015dc20 con 0x7f88400c5e00 2023-10-06T04:40:36.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.283+0000 7f8845b9e700 1 --2- 172.21.15.112:0/2555889292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88400c5e00 0x7f88400d0380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8830009910 tx=0x7f88300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a28b501346419269 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.283+0000 7f884539d700 1 -- 172.21.15.112:0/2555889292 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838001470 con 0x7f88400c5e00 2023-10-06T04:40:36.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.283+0000 7f884539d700 1 -- 172.21.15.112:0/2555889292 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8830011420 con 0x7f88400c5e00 2023-10-06T04:40:36.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.283+0000 7f884539d700 1 -- 172.21.15.112:0/2555889292 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88300117c0 con 0x7f88400c5e00 2023-10-06T04:40:36.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.284+0000 7f88473a1700 1 -- 172.21.15.112:0/2555889292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88400c5e00 msgr2=0x7f88400d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.284+0000 7f88473a1700 1 --2- 172.21.15.112:0/2555889292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88400c5e00 0x7f88400d0380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8830009910 tx=0x7f88300091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.284+0000 7f88473a1700 1 -- 172.21.15.112:0/2555889292 shutdown_connections 2023-10-06T04:40:36.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.284+0000 7f88473a1700 1 --2- 172.21.15.112:0/2555889292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88400c5e00 0x7f88400d0380 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.284+0000 7f88473a1700 1 -- 172.21.15.112:0/2555889292 >> 172.21.15.112:0/2555889292 conn(0x7f884006c7d0 msgr2=0x7f884006cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:36.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.284+0000 7f88473a1700 1 -- 172.21.15.112:0/2555889292 shutdown_connections 2023-10-06T04:40:36.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.284+0000 7f88473a1700 1 -- 172.21.15.112:0/2555889292 wait complete. 2023-10-06T04:40:36.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.285+0000 7f88473a1700 1 Processor -- start 2023-10-06T04:40:36.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.285+0000 7f88473a1700 1 -- start start 2023-10-06T04:40:36.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f88473a1700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88400c5e00 0x7f8840155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f88473a1700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88400d08c0 0x7f884015d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f88473a1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8840157030 0x7f8840140e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f88473a1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8840150a10 con 0x7f8840157030 2023-10-06T04:40:36.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f88473a1700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8840151ac0 con 0x7f88400d08c0 2023-10-06T04:40:36.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f88473a1700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8840156640 con 0x7f88400c5e00 2023-10-06T04:40:36.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f8846ba0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8840157030 0x7f8840140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f8846ba0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8840157030 0x7f8840140e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54842/0 (socket says 172.21.15.112:54842) 2023-10-06T04:40:36.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f8846ba0700 1 -- 172.21.15.112:0/3050376272 learned_addr learned my addr 172.21.15.112:0/3050376272 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:36.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f8845b9e700 1 --2- 172.21.15.112:0/3050376272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88400d08c0 0x7f884015d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f8846ba0700 1 -- 172.21.15.112:0/3050376272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88400c5e00 msgr2=0x7f8840155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f884639f700 1 --2- 172.21.15.112:0/3050376272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88400c5e00 0x7f8840155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f8846ba0700 1 --2- 172.21.15.112:0/3050376272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88400c5e00 0x7f8840155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f8846ba0700 1 -- 172.21.15.112:0/3050376272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88400d08c0 msgr2=0x7f884015d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f8846ba0700 1 --2- 172.21.15.112:0/3050376272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88400d08c0 0x7f884015d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f8846ba0700 1 -- 172.21.15.112:0/3050376272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8830009420 con 0x7f8840157030 2023-10-06T04:40:36.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f8845b9e700 1 --2- 172.21.15.112:0/3050376272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88400d08c0 0x7f884015d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:36.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f884639f700 1 --2- 172.21.15.112:0/3050376272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88400c5e00 0x7f8840155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:36.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f8846ba0700 1 --2- 172.21.15.112:0/3050376272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8840157030 0x7f8840140e90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f883800cb90 tx=0x7f8838001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f88367fc700 1 -- 172.21.15.112:0/3050376272 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838001d40 con 0x7f8840157030 2023-10-06T04:40:36.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f88367fc700 1 -- 172.21.15.112:0/3050376272 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8838007360 con 0x7f8840157030 2023-10-06T04:40:36.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f88473a1700 1 -- 172.21.15.112:0/3050376272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8840156360 con 0x7f8840157030 2023-10-06T04:40:36.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f88367fc700 1 -- 172.21.15.112:0/3050376272 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838004830 con 0x7f8840157030 2023-10-06T04:40:36.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.286+0000 7f88473a1700 1 -- 172.21.15.112:0/3050376272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8840151750 con 0x7f8840157030 2023-10-06T04:40:36.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.287+0000 7f88473a1700 1 -- 172.21.15.112:0/3050376272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f884005f230 con 0x7f8840157030 2023-10-06T04:40:36.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.288+0000 7f88367fc700 1 -- 172.21.15.112:0/3050376272 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f8838004c20 con 0x7f8840157030 2023-10-06T04:40:36.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.288+0000 7f88367fc700 1 --2- 172.21.15.112:0/3050376272 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f88240670e0 0x7f8824069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.288+0000 7f88367fc700 1 -- 172.21.15.112:0/3050376272 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8838083b40 con 0x7f8840157030 2023-10-06T04:40:36.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.288+0000 7f884639f700 1 --2- 172.21.15.112:0/3050376272 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f88240670e0 0x7f8824069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.288+0000 7f88367fc700 1 --2- 172.21.15.112:0/3050376272 >> [v2:172.21.15.112:6824/90672,v1:172.21.15.112:6825/90672] conn(0x7f882406d550 0x7f882406f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.288+0000 7f88367fc700 1 -- 172.21.15.112:0/3050376272 --> [v2:172.21.15.112:6824/90672,v1:172.21.15.112:6825/90672] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8824070030 con 0x7f882406d550 2023-10-06T04:40:36.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.288+0000 7f88367fc700 1 -- 172.21.15.112:0/3050376272 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8838088220 con 0x7f8840157030 2023-10-06T04:40:36.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.288+0000 7f8845b9e700 1 --2- 172.21.15.112:0/3050376272 >> [v2:172.21.15.112:6824/90672,v1:172.21.15.112:6825/90672] conn(0x7f882406d550 0x7f882406f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.288+0000 7f884639f700 1 --2- 172.21.15.112:0/3050376272 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f88240670e0 0x7f8824069590 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f88400b0060 tx=0x7f883c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.289+0000 7f8845b9e700 1 --2- 172.21.15.112:0/3050376272 >> [v2:172.21.15.112:6824/90672,v1:172.21.15.112:6825/90672] conn(0x7f882406d550 0x7f882406f960 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.289+0000 7f88367fc700 1 -- 172.21.15.112:0/3050376272 <== osd.3 v2:172.21.15.112:6824/90672 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8824070030 con 0x7f882406d550 2023-10-06T04:40:36.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.303+0000 7f88473a1700 1 -- 172.21.15.112:0/3050376272 --> [v2:172.21.15.112:6824/90672,v1:172.21.15.112:6825/90672] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f884015df00 con 0x7f882406d550 2023-10-06T04:40:36.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.303+0000 7f88367fc700 1 -- 172.21.15.112:0/3050376272 <== osd.3 v2:172.21.15.112:6824/90672 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f884015df00 con 0x7f882406d550 2023-10-06T04:40:36.306 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-10-06T04:40:36.307 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:40:36.307 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-10-06T04:40:36.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.304+0000 7f88473a1700 1 -- 172.21.15.112:0/3050376272 >> [v2:172.21.15.112:6824/90672,v1:172.21.15.112:6825/90672] conn(0x7f882406d550 msgr2=0x7f882406f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.304+0000 7f88473a1700 1 --2- 172.21.15.112:0/3050376272 >> [v2:172.21.15.112:6824/90672,v1:172.21.15.112:6825/90672] conn(0x7f882406d550 0x7f882406f960 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.304+0000 7f88473a1700 1 -- 172.21.15.112:0/3050376272 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f88240670e0 msgr2=0x7f8824069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.304+0000 7f88473a1700 1 --2- 172.21.15.112:0/3050376272 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f88240670e0 0x7f8824069590 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f88400b0060 tx=0x7f883c009040 comp rx=0 tx=0).stop 2023-10-06T04:40:36.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.304+0000 7f88473a1700 1 -- 172.21.15.112:0/3050376272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8840157030 msgr2=0x7f8840140e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.304+0000 7f88473a1700 1 --2- 172.21.15.112:0/3050376272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8840157030 0x7f8840140e90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f883800cb90 tx=0x7f8838001ad0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.304+0000 7f8846ba0700 1 -- 172.21.15.112:0/3050376272 reap_dead start 2023-10-06T04:40:36.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.304+0000 7f88473a1700 1 -- 172.21.15.112:0/3050376272 shutdown_connections 2023-10-06T04:40:36.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.304+0000 7f88473a1700 1 -- 172.21.15.112:0/3050376272 >> 172.21.15.112:0/3050376272 conn(0x7f884006c7d0 msgr2=0x7f88400c9950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:36.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.304+0000 7f88473a1700 1 -- 172.21.15.112:0/3050376272 shutdown_connections 2023-10-06T04:40:36.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.304+0000 7f88473a1700 1 -- 172.21.15.112:0/3050376272 wait complete. 2023-10-06T04:40:36.318 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T04:40:36.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.430+0000 7fd79e634700 1 Processor -- start 2023-10-06T04:40:36.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.430+0000 7fd79e634700 1 -- start start 2023-10-06T04:40:36.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.431+0000 7fd79e634700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd798157580 0x7fd7980cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.431+0000 7fd79e634700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd7980685c0 0x7fd7981611e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.431+0000 7fd79e634700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7980c5240 con 0x7fd7980c40e0 2023-10-06T04:40:36.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.431+0000 7fd79e634700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7980c4630 con 0x7fd7980685c0 2023-10-06T04:40:36.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.431+0000 7fd79e634700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7980c4910 con 0x7fd798157580 2023-10-06T04:40:36.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.431+0000 7fd79cbd1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd7980685c0 0x7fd7981611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.431+0000 7fd7977fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd7980c40e0 0x7fd798067eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45706/0 (socket says 172.21.15.112:45706) 2023-10-06T04:40:36.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.431+0000 7fd7977fe700 1 -- 172.21.15.112:0/3033997189 learned_addr learned my addr 172.21.15.112:0/3033997189 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:36.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.432+0000 7fd797fff700 1 --2- 172.21.15.112:0/3033997189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd798157580 0x7fd7980cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.432+0000 7fd79cbd1700 1 -- 172.21.15.112:0/3033997189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd798157580 msgr2=0x7fd7980cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:36.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.432+0000 7fd79cbd1700 1 --2- 172.21.15.112:0/3033997189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd798157580 0x7fd7980cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.432+0000 7fd79cbd1700 1 -- 172.21.15.112:0/3033997189 >> v1:172.21.15.112:6789/0 conn(0x7fd7980c40e0 legacy=0x7fd798067eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.432+0000 7fd796ffd700 1 -- 172.21.15.112:0/3033997189 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465989875 0 0) 0x7fd7980c5240 con 0x7fd7980c40e0 2023-10-06T04:40:36.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.432+0000 7fd79cbd1700 1 -- 172.21.15.112:0/3033997189 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7980c4bf0 con 0x7fd7980685c0 2023-10-06T04:40:36.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.432+0000 7fd79cbd1700 1 --2- 172.21.15.112:0/3033997189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7980685c0 0x7fd7981611e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd790009e60 tx=0x7fd790009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5474d148320c4e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.432+0000 7fd796ffd700 1 -- 172.21.15.112:0/3033997189 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79000e070 con 0x7fd7980685c0 2023-10-06T04:40:36.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.432+0000 7fd796ffd700 1 -- 172.21.15.112:0/3033997189 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79000bb60 con 0x7fd7980685c0 2023-10-06T04:40:36.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.432+0000 7fd796ffd700 1 -- 172.21.15.112:0/3033997189 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790012430 con 0x7fd7980685c0 2023-10-06T04:40:36.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.432+0000 7fd79e634700 1 -- 172.21.15.112:0/3033997189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7980685c0 msgr2=0x7fd7981611e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.432+0000 7fd79e634700 1 --2- 172.21.15.112:0/3033997189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7980685c0 0x7fd7981611e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd790009e60 tx=0x7fd790009780 comp rx=0 tx=0).stop 2023-10-06T04:40:36.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.433+0000 7fd79e634700 1 -- 172.21.15.112:0/3033997189 shutdown_connections 2023-10-06T04:40:36.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.433+0000 7fd79e634700 1 --2- 172.21.15.112:0/3033997189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7980685c0 0x7fd7981611e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.433+0000 7fd79e634700 1 --2- 172.21.15.112:0/3033997189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd798157580 0x7fd7980cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.433+0000 7fd79e634700 1 -- 172.21.15.112:0/3033997189 >> 172.21.15.112:0/3033997189 conn(0x7fd7980631f0 msgr2=0x7fd7980635f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:36.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.433+0000 7fd79e634700 1 -- 172.21.15.112:0/3033997189 shutdown_connections 2023-10-06T04:40:36.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.433+0000 7fd79e634700 1 -- 172.21.15.112:0/3033997189 wait complete. 2023-10-06T04:40:36.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.434+0000 7fd79e634700 1 Processor -- start 2023-10-06T04:40:36.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.434+0000 7fd79e634700 1 -- start start 2023-10-06T04:40:36.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.435+0000 7fd79e634700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7980685c0 0x7fd798167bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.435+0000 7fd79e634700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7980c40e0 0x7fd7981511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.435+0000 7fd79e634700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd798157580 0x7fd7980cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.435+0000 7fd79e634700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7980c7f30 con 0x7fd7980c40e0 2023-10-06T04:40:36.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.435+0000 7fd79e634700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd798153630 con 0x7fd7980685c0 2023-10-06T04:40:36.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.435+0000 7fd79e634700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd798153ed0 con 0x7fd798157580 2023-10-06T04:40:36.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.435+0000 7fd7977fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7980c40e0 0x7fd7981511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.435+0000 7fd7977fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7980c40e0 0x7fd7981511d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54854/0 (socket says 172.21.15.112:54854) 2023-10-06T04:40:36.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.435+0000 7fd7977fe700 1 -- 172.21.15.112:0/4293975576 learned_addr learned my addr 172.21.15.112:0/4293975576 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:36.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.435+0000 7fd79cbd1700 1 --2- 172.21.15.112:0/4293975576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd798157580 0x7fd7980cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.435+0000 7fd797fff700 1 --2- 172.21.15.112:0/4293975576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7980685c0 0x7fd798167bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.435+0000 7fd7977fe700 1 -- 172.21.15.112:0/4293975576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd798157580 msgr2=0x7fd7980cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.435+0000 7fd7977fe700 1 --2- 172.21.15.112:0/4293975576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd798157580 0x7fd7980cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.435+0000 7fd7977fe700 1 -- 172.21.15.112:0/4293975576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7980685c0 msgr2=0x7fd798167bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.435+0000 7fd7977fe700 1 --2- 172.21.15.112:0/4293975576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7980685c0 0x7fd798167bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.435+0000 7fd7977fe700 1 -- 172.21.15.112:0/4293975576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd790009a20 con 0x7fd7980c40e0 2023-10-06T04:40:36.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.435+0000 7fd797fff700 1 --2- 172.21.15.112:0/4293975576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7980685c0 0x7fd798167bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:36.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.435+0000 7fd7977fe700 1 --2- 172.21.15.112:0/4293975576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7980c40e0 0x7fd7981511d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00c810 tx=0x7fd78c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.435+0000 7fd77ffff700 1 -- 172.21.15.112:0/4293975576 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c005b30 con 0x7fd7980c40e0 2023-10-06T04:40:36.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.435+0000 7fd77ffff700 1 -- 172.21.15.112:0/4293975576 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c005c90 con 0x7fd7980c40e0 2023-10-06T04:40:36.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.435+0000 7fd79e634700 1 -- 172.21.15.112:0/4293975576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd798168110 con 0x7fd7980c40e0 2023-10-06T04:40:36.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.436+0000 7fd77ffff700 1 -- 172.21.15.112:0/4293975576 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0072e0 con 0x7fd7980c40e0 2023-10-06T04:40:36.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.436+0000 7fd79e634700 1 -- 172.21.15.112:0/4293975576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7980c77f0 con 0x7fd7980c40e0 2023-10-06T04:40:36.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.436+0000 7fd79e634700 1 -- 172.21.15.112:0/4293975576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd79805f230 con 0x7fd7980c40e0 2023-10-06T04:40:36.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.437+0000 7fd77ffff700 1 -- 172.21.15.112:0/4293975576 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fd78c0076d0 con 0x7fd7980c40e0 2023-10-06T04:40:36.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.437+0000 7fd77ffff700 1 --2- 172.21.15.112:0/4293975576 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd7840670e0 0x7fd784069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.437+0000 7fd77ffff700 1 -- 172.21.15.112:0/4293975576 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fd78c083ac0 con 0x7fd7980c40e0 2023-10-06T04:40:36.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.437+0000 7fd797fff700 1 --2- 172.21.15.112:0/4293975576 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd7840670e0 0x7fd784069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.438+0000 7fd797fff700 1 --2- 172.21.15.112:0/4293975576 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd7840670e0 0x7fd784069590 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd7980cbd70 tx=0x7fd788008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.441+0000 7fd77ffff700 1 -- 172.21.15.112:0/4293975576 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd78c04b5a0 con 0x7fd7980c40e0 2023-10-06T04:40:36.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.624+0000 7fd79e634700 1 -- 172.21.15.112:0/4293975576 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd798154010 con 0x7fd7840670e0 2023-10-06T04:40:36.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.625+0000 7fd77ffff700 1 -- 172.21.15.112:0/4293975576 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd798154010 con 0x7fd7840670e0 2023-10-06T04:40:36.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.627+0000 7fd79e634700 1 -- 172.21.15.112:0/4293975576 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd7840670e0 msgr2=0x7fd784069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.627+0000 7fd79e634700 1 --2- 172.21.15.112:0/4293975576 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd7840670e0 0x7fd784069590 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd7980cbd70 tx=0x7fd788008040 comp rx=0 tx=0).stop 2023-10-06T04:40:36.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.627+0000 7fd79e634700 1 -- 172.21.15.112:0/4293975576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7980c40e0 msgr2=0x7fd7981511d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.627+0000 7fd79e634700 1 --2- 172.21.15.112:0/4293975576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7980c40e0 0x7fd7981511d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00c810 tx=0x7fd78c007df0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.627+0000 7fd79e634700 1 -- 172.21.15.112:0/4293975576 shutdown_connections 2023-10-06T04:40:36.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.627+0000 7fd79e634700 1 --2- 172.21.15.112:0/4293975576 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd7840670e0 0x7fd784069590 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.627+0000 7fd79e634700 1 --2- 172.21.15.112:0/4293975576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd798157580 0x7fd7980cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.627+0000 7fd79e634700 1 --2- 172.21.15.112:0/4293975576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7980685c0 0x7fd798167bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.627+0000 7fd79e634700 1 --2- 172.21.15.112:0/4293975576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7980c40e0 0x7fd7981511d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.627+0000 7fd79e634700 1 -- 172.21.15.112:0/4293975576 >> 172.21.15.112:0/4293975576 conn(0x7fd7980631f0 msgr2=0x7fd7980c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:36.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.627+0000 7fd79e634700 1 -- 172.21.15.112:0/4293975576 shutdown_connections 2023-10-06T04:40:36.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.627+0000 7fd79e634700 1 -- 172.21.15.112:0/4293975576 wait complete. 2023-10-06T04:40:36.631 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T04:40:36.641 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T04:40:36.641 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:40:36.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.757+0000 7fcac7417700 1 Processor -- start 2023-10-06T04:40:36.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.757+0000 7fcac7417700 1 -- start start 2023-10-06T04:40:36.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.758+0000 7fcac7417700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac00cbf00 0x7fcac015b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.758+0000 7fcac7417700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac015af50 con 0x7fcac006d3b0 2023-10-06T04:40:36.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.758+0000 7fcac7417700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac00cae50 con 0x7fcac0159a20 2023-10-06T04:40:36.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.758+0000 7fcac7417700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00cca70 con 0x7fcac00cbf00 2023-10-06T04:40:36.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.758+0000 7fcac59b4700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fcac006d3b0 0x7fcac015bc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45720/0 (socket says 172.21.15.112:45720) 2023-10-06T04:40:36.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.758+0000 7fcac59b4700 1 -- 172.21.15.112:0/956259017 learned_addr learned my addr 172.21.15.112:0/956259017 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:36.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.758+0000 7fcac49b2700 1 --2- 172.21.15.112:0/956259017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac00cbf00 0x7fcac015b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.758+0000 7fcab7fff700 1 -- 172.21.15.112:0/956259017 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 692922619 0 0) 0x7fcac015af50 con 0x7fcac006d3b0 2023-10-06T04:40:36.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcab7fff700 1 -- 172.21.15.112:0/956259017 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaac003570 con 0x7fcac006d3b0 2023-10-06T04:40:36.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcab7fff700 1 -- 172.21.15.112:0/956259017 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4150400172 0 0) 0x7fcaac003570 con 0x7fcac006d3b0 2023-10-06T04:40:36.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcab7fff700 1 -- 172.21.15.112:0/956259017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac00cbf00 msgr2=0x7fcac015b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:36.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcab7fff700 1 --2- 172.21.15.112:0/956259017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac00cbf00 0x7fcac015b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcab7fff700 1 -- 172.21.15.112:0/956259017 >> v1:172.21.15.179:6789/0 conn(0x7fcac0159a20 legacy=0x7fcac00cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcab7fff700 1 -- 172.21.15.112:0/956259017 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac00cb0f0 con 0x7fcac006d3b0 2023-10-06T04:40:36.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcab7fff700 1 -- 172.21.15.112:0/956259017 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7fcab80017f0 con 0x7fcac006d3b0 2023-10-06T04:40:36.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcab7fff700 1 -- 172.21.15.112:0/956259017 >> v1:172.21.15.112:6789/0 conn(0x7fcac006d3b0 legacy=0x7fcac015bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcab7fff700 1 --2- 172.21.15.112:0/956259017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac00cbf00 0x7fcaac003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcab7fff700 1 --2- 172.21.15.112:0/956259017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaac004010 0x7fcaac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcab7fff700 1 --2- 172.21.15.112:0/956259017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcaac004d50 0x7fcaac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcab7fff700 1 -- 172.21.15.112:0/956259017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00cca70 con 0x7fcaac004d50 2023-10-06T04:40:36.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcab7fff700 1 -- 172.21.15.112:0/956259017 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac00bbf0 con 0x7fcaac004010 2023-10-06T04:40:36.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcab7fff700 1 -- 172.21.15.112:0/956259017 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac00bdb0 con 0x7fcac00cbf00 2023-10-06T04:40:36.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcac59b4700 1 --2- 172.21.15.112:0/956259017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcaac004d50 0x7fcaac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcac49b2700 1 --2- 172.21.15.112:0/956259017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaac004010 0x7fcaac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcac51b3700 1 --2- 172.21.15.112:0/956259017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac00cbf00 0x7fcaac003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcac59b4700 1 -- 172.21.15.112:0/956259017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac00cbf00 msgr2=0x7fcaac003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:36.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcac59b4700 1 --2- 172.21.15.112:0/956259017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac00cbf00 0x7fcaac003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcac59b4700 1 -- 172.21.15.112:0/956259017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaac004010 msgr2=0x7fcaac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:36.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcac59b4700 1 --2- 172.21.15.112:0/956259017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaac004010 0x7fcaac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcac59b4700 1 -- 172.21.15.112:0/956259017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac003570 con 0x7fcaac004d50 2023-10-06T04:40:36.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.759+0000 7fcac59b4700 1 --2- 172.21.15.112:0/956259017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcaac004d50 0x7fcaac0051c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fcac006d7b0 tx=0x7fcab80021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc81201dd0c61558 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.760+0000 7fcab7fff700 1 -- 172.21.15.112:0/956259017 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab80070d0 con 0x7fcaac004d50 2023-10-06T04:40:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.760+0000 7fcab7fff700 1 -- 172.21.15.112:0/956259017 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab8007230 con 0x7fcaac004d50 2023-10-06T04:40:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.760+0000 7fcab7fff700 1 -- 172.21.15.112:0/956259017 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab80075f0 con 0x7fcaac004d50 2023-10-06T04:40:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.760+0000 7fcac7417700 1 -- 172.21.15.112:0/956259017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcaac004d50 msgr2=0x7fcaac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.760+0000 7fcac7417700 1 --2- 172.21.15.112:0/956259017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcaac004d50 0x7fcaac0051c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fcac006d7b0 tx=0x7fcab80021d0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.760+0000 7fcac59b4700 1 -- 172.21.15.112:0/956259017 reap_dead start 2023-10-06T04:40:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.760+0000 7fcac7417700 1 -- 172.21.15.112:0/956259017 shutdown_connections 2023-10-06T04:40:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.760+0000 7fcac7417700 1 -- 172.21.15.112:0/956259017 >> 172.21.15.112:0/956259017 conn(0x7fcac006cfb0 msgr2=0x7fcac00d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.760+0000 7fcac7417700 1 -- 172.21.15.112:0/956259017 shutdown_connections 2023-10-06T04:40:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.760+0000 7fcac7417700 1 -- 172.21.15.112:0/956259017 wait complete. 2023-10-06T04:40:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.761+0000 7fcac7417700 1 Processor -- start 2023-10-06T04:40:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.761+0000 7fcac7417700 1 -- start start 2023-10-06T04:40:36.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.762+0000 7fcac7417700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcaac004d50 0x7fcac00b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.762+0000 7fcac7417700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcac00b60b0 0x7fcac006df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.762+0000 7fcac7417700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac006e440 0x7fcac0152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.762+0000 7fcac7417700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00b4220 con 0x7fcaac004d50 2023-10-06T04:40:36.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.762+0000 7fcac7417700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00b49f0 con 0x7fcac00b60b0 2023-10-06T04:40:36.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.762+0000 7fcac7417700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac0155fb0 con 0x7fcac006e440 2023-10-06T04:40:36.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.762+0000 7fcac51b3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcaac004d50 0x7fcac00b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.762+0000 7fcac51b3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcaac004d50 0x7fcac00b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54882/0 (socket says 172.21.15.112:54882) 2023-10-06T04:40:36.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.762+0000 7fcac51b3700 1 -- 172.21.15.112:0/3955112670 learned_addr learned my addr 172.21.15.112:0/3955112670 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:36.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.762+0000 7fcac51b3700 1 -- 172.21.15.112:0/3955112670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac006e440 msgr2=0x7fcac0152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.762+0000 7fcac59b4700 1 --2- 172.21.15.112:0/3955112670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac006e440 0x7fcac0152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.762+0000 7fcac49b2700 1 --2- 172.21.15.112:0/3955112670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcac00b60b0 0x7fcac006df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.762+0000 7fcac51b3700 1 --2- 172.21.15.112:0/3955112670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac006e440 0x7fcac0152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.762+0000 7fcac51b3700 1 -- 172.21.15.112:0/3955112670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcac00b60b0 msgr2=0x7fcac006df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.762+0000 7fcac51b3700 1 --2- 172.21.15.112:0/3955112670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcac00b60b0 0x7fcac006df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.762+0000 7fcac51b3700 1 -- 172.21.15.112:0/3955112670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac00b4430 con 0x7fcaac004d50 2023-10-06T04:40:36.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.762+0000 7fcac59b4700 1 --2- 172.21.15.112:0/3955112670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac006e440 0x7fcac0152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:36.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.762+0000 7fcac49b2700 1 --2- 172.21.15.112:0/3955112670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcac00b60b0 0x7fcac006df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:36.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.763+0000 7fcac51b3700 1 --2- 172.21.15.112:0/3955112670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcaac004d50 0x7fcac00b5b70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fcabc002950 tx=0x7fcabc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.763+0000 7fcab57fa700 1 -- 172.21.15.112:0/3955112670 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00f8d0 con 0x7fcaac004d50 2023-10-06T04:40:36.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.763+0000 7fcab57fa700 1 -- 172.21.15.112:0/3955112670 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc00fa30 con 0x7fcaac004d50 2023-10-06T04:40:36.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.763+0000 7fcab57fa700 1 -- 172.21.15.112:0/3955112670 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00fdf0 con 0x7fcaac004d50 2023-10-06T04:40:36.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.763+0000 7fcac7417700 1 -- 172.21.15.112:0/3955112670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac00b4710 con 0x7fcaac004d50 2023-10-06T04:40:36.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.763+0000 7fcac7417700 1 -- 172.21.15.112:0/3955112670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac00b57e0 con 0x7fcaac004d50 2023-10-06T04:40:36.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.764+0000 7fcac7417700 1 -- 172.21.15.112:0/3955112670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcac005f230 con 0x7fcaac004d50 2023-10-06T04:40:36.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.764+0000 7fcab57fa700 1 -- 172.21.15.112:0/3955112670 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fcabc013600 con 0x7fcaac004d50 2023-10-06T04:40:36.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.764+0000 7fcab57fa700 1 --2- 172.21.15.112:0/3955112670 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcaa40670e0 0x7fcaa4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.765+0000 7fcab57fa700 1 -- 172.21.15.112:0/3955112670 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fcabc084b90 con 0x7fcaac004d50 2023-10-06T04:40:36.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.765+0000 7fcac49b2700 1 --2- 172.21.15.112:0/3955112670 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcaa40670e0 0x7fcaa4069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.765+0000 7fcab57fa700 1 --2- 172.21.15.112:0/3955112670 >> [v2:172.21.15.179:6800/90848,v1:172.21.15.179:6801/90848] conn(0x7fcaa406d550 0x7fcaa406f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.765+0000 7fcab57fa700 1 -- 172.21.15.112:0/3955112670 --> [v2:172.21.15.179:6800/90848,v1:172.21.15.179:6801/90848] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcaa4070030 con 0x7fcaa406d550 2023-10-06T04:40:36.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.765+0000 7fcab57fa700 1 -- 172.21.15.112:0/3955112670 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcabc089220 con 0x7fcaac004d50 2023-10-06T04:40:36.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.765+0000 7fcac49b2700 1 --2- 172.21.15.112:0/3955112670 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcaa40670e0 0x7fcaa4069590 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcab00093f0 tx=0x7fcab0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.765+0000 7fcac59b4700 1 --2- 172.21.15.112:0/3955112670 >> [v2:172.21.15.179:6800/90848,v1:172.21.15.179:6801/90848] conn(0x7fcaa406d550 0x7fcaa406f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.765+0000 7fcac59b4700 1 --2- 172.21.15.112:0/3955112670 >> [v2:172.21.15.179:6800/90848,v1:172.21.15.179:6801/90848] conn(0x7fcaa406d550 0x7fcaa406f960 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.766+0000 7fcab57fa700 1 -- 172.21.15.112:0/3955112670 <== osd.4 v2:172.21.15.179:6800/90848 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fcaa4070030 con 0x7fcaa406d550 2023-10-06T04:40:36.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.780+0000 7fcac7417700 1 -- 172.21.15.112:0/3955112670 --> [v2:172.21.15.179:6800/90848,v1:172.21.15.179:6801/90848] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcac009e400 con 0x7fcaa406d550 2023-10-06T04:40:36.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.780+0000 7fcab57fa700 1 -- 172.21.15.112:0/3955112670 <== osd.4 v2:172.21.15.179:6800/90848 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcac009e400 con 0x7fcaa406d550 2023-10-06T04:40:36.783 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-10-06T04:40:36.783 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:40:36.783 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-10-06T04:40:36.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.781+0000 7fcac7417700 1 -- 172.21.15.112:0/3955112670 >> [v2:172.21.15.179:6800/90848,v1:172.21.15.179:6801/90848] conn(0x7fcaa406d550 msgr2=0x7fcaa406f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.781+0000 7fcac7417700 1 --2- 172.21.15.112:0/3955112670 >> [v2:172.21.15.179:6800/90848,v1:172.21.15.179:6801/90848] conn(0x7fcaa406d550 0x7fcaa406f960 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.781+0000 7fcac7417700 1 -- 172.21.15.112:0/3955112670 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcaa40670e0 msgr2=0x7fcaa4069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.781+0000 7fcac7417700 1 --2- 172.21.15.112:0/3955112670 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fcaa40670e0 0x7fcaa4069590 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcab00093f0 tx=0x7fcab0008040 comp rx=0 tx=0).stop 2023-10-06T04:40:36.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.781+0000 7fcac7417700 1 -- 172.21.15.112:0/3955112670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcaac004d50 msgr2=0x7fcac00b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.781+0000 7fcac7417700 1 --2- 172.21.15.112:0/3955112670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcaac004d50 0x7fcac00b5b70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fcabc002950 tx=0x7fcabc007d30 comp rx=0 tx=0).stop 2023-10-06T04:40:36.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.781+0000 7fcac59b4700 1 -- 172.21.15.112:0/3955112670 reap_dead start 2023-10-06T04:40:36.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.781+0000 7fcac7417700 1 -- 172.21.15.112:0/3955112670 shutdown_connections 2023-10-06T04:40:36.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.781+0000 7fcac7417700 1 -- 172.21.15.112:0/3955112670 >> 172.21.15.112:0/3955112670 conn(0x7fcac006cfb0 msgr2=0x7fcac00b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:36.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.781+0000 7fcac7417700 1 -- 172.21.15.112:0/3955112670 shutdown_connections 2023-10-06T04:40:36.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.781+0000 7fcac7417700 1 -- 172.21.15.112:0/3955112670 wait complete. 2023-10-06T04:40:36.795 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T04:40:36.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.908+0000 7f7b91ea7700 1 Processor -- start 2023-10-06T04:40:36.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.908+0000 7f7b91ea7700 1 -- start start 2023-10-06T04:40:36.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.909+0000 7f7b91ea7700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b8c068350 0x7f7b8c159720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.909+0000 7f7b91ea7700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b8c15b500 con 0x7f7b8c15aa00 2023-10-06T04:40:36.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.909+0000 7f7b91ea7700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b8c15b7e0 con 0x7f7b8c067eb0 2023-10-06T04:40:36.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.909+0000 7f7b91ea7700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c15bac0 con 0x7f7b8c068350 2023-10-06T04:40:36.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.909+0000 7f7b8b7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7b8c15aa00 0x7f7b8c1585f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45736/0 (socket says 172.21.15.112:45736) 2023-10-06T04:40:36.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.909+0000 7f7b8b7fe700 1 -- 172.21.15.112:0/1818139267 learned_addr learned my addr 172.21.15.112:0/1818139267 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:36.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.909+0000 7f7b8bfff700 1 --2- 172.21.15.112:0/1818139267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b8c068350 0x7f7b8c159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.909+0000 7f7b8a7fc700 1 -- 172.21.15.112:0/1818139267 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2501757286 0 0) 0x7f7b8c15b500 con 0x7f7b8c15aa00 2023-10-06T04:40:36.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.910+0000 7f7b8a7fc700 1 -- 172.21.15.112:0/1818139267 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b74003570 con 0x7f7b8c15aa00 2023-10-06T04:40:36.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.910+0000 7f7b8a7fc700 1 -- 172.21.15.112:0/1818139267 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1067158422 0 0) 0x7f7b8c15b7e0 con 0x7f7b8c067eb0 2023-10-06T04:40:36.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.910+0000 7f7b8a7fc700 1 -- 172.21.15.112:0/1818139267 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b8c15b500 con 0x7f7b8c067eb0 2023-10-06T04:40:36.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.910+0000 7f7b8bfff700 1 -- 172.21.15.112:0/1818139267 >> v1:172.21.15.179:6789/0 conn(0x7f7b8c067eb0 legacy=0x7f7b8c159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.910+0000 7f7b8bfff700 1 -- 172.21.15.112:0/1818139267 >> v1:172.21.15.112:6789/0 conn(0x7f7b8c15aa00 legacy=0x7f7b8c1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.910+0000 7f7b8a7fc700 1 -- 172.21.15.112:0/1818139267 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 924915724 0 0) 0x7f7b74003570 con 0x7f7b8c15aa00 2023-10-06T04:40:36.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.910+0000 7f7b8bfff700 1 -- 172.21.15.112:0/1818139267 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c15bda0 con 0x7f7b8c068350 2023-10-06T04:40:36.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.910+0000 7f7b8bfff700 1 --2- 172.21.15.112:0/1818139267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b8c068350 0x7f7b8c159720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009e90 tx=0x7f7b84009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee6e8af6fd14571b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.910+0000 7f7b8a7fc700 1 -- 172.21.15.112:0/1818139267 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8400e070 con 0x7f7b8c068350 2023-10-06T04:40:36.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.910+0000 7f7b8a7fc700 1 -- 172.21.15.112:0/1818139267 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8400b870 con 0x7f7b8c068350 2023-10-06T04:40:36.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.910+0000 7f7b8a7fc700 1 -- 172.21.15.112:0/1818139267 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c001470 con 0x7f7b8c068350 2023-10-06T04:40:36.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.911+0000 7f7b91ea7700 1 -- 172.21.15.112:0/1818139267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b8c068350 msgr2=0x7f7b8c159720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.911+0000 7f7b91ea7700 1 --2- 172.21.15.112:0/1818139267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b8c068350 0x7f7b8c159720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009e90 tx=0x7f7b84009780 comp rx=0 tx=0).stop 2023-10-06T04:40:36.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.911+0000 7f7b91ea7700 1 -- 172.21.15.112:0/1818139267 shutdown_connections 2023-10-06T04:40:36.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.911+0000 7f7b91ea7700 1 --2- 172.21.15.112:0/1818139267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b8c068350 0x7f7b8c159720 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.911+0000 7f7b91ea7700 1 -- 172.21.15.112:0/1818139267 >> 172.21.15.112:0/1818139267 conn(0x7f7b8c0ce5e0 msgr2=0x7f7b8c0ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:36.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.911+0000 7f7b91ea7700 1 -- 172.21.15.112:0/1818139267 shutdown_connections 2023-10-06T04:40:36.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.911+0000 7f7b91ea7700 1 -- 172.21.15.112:0/1818139267 wait complete. 2023-10-06T04:40:36.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.912+0000 7f7b91ea7700 1 Processor -- start 2023-10-06T04:40:36.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.912+0000 7f7b91ea7700 1 -- start start 2023-10-06T04:40:36.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.913+0000 7f7b91ea7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b8c067eb0 0x7f7b8c0c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.913+0000 7f7b91ea7700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b8c068350 0x7f7b8c0c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.913+0000 7f7b91ea7700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b8c15aa00 0x7f7b8c0c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.913+0000 7f7b91ea7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c0c25c0 con 0x7f7b8c067eb0 2023-10-06T04:40:36.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.913+0000 7f7b91ea7700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c15d290 con 0x7f7b8c068350 2023-10-06T04:40:36.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.913+0000 7f7b91ea7700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c15d570 con 0x7f7b8c15aa00 2023-10-06T04:40:36.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.913+0000 7f7b8b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b8c067eb0 0x7f7b8c0c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.913+0000 7f7b8b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b8c067eb0 0x7f7b8c0c58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54898/0 (socket says 172.21.15.112:54898) 2023-10-06T04:40:36.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.913+0000 7f7b8b7fe700 1 -- 172.21.15.112:0/2369414508 learned_addr learned my addr 172.21.15.112:0/2369414508 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:36.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.913+0000 7f7b8b7fe700 1 -- 172.21.15.112:0/2369414508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b8c15aa00 msgr2=0x7f7b8c0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.913+0000 7f7b8b7fe700 1 --2- 172.21.15.112:0/2369414508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b8c15aa00 0x7f7b8c0c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.913+0000 7f7b8b7fe700 1 -- 172.21.15.112:0/2369414508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b8c068350 msgr2=0x7f7b8c0c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:36.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.913+0000 7f7b8b7fe700 1 --2- 172.21.15.112:0/2369414508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b8c068350 0x7f7b8c0c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:36.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.913+0000 7f7b8b7fe700 1 -- 172.21.15.112:0/2369414508 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b84009a20 con 0x7f7b8c067eb0 2023-10-06T04:40:36.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.913+0000 7f7b8b7fe700 1 --2- 172.21.15.112:0/2369414508 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b8c067eb0 0x7f7b8c0c58e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00c860 tx=0x7f7b7c001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.913+0000 7f7b737fe700 1 -- 172.21.15.112:0/2369414508 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c007360 con 0x7f7b8c067eb0 2023-10-06T04:40:36.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.913+0000 7f7b737fe700 1 -- 172.21.15.112:0/2369414508 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7c0074c0 con 0x7f7b8c067eb0 2023-10-06T04:40:36.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.913+0000 7f7b91ea7700 1 -- 172.21.15.112:0/2369414508 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8c15d850 con 0x7f7b8c067eb0 2023-10-06T04:40:36.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.913+0000 7f7b737fe700 1 -- 172.21.15.112:0/2369414508 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c004830 con 0x7f7b8c067eb0 2023-10-06T04:40:36.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.913+0000 7f7b91ea7700 1 -- 172.21.15.112:0/2369414508 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8c0c5e20 con 0x7f7b8c067eb0 2023-10-06T04:40:36.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.914+0000 7f7b91ea7700 1 -- 172.21.15.112:0/2369414508 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8c05f230 con 0x7f7b8c067eb0 2023-10-06T04:40:36.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.915+0000 7f7b737fe700 1 -- 172.21.15.112:0/2369414508 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f7b7c004bc0 con 0x7f7b8c067eb0 2023-10-06T04:40:36.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.915+0000 7f7b737fe700 1 --2- 172.21.15.112:0/2369414508 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7b780670e0 0x7f7b78069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:36.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.915+0000 7f7b737fe700 1 -- 172.21.15.112:0/2369414508 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f7b7c083da0 con 0x7f7b8c067eb0 2023-10-06T04:40:36.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.915+0000 7f7b8affd700 1 --2- 172.21.15.112:0/2369414508 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7b780670e0 0x7f7b78069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:36.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.916+0000 7f7b8affd700 1 --2- 172.21.15.112:0/2369414508 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7b780670e0 0x7f7b78069590 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c0cd5c0 tx=0x7f7b800079d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:36.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:36.919+0000 7f7b737fe700 1 -- 172.21.15.112:0/2369414508 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b7c050fb0 con 0x7f7b8c067eb0 2023-10-06T04:40:37.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.105+0000 7f7b91ea7700 1 -- 172.21.15.112:0/2369414508 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b8c0c2700 con 0x7f7b780670e0 2023-10-06T04:40:37.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.105+0000 7f7b737fe700 1 -- 172.21.15.112:0/2369414508 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7b80014400 con 0x7f7b780670e0 2023-10-06T04:40:37.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.107+0000 7f7b91ea7700 1 -- 172.21.15.112:0/2369414508 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7b780670e0 msgr2=0x7f7b78069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.107+0000 7f7b91ea7700 1 --2- 172.21.15.112:0/2369414508 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7b780670e0 0x7f7b78069590 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c0cd5c0 tx=0x7f7b800079d0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.107+0000 7f7b91ea7700 1 -- 172.21.15.112:0/2369414508 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b8c067eb0 msgr2=0x7f7b8c0c58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.107+0000 7f7b91ea7700 1 --2- 172.21.15.112:0/2369414508 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b8c067eb0 0x7f7b8c0c58e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00c860 tx=0x7f7b7c001a30 comp rx=0 tx=0).stop 2023-10-06T04:40:37.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.107+0000 7f7b91ea7700 1 -- 172.21.15.112:0/2369414508 shutdown_connections 2023-10-06T04:40:37.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.107+0000 7f7b91ea7700 1 --2- 172.21.15.112:0/2369414508 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f7b780670e0 0x7f7b78069590 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.107+0000 7f7b91ea7700 1 --2- 172.21.15.112:0/2369414508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b8c15aa00 0x7f7b8c0c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.107+0000 7f7b91ea7700 1 --2- 172.21.15.112:0/2369414508 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b8c067eb0 0x7f7b8c0c58e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.107+0000 7f7b91ea7700 1 --2- 172.21.15.112:0/2369414508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b8c068350 0x7f7b8c0c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.107+0000 7f7b91ea7700 1 -- 172.21.15.112:0/2369414508 >> 172.21.15.112:0/2369414508 conn(0x7f7b8c0ce5e0 msgr2=0x7f7b8c0cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:37.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.107+0000 7f7b91ea7700 1 -- 172.21.15.112:0/2369414508 shutdown_connections 2023-10-06T04:40:37.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.107+0000 7f7b91ea7700 1 -- 172.21.15.112:0/2369414508 wait complete. 2023-10-06T04:40:37.111 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T04:40:37.121 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T04:40:37.122 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:40:37.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.237+0000 7fb4f8ab6700 1 Processor -- start 2023-10-06T04:40:37.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.237+0000 7fb4f8ab6700 1 -- start start 2023-10-06T04:40:37.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.238+0000 7fb4f8ab6700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f4155370 0x7fb4f4067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.238+0000 7fb4f8ab6700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f415c0e0 con 0x7fb4f40684e0 2023-10-06T04:40:37.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.238+0000 7fb4f8ab6700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f415b1f0 con 0x7fb4f4154fa0 2023-10-06T04:40:37.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.238+0000 7fb4f8ab6700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f4068980 con 0x7fb4f4155370 2023-10-06T04:40:37.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.238+0000 7fb4f2d9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb4f40684e0 0x7fb4f40b2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45740/0 (socket says 172.21.15.112:45740) 2023-10-06T04:40:37.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.238+0000 7fb4f2d9d700 1 -- 172.21.15.112:0/3431742339 learned_addr learned my addr 172.21.15.112:0/3431742339 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:37.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.238+0000 7fb4e9d9b700 1 --2- 172.21.15.112:0/3431742339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f4155370 0x7fb4f4067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.238+0000 7fb4f1d9b700 1 -- 172.21.15.112:0/3431742339 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854355766 0 0) 0x7fb4f415c0e0 con 0x7fb4f40684e0 2023-10-06T04:40:37.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f1d9b700 1 -- 172.21.15.112:0/3431742339 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4e0003570 con 0x7fb4f40684e0 2023-10-06T04:40:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f1d9b700 1 -- 172.21.15.112:0/3431742339 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 492336984 0 0) 0x7fb4e0003570 con 0x7fb4f40684e0 2023-10-06T04:40:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f1d9b700 1 -- 172.21.15.112:0/3431742339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f4155370 msgr2=0x7fb4f4067fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f1d9b700 1 --2- 172.21.15.112:0/3431742339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f4155370 0x7fb4f4067fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f1d9b700 1 -- 172.21.15.112:0/3431742339 >> v1:172.21.15.179:6789/0 conn(0x7fb4f4154fa0 legacy=0x7fb4f4158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f1d9b700 1 -- 172.21.15.112:0/3431742339 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f415b4d0 con 0x7fb4f40684e0 2023-10-06T04:40:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f1d9b700 1 -- 172.21.15.112:0/3431742339 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7fb4ec0017f0 con 0x7fb4f40684e0 2023-10-06T04:40:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f1d9b700 1 -- 172.21.15.112:0/3431742339 >> v1:172.21.15.112:6789/0 conn(0x7fb4f40684e0 legacy=0x7fb4f40b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f1d9b700 1 --2- 172.21.15.112:0/3431742339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f4155370 0x7fb4e0003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f1d9b700 1 --2- 172.21.15.112:0/3431742339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4e0004010 0x7fb4e0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f1d9b700 1 --2- 172.21.15.112:0/3431742339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4e0004d50 0x7fb4e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f1d9b700 1 -- 172.21.15.112:0/3431742339 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f4068980 con 0x7fb4e0004d50 2023-10-06T04:40:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f1d9b700 1 -- 172.21.15.112:0/3431742339 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e000bbf0 con 0x7fb4e0004010 2023-10-06T04:40:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f1d9b700 1 -- 172.21.15.112:0/3431742339 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e000bdb0 con 0x7fb4f4155370 2023-10-06T04:40:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f2d9d700 1 --2- 172.21.15.112:0/3431742339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4e0004d50 0x7fb4e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4e9d9b700 1 --2- 172.21.15.112:0/3431742339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4e0004010 0x7fb4e0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f259c700 1 --2- 172.21.15.112:0/3431742339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f4155370 0x7fb4e0003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f2d9d700 1 -- 172.21.15.112:0/3431742339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f4155370 msgr2=0x7fb4e0003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f2d9d700 1 --2- 172.21.15.112:0/3431742339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f4155370 0x7fb4e0003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f2d9d700 1 -- 172.21.15.112:0/3431742339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4e0004010 msgr2=0x7fb4e0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:37.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f2d9d700 1 --2- 172.21.15.112:0/3431742339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4e0004010 0x7fb4e0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f2d9d700 1 -- 172.21.15.112:0/3431742339 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e0003570 con 0x7fb4e0004d50 2023-10-06T04:40:37.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f2d9d700 1 --2- 172.21.15.112:0/3431742339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4e0004d50 0x7fb4e00051c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec00a900 tx=0x7fb4ec0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faefe815cd202be5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:37.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f1d9b700 1 -- 172.21.15.112:0/3431742339 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec0070d0 con 0x7fb4e0004d50 2023-10-06T04:40:37.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f1d9b700 1 -- 172.21.15.112:0/3431742339 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ec007250 con 0x7fb4e0004d50 2023-10-06T04:40:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.239+0000 7fb4f1d9b700 1 -- 172.21.15.112:0/3431742339 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec007610 con 0x7fb4e0004d50 2023-10-06T04:40:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.240+0000 7fb4f8ab6700 1 -- 172.21.15.112:0/3431742339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4e0004d50 msgr2=0x7fb4e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.240+0000 7fb4f8ab6700 1 --2- 172.21.15.112:0/3431742339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4e0004d50 0x7fb4e00051c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec00a900 tx=0x7fb4ec0021d0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.240+0000 7fb4f2d9d700 1 -- 172.21.15.112:0/3431742339 reap_dead start 2023-10-06T04:40:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.240+0000 7fb4f8ab6700 1 -- 172.21.15.112:0/3431742339 shutdown_connections 2023-10-06T04:40:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.240+0000 7fb4f8ab6700 1 -- 172.21.15.112:0/3431742339 >> 172.21.15.112:0/3431742339 conn(0x7fb4f40631f0 msgr2=0x7fb4f40635f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.240+0000 7fb4f8ab6700 1 -- 172.21.15.112:0/3431742339 shutdown_connections 2023-10-06T04:40:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.240+0000 7fb4f8ab6700 1 -- 172.21.15.112:0/3431742339 wait complete. 2023-10-06T04:40:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.241+0000 7fb4f8ab6700 1 Processor -- start 2023-10-06T04:40:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.241+0000 7fb4f8ab6700 1 -- start start 2023-10-06T04:40:37.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.242+0000 7fb4f8ab6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4e0004d50 0x7fb4f4159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.242+0000 7fb4f8ab6700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4f41507f0 0x7fb4f41534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.242+0000 7fb4f8ab6700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f41539e0 0x7fb4f4157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.242+0000 7fb4f8ab6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f40ca8c0 con 0x7fb4e0004d50 2023-10-06T04:40:37.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.242+0000 7fb4f8ab6700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f4153e50 con 0x7fb4f41507f0 2023-10-06T04:40:37.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.242+0000 7fb4f8ab6700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f41594a0 con 0x7fb4f41539e0 2023-10-06T04:40:37.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.242+0000 7fb4f259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4e0004d50 0x7fb4f4159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.242+0000 7fb4f259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4e0004d50 0x7fb4f4159930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54920/0 (socket says 172.21.15.112:54920) 2023-10-06T04:40:37.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.242+0000 7fb4f259c700 1 -- 172.21.15.112:0/2571113477 learned_addr learned my addr 172.21.15.112:0/2571113477 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:37.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.242+0000 7fb4e9d9b700 1 --2- 172.21.15.112:0/2571113477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4f41507f0 0x7fb4f41534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.242+0000 7fb4f2d9d700 1 --2- 172.21.15.112:0/2571113477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f41539e0 0x7fb4f4157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.242+0000 7fb4f259c700 1 -- 172.21.15.112:0/2571113477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f41539e0 msgr2=0x7fb4f4157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.242+0000 7fb4f259c700 1 --2- 172.21.15.112:0/2571113477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f41539e0 0x7fb4f4157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.242+0000 7fb4f259c700 1 -- 172.21.15.112:0/2571113477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4f41507f0 msgr2=0x7fb4f41534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.242+0000 7fb4f259c700 1 --2- 172.21.15.112:0/2571113477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4f41507f0 0x7fb4f41534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.242+0000 7fb4f259c700 1 -- 172.21.15.112:0/2571113477 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f4159e70 con 0x7fb4e0004d50 2023-10-06T04:40:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.242+0000 7fb4e9d9b700 1 --2- 172.21.15.112:0/2571113477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4f41507f0 0x7fb4f41534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.242+0000 7fb4f259c700 1 --2- 172.21.15.112:0/2571113477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4e0004d50 0x7fb4f4159930 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40029a0 tx=0x7fb4e4007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.243+0000 7fb4eaffd700 1 -- 172.21.15.112:0/2571113477 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e400f8d0 con 0x7fb4e0004d50 2023-10-06T04:40:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.243+0000 7fb4eaffd700 1 -- 172.21.15.112:0/2571113477 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e400fa30 con 0x7fb4e0004d50 2023-10-06T04:40:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.243+0000 7fb4eaffd700 1 -- 172.21.15.112:0/2571113477 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e400fdd0 con 0x7fb4e0004d50 2023-10-06T04:40:37.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.243+0000 7fb4f8ab6700 1 -- 172.21.15.112:0/2571113477 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f4158890 con 0x7fb4e0004d50 2023-10-06T04:40:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.243+0000 7fb4f8ab6700 1 -- 172.21.15.112:0/2571113477 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f4158e50 con 0x7fb4e0004d50 2023-10-06T04:40:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.243+0000 7fb4f8ab6700 1 -- 172.21.15.112:0/2571113477 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb4f405f230 con 0x7fb4e0004d50 2023-10-06T04:40:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.244+0000 7fb4eaffd700 1 -- 172.21.15.112:0/2571113477 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fb4e4013600 con 0x7fb4e0004d50 2023-10-06T04:40:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.244+0000 7fb4eaffd700 1 --2- 172.21.15.112:0/2571113477 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb4d40670e0 0x7fb4d4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.244+0000 7fb4eaffd700 1 -- 172.21.15.112:0/2571113477 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fb4e4084c20 con 0x7fb4e0004d50 2023-10-06T04:40:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.244+0000 7fb4e9d9b700 1 --2- 172.21.15.112:0/2571113477 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb4d40670e0 0x7fb4d4069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.244+0000 7fb4eaffd700 1 --2- 172.21.15.112:0/2571113477 >> [v2:172.21.15.179:6816/90872,v1:172.21.15.179:6817/90872] conn(0x7fb4d406d550 0x7fb4d406f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.244+0000 7fb4eaffd700 1 -- 172.21.15.112:0/2571113477 --> [v2:172.21.15.179:6816/90872,v1:172.21.15.179:6817/90872] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb4d4070030 con 0x7fb4d406d550 2023-10-06T04:40:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.244+0000 7fb4eaffd700 1 -- 172.21.15.112:0/2571113477 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4e4089220 con 0x7fb4e0004d50 2023-10-06T04:40:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.245+0000 7fb4f2d9d700 1 --2- 172.21.15.112:0/2571113477 >> [v2:172.21.15.179:6816/90872,v1:172.21.15.179:6817/90872] conn(0x7fb4d406d550 0x7fb4d406f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.245+0000 7fb4e9d9b700 1 --2- 172.21.15.112:0/2571113477 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb4d40670e0 0x7fb4d4069590 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb4f41523a0 tx=0x7fb4dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:37.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.245+0000 7fb4f2d9d700 1 --2- 172.21.15.112:0/2571113477 >> [v2:172.21.15.179:6816/90872,v1:172.21.15.179:6817/90872] conn(0x7fb4d406d550 0x7fb4d406f960 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:37.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.246+0000 7fb4eaffd700 1 -- 172.21.15.112:0/2571113477 <== osd.5 v2:172.21.15.179:6816/90872 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb4d4070030 con 0x7fb4d406d550 2023-10-06T04:40:37.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.259+0000 7fb4f8ab6700 1 -- 172.21.15.112:0/2571113477 --> [v2:172.21.15.179:6816/90872,v1:172.21.15.179:6817/90872] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb4f415b7b0 con 0x7fb4d406d550 2023-10-06T04:40:37.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.260+0000 7fb4eaffd700 1 -- 172.21.15.112:0/2571113477 <== osd.5 v2:172.21.15.179:6816/90872 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb4f415b7b0 con 0x7fb4d406d550 2023-10-06T04:40:37.264 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-10-06T04:40:37.264 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:40:37.264 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-10-06T04:40:37.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.260+0000 7fb4f8ab6700 1 -- 172.21.15.112:0/2571113477 >> [v2:172.21.15.179:6816/90872,v1:172.21.15.179:6817/90872] conn(0x7fb4d406d550 msgr2=0x7fb4d406f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.260+0000 7fb4f8ab6700 1 --2- 172.21.15.112:0/2571113477 >> [v2:172.21.15.179:6816/90872,v1:172.21.15.179:6817/90872] conn(0x7fb4d406d550 0x7fb4d406f960 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.260+0000 7fb4f8ab6700 1 -- 172.21.15.112:0/2571113477 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb4d40670e0 msgr2=0x7fb4d4069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.260+0000 7fb4f8ab6700 1 --2- 172.21.15.112:0/2571113477 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fb4d40670e0 0x7fb4d4069590 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb4f41523a0 tx=0x7fb4dc008040 comp rx=0 tx=0).stop 2023-10-06T04:40:37.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.260+0000 7fb4f8ab6700 1 -- 172.21.15.112:0/2571113477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4e0004d50 msgr2=0x7fb4f4159930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.260+0000 7fb4f8ab6700 1 --2- 172.21.15.112:0/2571113477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4e0004d50 0x7fb4f4159930 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40029a0 tx=0x7fb4e4007d80 comp rx=0 tx=0).stop 2023-10-06T04:40:37.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.260+0000 7fb4f2d9d700 1 -- 172.21.15.112:0/2571113477 reap_dead start 2023-10-06T04:40:37.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.260+0000 7fb4f8ab6700 1 -- 172.21.15.112:0/2571113477 shutdown_connections 2023-10-06T04:40:37.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.261+0000 7fb4f8ab6700 1 -- 172.21.15.112:0/2571113477 >> 172.21.15.112:0/2571113477 conn(0x7fb4f40631f0 msgr2=0x7fb4f4069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:37.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.261+0000 7fb4f8ab6700 1 -- 172.21.15.112:0/2571113477 shutdown_connections 2023-10-06T04:40:37.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.261+0000 7fb4f8ab6700 1 -- 172.21.15.112:0/2571113477 wait complete. 2023-10-06T04:40:37.274 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T04:40:37.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.387+0000 7f0512535700 1 Processor -- start 2023-10-06T04:40:37.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.387+0000 7f0512535700 1 -- start start 2023-10-06T04:40:37.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.388+0000 7f0512535700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f050c159460 0x7f050c0cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.388+0000 7f0512535700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050c0cd690 con 0x7f050c06d9a0 2023-10-06T04:40:37.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.388+0000 7f0512535700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050c0cf7f0 con 0x7f050c159830 2023-10-06T04:40:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.388+0000 7f0512535700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f050c0cfad0 con 0x7f050c159460 2023-10-06T04:40:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.388+0000 7f0511533700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f050c159460 0x7f050c0cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.388+0000 7f0511d34700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f050c06d9a0 0x7f050c0b3bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45744/0 (socket says 172.21.15.112:45744) 2023-10-06T04:40:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.388+0000 7f0511d34700 1 -- 172.21.15.112:0/4278390852 learned_addr learned my addr 172.21.15.112:0/4278390852 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.388+0000 7f0511533700 1 -- 172.21.15.112:0/4278390852 >> v1:172.21.15.179:6789/0 conn(0x7f050c159830 legacy=0x7f050c0b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.388+0000 7f0511533700 1 -- 172.21.15.112:0/4278390852 >> v1:172.21.15.112:6789/0 conn(0x7f050c06d9a0 legacy=0x7f050c0b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.388+0000 7f0511533700 1 -- 172.21.15.112:0/4278390852 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c0cfdb0 con 0x7f050c159460 2023-10-06T04:40:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.388+0000 7f0511533700 1 --2- 172.21.15.112:0/4278390852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f050c159460 0x7f050c0cd0b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f05080098e0 tx=0x7f05080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eabaa55b5caa691 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.389+0000 7f0503fff700 1 -- 172.21.15.112:0/4278390852 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0508009e80 con 0x7f050c159460 2023-10-06T04:40:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.389+0000 7f0503fff700 1 -- 172.21.15.112:0/4278390852 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050800b760 con 0x7f050c159460 2023-10-06T04:40:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.389+0000 7f0503fff700 1 -- 172.21.15.112:0/4278390852 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050800bb00 con 0x7f050c159460 2023-10-06T04:40:37.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.389+0000 7f0512535700 1 -- 172.21.15.112:0/4278390852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f050c159460 msgr2=0x7f050c0cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.389+0000 7f0512535700 1 --2- 172.21.15.112:0/4278390852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f050c159460 0x7f050c0cd0b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f05080098e0 tx=0x7f05080091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.389+0000 7f0512535700 1 -- 172.21.15.112:0/4278390852 shutdown_connections 2023-10-06T04:40:37.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.389+0000 7f0512535700 1 --2- 172.21.15.112:0/4278390852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f050c159460 0x7f050c0cd0b0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.389+0000 7f0512535700 1 -- 172.21.15.112:0/4278390852 >> 172.21.15.112:0/4278390852 conn(0x7f050c06d250 msgr2=0x7f050c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:37.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.389+0000 7f0512535700 1 -- 172.21.15.112:0/4278390852 shutdown_connections 2023-10-06T04:40:37.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.389+0000 7f0512535700 1 -- 172.21.15.112:0/4278390852 wait complete. 2023-10-06T04:40:37.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.390+0000 7f0512535700 1 Processor -- start 2023-10-06T04:40:37.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.390+0000 7f0512535700 1 -- start start 2023-10-06T04:40:37.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.391+0000 7f0512535700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f050c06d9a0 0x7f050c0c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.391+0000 7f0512535700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f050c159460 0x7f050c0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.391+0000 7f0512535700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f050c159830 0x7f050c0b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.391+0000 7f0512535700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c0c9bb0 con 0x7f050c06d9a0 2023-10-06T04:40:37.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.391+0000 7f0512535700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c0c6560 con 0x7f050c159830 2023-10-06T04:40:37.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.391+0000 7f0512535700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c0c6840 con 0x7f050c159460 2023-10-06T04:40:37.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.391+0000 7f0511533700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f050c06d9a0 0x7f050c0c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.391+0000 7f0511533700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f050c06d9a0 0x7f050c0c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54934/0 (socket says 172.21.15.112:54934) 2023-10-06T04:40:37.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.391+0000 7f0511533700 1 -- 172.21.15.112:0/2007739927 learned_addr learned my addr 172.21.15.112:0/2007739927 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:37.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.391+0000 7f0511533700 1 -- 172.21.15.112:0/2007739927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f050c159460 msgr2=0x7f050c0b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.391+0000 7f0511533700 1 --2- 172.21.15.112:0/2007739927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f050c159460 0x7f050c0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.392+0000 7f0511533700 1 -- 172.21.15.112:0/2007739927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f050c159830 msgr2=0x7f050c0b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.392+0000 7f0511533700 1 --2- 172.21.15.112:0/2007739927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f050c159830 0x7f050c0b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.392+0000 7f0511533700 1 -- 172.21.15.112:0/2007739927 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0508009420 con 0x7f050c06d9a0 2023-10-06T04:40:37.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.392+0000 7f0511533700 1 --2- 172.21.15.112:0/2007739927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f050c06d9a0 0x7f050c0c7fb0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f05080091e0 tx=0x7f0508016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:37.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.392+0000 7f05017fa700 1 -- 172.21.15.112:0/2007739927 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0508000d10 con 0x7f050c06d9a0 2023-10-06T04:40:37.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.392+0000 7f05017fa700 1 -- 172.21.15.112:0/2007739927 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0508011e30 con 0x7f050c06d9a0 2023-10-06T04:40:37.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.392+0000 7f0512535700 1 -- 172.21.15.112:0/2007739927 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050c0c6b20 con 0x7f050c06d9a0 2023-10-06T04:40:37.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.392+0000 7f05017fa700 1 -- 172.21.15.112:0/2007739927 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050801b680 con 0x7f050c06d9a0 2023-10-06T04:40:37.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.392+0000 7f0512535700 1 -- 172.21.15.112:0/2007739927 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050c0c84f0 con 0x7f050c06d9a0 2023-10-06T04:40:37.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.393+0000 7f0512535700 1 -- 172.21.15.112:0/2007739927 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f050c05f230 con 0x7f050c06d9a0 2023-10-06T04:40:37.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.393+0000 7f05017fa700 1 -- 172.21.15.112:0/2007739927 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f0508022020 con 0x7f050c06d9a0 2023-10-06T04:40:37.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.393+0000 7f05017fa700 1 --2- 172.21.15.112:0/2007739927 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f04f00670e0 0x7f04f0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.393+0000 7f05017fa700 1 -- 172.21.15.112:0/2007739927 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f0508086160 con 0x7f050c06d9a0 2023-10-06T04:40:37.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.394+0000 7f0510d32700 1 --2- 172.21.15.112:0/2007739927 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f04f00670e0 0x7f04f0069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.394+0000 7f0510d32700 1 --2- 172.21.15.112:0/2007739927 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f04f00670e0 0x7f04f0069590 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f050c16ce40 tx=0x7f04fc006c60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:37.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.398+0000 7f05017fa700 1 -- 172.21.15.112:0/2007739927 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0508053370 con 0x7f050c06d9a0 2023-10-06T04:40:37.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.581+0000 7f0512535700 1 -- 172.21.15.112:0/2007739927 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f050c05f230 con 0x7f04f00670e0 2023-10-06T04:40:37.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.582+0000 7f05017fa700 1 -- 172.21.15.112:0/2007739927 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f050c05f230 con 0x7f04f00670e0 2023-10-06T04:40:37.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.584+0000 7f0512535700 1 -- 172.21.15.112:0/2007739927 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f04f00670e0 msgr2=0x7f04f0069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.584+0000 7f0512535700 1 --2- 172.21.15.112:0/2007739927 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f04f00670e0 0x7f04f0069590 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f050c16ce40 tx=0x7f04fc006c60 comp rx=0 tx=0).stop 2023-10-06T04:40:37.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.584+0000 7f0512535700 1 -- 172.21.15.112:0/2007739927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f050c06d9a0 msgr2=0x7f050c0c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.584+0000 7f0512535700 1 --2- 172.21.15.112:0/2007739927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f050c06d9a0 0x7f050c0c7fb0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f05080091e0 tx=0x7f0508016000 comp rx=0 tx=0).stop 2023-10-06T04:40:37.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.584+0000 7f0512535700 1 -- 172.21.15.112:0/2007739927 shutdown_connections 2023-10-06T04:40:37.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.584+0000 7f0512535700 1 --2- 172.21.15.112:0/2007739927 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f04f00670e0 0x7f04f0069590 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.584+0000 7f0512535700 1 --2- 172.21.15.112:0/2007739927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f050c159830 0x7f050c0b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.584+0000 7f0512535700 1 --2- 172.21.15.112:0/2007739927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f050c06d9a0 0x7f050c0c7fb0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.584+0000 7f0512535700 1 --2- 172.21.15.112:0/2007739927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f050c159460 0x7f050c0b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.584+0000 7f0512535700 1 -- 172.21.15.112:0/2007739927 >> 172.21.15.112:0/2007739927 conn(0x7f050c06d250 msgr2=0x7f050c0b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:37.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.584+0000 7f0512535700 1 -- 172.21.15.112:0/2007739927 shutdown_connections 2023-10-06T04:40:37.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.584+0000 7f0512535700 1 -- 172.21.15.112:0/2007739927 wait complete. 2023-10-06T04:40:37.588 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T04:40:37.598 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T04:40:37.598 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:40:37.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.714+0000 7f7923f58700 1 Processor -- start 2023-10-06T04:40:37.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.714+0000 7f7923f58700 1 -- start start 2023-10-06T04:40:37.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.715+0000 7f7923f58700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f791c159a20 0x7f791c0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.715+0000 7f7923f58700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791c15af50 con 0x7f791c06d3b0 2023-10-06T04:40:37.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.715+0000 7f7923f58700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791c15e370 con 0x7f791c15c720 2023-10-06T04:40:37.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.715+0000 7f7923f58700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f791c0cca70 con 0x7f791c159a20 2023-10-06T04:40:37.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.715+0000 7f7921cf4700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f791c159a20 0x7f791c0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.715+0000 7f79214f3700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f791c06d3b0 0x7f791c15d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45756/0 (socket says 172.21.15.112:45756) 2023-10-06T04:40:37.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.715+0000 7f79214f3700 1 -- 172.21.15.112:0/1527798161 learned_addr learned my addr 172.21.15.112:0/1527798161 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:37.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.715+0000 7f7921cf4700 1 -- 172.21.15.112:0/1527798161 >> v1:172.21.15.179:6789/0 conn(0x7f791c15c720 legacy=0x7f791c15dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.715+0000 7f7921cf4700 1 -- 172.21.15.112:0/1527798161 >> v1:172.21.15.112:6789/0 conn(0x7f791c06d3b0 legacy=0x7f791c15d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.715+0000 7f7920cf2700 1 -- 172.21.15.112:0/1527798161 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4123825551 0 0) 0x7f791c15af50 con 0x7f791c06d3b0 2023-10-06T04:40:37.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.715+0000 7f7921cf4700 1 -- 172.21.15.112:0/1527798161 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c0cae50 con 0x7f791c159a20 2023-10-06T04:40:37.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.715+0000 7f7921cf4700 1 --2- 172.21.15.112:0/1527798161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f791c159a20 0x7f791c0cb7f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7918009e60 tx=0x7f7918009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f20c75cc58b2a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:37.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.715+0000 7f7920cf2700 1 -- 172.21.15.112:0/1527798161 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791800e070 con 0x7f791c159a20 2023-10-06T04:40:37.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.715+0000 7f7920cf2700 1 -- 172.21.15.112:0/1527798161 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791800bc30 con 0x7f791c159a20 2023-10-06T04:40:37.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.715+0000 7f7920cf2700 1 -- 172.21.15.112:0/1527798161 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7918012430 con 0x7f791c159a20 2023-10-06T04:40:37.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.716+0000 7f7923f58700 1 -- 172.21.15.112:0/1527798161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f791c159a20 msgr2=0x7f791c0cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.716+0000 7f7923f58700 1 --2- 172.21.15.112:0/1527798161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f791c159a20 0x7f791c0cb7f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7918009e60 tx=0x7f7918009780 comp rx=0 tx=0).stop 2023-10-06T04:40:37.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.716+0000 7f7923f58700 1 -- 172.21.15.112:0/1527798161 shutdown_connections 2023-10-06T04:40:37.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.716+0000 7f7923f58700 1 --2- 172.21.15.112:0/1527798161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f791c159a20 0x7f791c0cb7f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.716+0000 7f7923f58700 1 -- 172.21.15.112:0/1527798161 >> 172.21.15.112:0/1527798161 conn(0x7f791c06cfb0 msgr2=0x7f791c0d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:37.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.716+0000 7f7923f58700 1 -- 172.21.15.112:0/1527798161 shutdown_connections 2023-10-06T04:40:37.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.716+0000 7f7923f58700 1 -- 172.21.15.112:0/1527798161 wait complete. 2023-10-06T04:40:37.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.717+0000 7f7923f58700 1 Processor -- start 2023-10-06T04:40:37.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.717+0000 7f7923f58700 1 -- start start 2023-10-06T04:40:37.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f7923f58700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f791c06d3b0 0x7f791c158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f7923f58700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f791c159a20 0x7f791c0b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f7923f58700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f791c15c720 0x7f791c0b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f7923f58700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791c0b0940 con 0x7f791c15c720 2023-10-06T04:40:37.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f7923f58700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791c0b6070 con 0x7f791c06d3b0 2023-10-06T04:40:37.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f7923f58700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791c0b6350 con 0x7f791c159a20 2023-10-06T04:40:37.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f79224f5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f791c15c720 0x7f791c0b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f79224f5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f791c15c720 0x7f791c0b1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54946/0 (socket says 172.21.15.112:54946) 2023-10-06T04:40:37.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f79224f5700 1 -- 172.21.15.112:0/3926551736 learned_addr learned my addr 172.21.15.112:0/3926551736 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:37.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f7921cf4700 1 --2- 172.21.15.112:0/3926551736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f791c06d3b0 0x7f791c158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f79214f3700 1 --2- 172.21.15.112:0/3926551736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f791c159a20 0x7f791c0b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f79224f5700 1 -- 172.21.15.112:0/3926551736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f791c159a20 msgr2=0x7f791c0b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f79224f5700 1 --2- 172.21.15.112:0/3926551736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f791c159a20 0x7f791c0b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f79224f5700 1 -- 172.21.15.112:0/3926551736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f791c06d3b0 msgr2=0x7f791c158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f79224f5700 1 --2- 172.21.15.112:0/3926551736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f791c06d3b0 0x7f791c158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f79224f5700 1 -- 172.21.15.112:0/3926551736 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7918009a20 con 0x7f791c15c720 2023-10-06T04:40:37.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f7921cf4700 1 --2- 172.21.15.112:0/3926551736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f791c06d3b0 0x7f791c158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:37.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f79214f3700 1 --2- 172.21.15.112:0/3926551736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f791c159a20 0x7f791c0b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:37.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f79224f5700 1 --2- 172.21.15.112:0/3926551736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f791c15c720 0x7f791c0b1310 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f791400c560 tx=0x7f7914007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:37.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f7911ffb700 1 -- 172.21.15.112:0/3926551736 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7914001120 con 0x7f791c15c720 2023-10-06T04:40:37.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f7911ffb700 1 -- 172.21.15.112:0/3926551736 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7914011590 con 0x7f791c15c720 2023-10-06T04:40:37.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f7923f58700 1 -- 172.21.15.112:0/3926551736 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f791c0b6630 con 0x7f791c15c720 2023-10-06T04:40:37.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.718+0000 7f7911ffb700 1 -- 172.21.15.112:0/3926551736 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7914011950 con 0x7f791c15c720 2023-10-06T04:40:37.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.719+0000 7f7923f58700 1 -- 172.21.15.112:0/3926551736 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791c0b3960 con 0x7f791c15c720 2023-10-06T04:40:37.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.719+0000 7f7923f58700 1 -- 172.21.15.112:0/3926551736 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f791c05f230 con 0x7f791c15c720 2023-10-06T04:40:37.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.720+0000 7f7911ffb700 1 -- 172.21.15.112:0/3926551736 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f7914011d00 con 0x7f791c15c720 2023-10-06T04:40:37.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.720+0000 7f7911ffb700 1 --2- 172.21.15.112:0/3926551736 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f79000670e0 0x7f7900069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.720+0000 7f7911ffb700 1 -- 172.21.15.112:0/3926551736 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f7914083ae0 con 0x7f791c15c720 2023-10-06T04:40:37.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.720+0000 7f7921cf4700 1 --2- 172.21.15.112:0/3926551736 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f79000670e0 0x7f7900069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.720+0000 7f7911ffb700 1 --2- 172.21.15.112:0/3926551736 >> [v2:172.21.15.179:6824/90879,v1:172.21.15.179:6825/90879] conn(0x7f790006d550 0x7f790006f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.720+0000 7f7911ffb700 1 -- 172.21.15.112:0/3926551736 --> [v2:172.21.15.179:6824/90879,v1:172.21.15.179:6825/90879] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7900070030 con 0x7f790006d550 2023-10-06T04:40:37.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.720+0000 7f7911ffb700 1 -- 172.21.15.112:0/3926551736 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7914088220 con 0x7f791c15c720 2023-10-06T04:40:37.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.721+0000 7f7921cf4700 1 --2- 172.21.15.112:0/3926551736 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f79000670e0 0x7f7900069590 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7918009e60 tx=0x7f7918019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:37.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.721+0000 7f79214f3700 1 --2- 172.21.15.112:0/3926551736 >> [v2:172.21.15.179:6824/90879,v1:172.21.15.179:6825/90879] conn(0x7f790006d550 0x7f790006f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.721+0000 7f79214f3700 1 --2- 172.21.15.112:0/3926551736 >> [v2:172.21.15.179:6824/90879,v1:172.21.15.179:6825/90879] conn(0x7f790006d550 0x7f790006f960 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:37.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.722+0000 7f7911ffb700 1 -- 172.21.15.112:0/3926551736 <== osd.6 v2:172.21.15.179:6824/90879 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f7900070030 con 0x7f790006d550 2023-10-06T04:40:37.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.735+0000 7f7923f58700 1 -- 172.21.15.112:0/3926551736 --> [v2:172.21.15.179:6824/90879,v1:172.21.15.179:6825/90879] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f791c09e400 con 0x7f790006d550 2023-10-06T04:40:37.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.736+0000 7f7911ffb700 1 -- 172.21.15.112:0/3926551736 <== osd.6 v2:172.21.15.179:6824/90879 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f791c09e400 con 0x7f790006d550 2023-10-06T04:40:37.738 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-10-06T04:40:37.738 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:40:37.738 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-10-06T04:40:37.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.736+0000 7f7923f58700 1 -- 172.21.15.112:0/3926551736 >> [v2:172.21.15.179:6824/90879,v1:172.21.15.179:6825/90879] conn(0x7f790006d550 msgr2=0x7f790006f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.736+0000 7f7923f58700 1 --2- 172.21.15.112:0/3926551736 >> [v2:172.21.15.179:6824/90879,v1:172.21.15.179:6825/90879] conn(0x7f790006d550 0x7f790006f960 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.736+0000 7f7923f58700 1 -- 172.21.15.112:0/3926551736 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f79000670e0 msgr2=0x7f7900069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.736+0000 7f7923f58700 1 --2- 172.21.15.112:0/3926551736 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f79000670e0 0x7f7900069590 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7918009e60 tx=0x7f7918019000 comp rx=0 tx=0).stop 2023-10-06T04:40:37.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.736+0000 7f7923f58700 1 -- 172.21.15.112:0/3926551736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f791c15c720 msgr2=0x7f791c0b1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.736+0000 7f7923f58700 1 --2- 172.21.15.112:0/3926551736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f791c15c720 0x7f791c0b1310 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f791400c560 tx=0x7f7914007ef0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.736+0000 7f79224f5700 1 -- 172.21.15.112:0/3926551736 reap_dead start 2023-10-06T04:40:37.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.736+0000 7f7923f58700 1 -- 172.21.15.112:0/3926551736 shutdown_connections 2023-10-06T04:40:37.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.736+0000 7f7923f58700 1 -- 172.21.15.112:0/3926551736 >> 172.21.15.112:0/3926551736 conn(0x7f791c06cfb0 msgr2=0x7f791c0cb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:37.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.736+0000 7f7923f58700 1 -- 172.21.15.112:0/3926551736 shutdown_connections 2023-10-06T04:40:37.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.736+0000 7f7923f58700 1 -- 172.21.15.112:0/3926551736 wait complete. 2023-10-06T04:40:37.750 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T04:40:37.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.862+0000 7f6cf359e700 1 Processor -- start 2023-10-06T04:40:37.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.862+0000 7f6cf359e700 1 -- start start 2023-10-06T04:40:37.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.863+0000 7f6cf359e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6cf406e0b0 0x7f6cf40b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.863+0000 7f6cf359e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf4143640 con 0x7f6cf4143270 2023-10-06T04:40:37.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.863+0000 7f6cf359e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf40cd650 con 0x7f6cf40cd100 2023-10-06T04:40:37.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.863+0000 7f6cf359e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf40b4350 con 0x7f6cf406e0b0 2023-10-06T04:40:37.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.863+0000 7f6cf259c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6cf4143270 0x7f6cf406d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45772/0 (socket says 172.21.15.112:45772) 2023-10-06T04:40:37.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.863+0000 7f6cf259c700 1 -- 172.21.15.112:0/3052363227 learned_addr learned my addr 172.21.15.112:0/3052363227 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:37.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.863+0000 7f6cf159a700 1 -- 172.21.15.112:0/3052363227 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818219774 0 0) 0x7f6cf4143640 con 0x7f6cf4143270 2023-10-06T04:40:37.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.863+0000 7f6cf1d9b700 1 --2- 172.21.15.112:0/3052363227 >> v2:172.21.15.179:3300/0 conn(0x7f6cf406e0b0 0x7f6cf40b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.863+0000 7f6cf159a700 1 -- 172.21.15.112:0/3052363227 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ce0003570 con 0x7f6cf4143270 2023-10-06T04:40:37.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.863+0000 7f6cf159a700 1 -- 172.21.15.112:0/3052363227 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 667971381 0 0) 0x7f6ce0003570 con 0x7f6cf4143270 2023-10-06T04:40:37.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.863+0000 7f6cf159a700 1 -- 172.21.15.112:0/3052363227 >> v2:172.21.15.179:3300/0 conn(0x7f6cf406e0b0 msgr2=0x7f6cf40b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:37.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.863+0000 7f6cf159a700 1 --2- 172.21.15.112:0/3052363227 >> v2:172.21.15.179:3300/0 conn(0x7f6cf406e0b0 0x7f6cf40b64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.863+0000 7f6cf159a700 1 -- 172.21.15.112:0/3052363227 >> v1:172.21.15.179:6789/0 conn(0x7f6cf40cd100 legacy=0x7f6cf40b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf159a700 1 -- 172.21.15.112:0/3052363227 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf40b4630 con 0x7f6cf4143270 2023-10-06T04:40:37.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf159a700 1 -- 172.21.15.112:0/3052363227 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7f6cec0017f0 con 0x7f6cf4143270 2023-10-06T04:40:37.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf159a700 1 -- 172.21.15.112:0/3052363227 >> v1:172.21.15.112:6789/0 conn(0x7f6cf4143270 legacy=0x7f6cf406d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf159a700 1 --2- 172.21.15.112:0/3052363227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ce0003a60 0x7f6ce0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf159a700 1 --2- 172.21.15.112:0/3052363227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ce0004810 0x7f6ce0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf159a700 1 --2- 172.21.15.112:0/3052363227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce00051c0 0x7f6ce000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf159a700 1 -- 172.21.15.112:0/3052363227 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf40b4350 con 0x7f6ce00051c0 2023-10-06T04:40:37.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf159a700 1 -- 172.21.15.112:0/3052363227 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce000c160 con 0x7f6ce0003a60 2023-10-06T04:40:37.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf159a700 1 -- 172.21.15.112:0/3052363227 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce000c320 con 0x7f6ce0004810 2023-10-06T04:40:37.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf2d9d700 1 --2- 172.21.15.112:0/3052363227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce00051c0 0x7f6ce000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf1d9b700 1 --2- 172.21.15.112:0/3052363227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ce0004810 0x7f6ce0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf259c700 1 --2- 172.21.15.112:0/3052363227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ce0003a60 0x7f6ce0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf2d9d700 1 -- 172.21.15.112:0/3052363227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ce0004810 msgr2=0x7f6ce0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:37.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf2d9d700 1 --2- 172.21.15.112:0/3052363227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ce0004810 0x7f6ce0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf2d9d700 1 -- 172.21.15.112:0/3052363227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ce0003a60 msgr2=0x7f6ce0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:37.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf2d9d700 1 --2- 172.21.15.112:0/3052363227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ce0003a60 0x7f6ce0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf2d9d700 1 -- 172.21.15.112:0/3052363227 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce0003570 con 0x7f6ce00051c0 2023-10-06T04:40:37.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf2d9d700 1 -- 172.21.15.112:0/3052363227 reap_dead start 2023-10-06T04:40:37.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf2d9d700 1 --2- 172.21.15.112:0/3052363227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce00051c0 0x7f6ce000ba60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40018b0 tx=0x7f6ce4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1fc2aaf9cbf7cb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:37.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf159a700 1 -- 172.21.15.112:0/3052363227 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4012420 con 0x7f6ce00051c0 2023-10-06T04:40:37.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf159a700 1 -- 172.21.15.112:0/3052363227 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce40125a0 con 0x7f6ce00051c0 2023-10-06T04:40:37.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.864+0000 7f6cf159a700 1 -- 172.21.15.112:0/3052363227 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4012960 con 0x7f6ce00051c0 2023-10-06T04:40:37.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.865+0000 7f6cf359e700 1 -- 172.21.15.112:0/3052363227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce00051c0 msgr2=0x7f6ce000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.865+0000 7f6cf359e700 1 --2- 172.21.15.112:0/3052363227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce00051c0 0x7f6ce000ba60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40018b0 tx=0x7f6ce4007d30 comp rx=0 tx=0).stop 2023-10-06T04:40:37.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.865+0000 7f6cf359e700 1 -- 172.21.15.112:0/3052363227 shutdown_connections 2023-10-06T04:40:37.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.865+0000 7f6cf359e700 1 --2- 172.21.15.112:0/3052363227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce00051c0 0x7f6ce000ba60 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.865+0000 7f6cf359e700 1 -- 172.21.15.112:0/3052363227 >> 172.21.15.112:0/3052363227 conn(0x7f6cf406d2a0 msgr2=0x7f6cf40b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:37.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.865+0000 7f6cf359e700 1 -- 172.21.15.112:0/3052363227 shutdown_connections 2023-10-06T04:40:37.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.865+0000 7f6cf359e700 1 -- 172.21.15.112:0/3052363227 wait complete. 2023-10-06T04:40:37.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.866+0000 7f6cf359e700 1 Processor -- start 2023-10-06T04:40:37.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.866+0000 7f6cf359e700 1 -- start start 2023-10-06T04:40:37.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.867+0000 7f6cf359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ce00051c0 0x7f6cf4159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.867+0000 7f6cf359e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cf415f3c0 0x7f6cf413c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.867+0000 7f6cf359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cf413c9a0 0x7f6cf4140010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.867+0000 7f6cf359e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf413da40 con 0x7f6cf415f3c0 2023-10-06T04:40:37.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.867+0000 7f6cf359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf413ce30 con 0x7f6cf413c9a0 2023-10-06T04:40:37.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.867+0000 7f6cf359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf413d110 con 0x7f6ce00051c0 2023-10-06T04:40:37.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.867+0000 7f6cf1d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cf415f3c0 0x7f6cf413c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.867+0000 7f6cf1d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cf415f3c0 0x7f6cf413c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54968/0 (socket says 172.21.15.112:54968) 2023-10-06T04:40:37.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.867+0000 7f6cf1d9b700 1 -- 172.21.15.112:0/2801111304 learned_addr learned my addr 172.21.15.112:0/2801111304 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:37.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.867+0000 7f6cf2d9d700 1 --2- 172.21.15.112:0/2801111304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cf413c9a0 0x7f6cf4140010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.867+0000 7f6cf259c700 1 --2- 172.21.15.112:0/2801111304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ce00051c0 0x7f6cf4159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.867+0000 7f6cf1d9b700 1 -- 172.21.15.112:0/2801111304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ce00051c0 msgr2=0x7f6cf4159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.867+0000 7f6cf1d9b700 1 --2- 172.21.15.112:0/2801111304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ce00051c0 0x7f6cf4159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.867+0000 7f6cf1d9b700 1 -- 172.21.15.112:0/2801111304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cf413c9a0 msgr2=0x7f6cf4140010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:37.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.867+0000 7f6cf1d9b700 1 --2- 172.21.15.112:0/2801111304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cf413c9a0 0x7f6cf4140010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:37.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.867+0000 7f6cf1d9b700 1 -- 172.21.15.112:0/2801111304 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf413d3f0 con 0x7f6cf415f3c0 2023-10-06T04:40:37.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.867+0000 7f6cf1d9b700 1 --2- 172.21.15.112:0/2801111304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cf415f3c0 0x7f6cf413c460 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc009fd0 tx=0x7f6cdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:37.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.868+0000 7f6cea7fc700 1 -- 172.21.15.112:0/2801111304 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc00f940 con 0x7f6cf415f3c0 2023-10-06T04:40:37.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.868+0000 7f6cea7fc700 1 -- 172.21.15.112:0/2801111304 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cdc00faa0 con 0x7f6cf415f3c0 2023-10-06T04:40:37.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.868+0000 7f6cf359e700 1 -- 172.21.15.112:0/2801111304 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf413d6d0 con 0x7f6cf415f3c0 2023-10-06T04:40:37.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.868+0000 7f6cea7fc700 1 -- 172.21.15.112:0/2801111304 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc00fe20 con 0x7f6cf415f3c0 2023-10-06T04:40:37.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.868+0000 7f6cf359e700 1 -- 172.21.15.112:0/2801111304 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf4140550 con 0x7f6cf415f3c0 2023-10-06T04:40:37.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.869+0000 7f6cf359e700 1 -- 172.21.15.112:0/2801111304 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf405f230 con 0x7f6cf415f3c0 2023-10-06T04:40:37.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.869+0000 7f6cea7fc700 1 -- 172.21.15.112:0/2801111304 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f6cdc014650 con 0x7f6cf415f3c0 2023-10-06T04:40:37.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.869+0000 7f6cea7fc700 1 --2- 172.21.15.112:0/2801111304 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6cd40670e0 0x7f6cd4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:37.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.869+0000 7f6cea7fc700 1 -- 172.21.15.112:0/2801111304 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f6cdc018030 con 0x7f6cf415f3c0 2023-10-06T04:40:37.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.869+0000 7f6cf259c700 1 --2- 172.21.15.112:0/2801111304 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6cd40670e0 0x7f6cd4069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:37.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.870+0000 7f6cf259c700 1 --2- 172.21.15.112:0/2801111304 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6cd40670e0 0x7f6cd4069590 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6cec002060 tx=0x7f6cec0021d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:37.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:37.874+0000 7f6cea7fc700 1 -- 172.21.15.112:0/2801111304 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cdc052220 con 0x7f6cf415f3c0 2023-10-06T04:40:38.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.055+0000 7f6cf359e700 1 -- 172.21.15.112:0/2801111304 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cf40b4910 con 0x7f6cd40670e0 2023-10-06T04:40:38.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.055+0000 7f6cea7fc700 1 -- 172.21.15.112:0/2801111304 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6cf40b4910 con 0x7f6cd40670e0 2023-10-06T04:40:38.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.057+0000 7f6cf359e700 1 -- 172.21.15.112:0/2801111304 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6cd40670e0 msgr2=0x7f6cd4069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.057+0000 7f6cf359e700 1 --2- 172.21.15.112:0/2801111304 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6cd40670e0 0x7f6cd4069590 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6cec002060 tx=0x7f6cec0021d0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.057+0000 7f6cf359e700 1 -- 172.21.15.112:0/2801111304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cf415f3c0 msgr2=0x7f6cf413c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.057+0000 7f6cf359e700 1 --2- 172.21.15.112:0/2801111304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cf415f3c0 0x7f6cf413c460 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc009fd0 tx=0x7f6cdc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.057+0000 7f6cf359e700 1 -- 172.21.15.112:0/2801111304 shutdown_connections 2023-10-06T04:40:38.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.057+0000 7f6cf359e700 1 --2- 172.21.15.112:0/2801111304 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6cd40670e0 0x7f6cd4069590 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.057+0000 7f6cf359e700 1 --2- 172.21.15.112:0/2801111304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cf413c9a0 0x7f6cf4140010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.057+0000 7f6cf359e700 1 --2- 172.21.15.112:0/2801111304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ce00051c0 0x7f6cf4159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.057+0000 7f6cf359e700 1 --2- 172.21.15.112:0/2801111304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cf415f3c0 0x7f6cf413c460 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.057+0000 7f6cf359e700 1 -- 172.21.15.112:0/2801111304 >> 172.21.15.112:0/2801111304 conn(0x7f6cf406d2a0 msgr2=0x7f6cf40b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:38.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.057+0000 7f6cf359e700 1 -- 172.21.15.112:0/2801111304 shutdown_connections 2023-10-06T04:40:38.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.057+0000 7f6cf359e700 1 -- 172.21.15.112:0/2801111304 wait complete. 2023-10-06T04:40:38.061 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T04:40:38.071 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T04:40:38.071 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:40:38.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.187+0000 7f06f359e700 1 Processor -- start 2023-10-06T04:40:38.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.187+0000 7f06f359e700 1 -- start start 2023-10-06T04:40:38.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.188+0000 7f06f359e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f06f40c5e00 0x7f06f40d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.188+0000 7f06f359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f40d08c0 0x7f06f40cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.188+0000 7f06f359e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f40c5970 con 0x7f06f4157030 2023-10-06T04:40:38.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.188+0000 7f06f359e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f40d0cc0 con 0x7f06f40c5e00 2023-10-06T04:40:38.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.188+0000 7f06f359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f415d950 con 0x7f06f40d08c0 2023-10-06T04:40:38.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.188+0000 7f06e9d9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f06f40c5e00 0x7f06f40d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.188+0000 7f06e9d9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f06f40c5e00 0x7f06f40d0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59596/0 (socket says 172.21.15.112:59596) 2023-10-06T04:40:38.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.188+0000 7f06e9d9b700 1 -- 172.21.15.112:0/811674915 learned_addr learned my addr 172.21.15.112:0/811674915 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:38.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.188+0000 7f06f2d9d700 1 --2- 172.21.15.112:0/811674915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f40d08c0 0x7f06f40cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.188+0000 7f06e9d9b700 1 -- 172.21.15.112:0/811674915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f40d08c0 msgr2=0x7f06f40cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:38.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.188+0000 7f06e9d9b700 1 --2- 172.21.15.112:0/811674915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f40d08c0 0x7f06f40cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.188+0000 7f06e9d9b700 1 -- 172.21.15.112:0/811674915 >> v1:172.21.15.179:6789/0 conn(0x7f06f4157030 legacy=0x7f06f415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:38.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.188+0000 7f06e9d9b700 1 -- 172.21.15.112:0/811674915 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f415dc20 con 0x7f06f40c5e00 2023-10-06T04:40:38.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.188+0000 7f06f2d9d700 1 --2- 172.21.15.112:0/811674915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f40d08c0 0x7f06f40cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:38.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.188+0000 7f06e9d9b700 1 --2- 172.21.15.112:0/811674915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f40c5e00 0x7f06f40d0380 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0099b0 tx=0x7f06dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8089f98fc33d84 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:38.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.188+0000 7f06f1d9b700 1 -- 172.21.15.112:0/811674915 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc00b820 con 0x7f06f40c5e00 2023-10-06T04:40:38.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.189+0000 7f06f1d9b700 1 -- 172.21.15.112:0/811674915 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc00b980 con 0x7f06f40c5e00 2023-10-06T04:40:38.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.189+0000 7f06f1d9b700 1 -- 172.21.15.112:0/811674915 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc00bd20 con 0x7f06f40c5e00 2023-10-06T04:40:38.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.189+0000 7f06f359e700 1 -- 172.21.15.112:0/811674915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f40c5e00 msgr2=0x7f06f40d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.189+0000 7f06f359e700 1 --2- 172.21.15.112:0/811674915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f40c5e00 0x7f06f40d0380 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0099b0 tx=0x7f06dc009250 comp rx=0 tx=0).stop 2023-10-06T04:40:38.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.189+0000 7f06f359e700 1 -- 172.21.15.112:0/811674915 shutdown_connections 2023-10-06T04:40:38.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.189+0000 7f06f359e700 1 --2- 172.21.15.112:0/811674915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f40d08c0 0x7f06f40cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.189+0000 7f06f359e700 1 --2- 172.21.15.112:0/811674915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f40c5e00 0x7f06f40d0380 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.189+0000 7f06f359e700 1 -- 172.21.15.112:0/811674915 >> 172.21.15.112:0/811674915 conn(0x7f06f406c7d0 msgr2=0x7f06f406cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:38.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.189+0000 7f06f359e700 1 -- 172.21.15.112:0/811674915 shutdown_connections 2023-10-06T04:40:38.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.189+0000 7f06f359e700 1 -- 172.21.15.112:0/811674915 wait complete. 2023-10-06T04:40:38.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.190+0000 7f06f359e700 1 Processor -- start 2023-10-06T04:40:38.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.190+0000 7f06f359e700 1 -- start start 2023-10-06T04:40:38.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.191+0000 7f06f359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f40c5e00 0x7f06f4144f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.191+0000 7f06f359e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f40d08c0 0x7f06f415c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.191+0000 7f06f359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f4157030 0x7f06f415c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.191+0000 7f06f359e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f416cbd0 con 0x7f06f40d08c0 2023-10-06T04:40:38.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.191+0000 7f06f359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f416d710 con 0x7f06f40c5e00 2023-10-06T04:40:38.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.191+0000 7f06f359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f416cde0 con 0x7f06f4157030 2023-10-06T04:40:38.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.191+0000 7f06e9d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f40d08c0 0x7f06f415c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.191+0000 7f06e9d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f40d08c0 0x7f06f415c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59608/0 (socket says 172.21.15.112:59608) 2023-10-06T04:40:38.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.191+0000 7f06e9d9b700 1 -- 172.21.15.112:0/4176219723 learned_addr learned my addr 172.21.15.112:0/4176219723 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:38.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.191+0000 7f06f2d9d700 1 --2- 172.21.15.112:0/4176219723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f4157030 0x7f06f415c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.191+0000 7f06f259c700 1 --2- 172.21.15.112:0/4176219723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f40c5e00 0x7f06f4144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.192+0000 7f06e9d9b700 1 -- 172.21.15.112:0/4176219723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f4157030 msgr2=0x7f06f415c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.192+0000 7f06e9d9b700 1 --2- 172.21.15.112:0/4176219723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f4157030 0x7f06f415c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.192+0000 7f06e9d9b700 1 -- 172.21.15.112:0/4176219723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f40c5e00 msgr2=0x7f06f4144f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.192+0000 7f06e9d9b700 1 --2- 172.21.15.112:0/4176219723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f40c5e00 0x7f06f4144f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.192+0000 7f06e9d9b700 1 -- 172.21.15.112:0/4176219723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc0094f0 con 0x7f06f40d08c0 2023-10-06T04:40:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.192+0000 7f06e9d9b700 1 --2- 172.21.15.112:0/4176219723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f40d08c0 0x7f06f415c2e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009290 tx=0x7f06dc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.192+0000 7f06eaffd700 1 -- 172.21.15.112:0/4176219723 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc011c10 con 0x7f06f40d08c0 2023-10-06T04:40:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.192+0000 7f06eaffd700 1 -- 172.21.15.112:0/4176219723 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc020070 con 0x7f06f40d08c0 2023-10-06T04:40:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.192+0000 7f06f359e700 1 -- 172.21.15.112:0/4176219723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f416d0c0 con 0x7f06f40d08c0 2023-10-06T04:40:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.192+0000 7f06eaffd700 1 -- 172.21.15.112:0/4176219723 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc01b450 con 0x7f06f40d08c0 2023-10-06T04:40:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.192+0000 7f06f359e700 1 -- 172.21.15.112:0/4176219723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f41454b0 con 0x7f06f40d08c0 2023-10-06T04:40:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.193+0000 7f06f359e700 1 -- 172.21.15.112:0/4176219723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f06f405f230 con 0x7f06f40d08c0 2023-10-06T04:40:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.193+0000 7f06eaffd700 1 -- 172.21.15.112:0/4176219723 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f06dc022030 con 0x7f06f40d08c0 2023-10-06T04:40:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.194+0000 7f06eaffd700 1 --2- 172.21.15.112:0/4176219723 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f06d40670e0 0x7f06d4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.194+0000 7f06eaffd700 1 -- 172.21.15.112:0/4176219723 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f06dc086ad0 con 0x7f06f40d08c0 2023-10-06T04:40:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.194+0000 7f06f259c700 1 --2- 172.21.15.112:0/4176219723 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f06d40670e0 0x7f06d4069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.194+0000 7f06eaffd700 1 --2- 172.21.15.112:0/4176219723 >> [v2:172.21.15.179:6808/90849,v1:172.21.15.179:6809/90849] conn(0x7f06d406d550 0x7f06d406f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.194+0000 7f06eaffd700 1 -- 172.21.15.112:0/4176219723 --> [v2:172.21.15.179:6808/90849,v1:172.21.15.179:6809/90849] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06d4070030 con 0x7f06d406d550 2023-10-06T04:40:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.194+0000 7f06eaffd700 1 -- 172.21.15.112:0/4176219723 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06dc086ea0 con 0x7f06f40d08c0 2023-10-06T04:40:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.194+0000 7f06f2d9d700 1 --2- 172.21.15.112:0/4176219723 >> [v2:172.21.15.179:6808/90849,v1:172.21.15.179:6809/90849] conn(0x7f06d406d550 0x7f06d406f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.194+0000 7f06f259c700 1 --2- 172.21.15.112:0/4176219723 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f06d40670e0 0x7f06d4069590 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009af0 tx=0x7f06e4009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.195+0000 7f06f2d9d700 1 --2- 172.21.15.112:0/4176219723 >> [v2:172.21.15.179:6808/90849,v1:172.21.15.179:6809/90849] conn(0x7f06d406d550 0x7f06d406f960 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.195+0000 7f06eaffd700 1 -- 172.21.15.112:0/4176219723 <== osd.7 v2:172.21.15.179:6808/90849 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f06d4070030 con 0x7f06d406d550 2023-10-06T04:40:38.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.209+0000 7f06f359e700 1 -- 172.21.15.112:0/4176219723 --> [v2:172.21.15.179:6808/90849,v1:172.21.15.179:6809/90849] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f06f415df00 con 0x7f06d406d550 2023-10-06T04:40:38.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.209+0000 7f06eaffd700 1 -- 172.21.15.112:0/4176219723 <== osd.7 v2:172.21.15.179:6808/90849 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f06f415df00 con 0x7f06d406d550 2023-10-06T04:40:38.212 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-10-06T04:40:38.212 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:40:38.212 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-10-06T04:40:38.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.209+0000 7f06f359e700 1 -- 172.21.15.112:0/4176219723 >> [v2:172.21.15.179:6808/90849,v1:172.21.15.179:6809/90849] conn(0x7f06d406d550 msgr2=0x7f06d406f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.209+0000 7f06f359e700 1 --2- 172.21.15.112:0/4176219723 >> [v2:172.21.15.179:6808/90849,v1:172.21.15.179:6809/90849] conn(0x7f06d406d550 0x7f06d406f960 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.210+0000 7f06f359e700 1 -- 172.21.15.112:0/4176219723 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f06d40670e0 msgr2=0x7f06d4069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.210+0000 7f06f359e700 1 --2- 172.21.15.112:0/4176219723 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f06d40670e0 0x7f06d4069590 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009af0 tx=0x7f06e4009060 comp rx=0 tx=0).stop 2023-10-06T04:40:38.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.210+0000 7f06f359e700 1 -- 172.21.15.112:0/4176219723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f40d08c0 msgr2=0x7f06f415c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.210+0000 7f06f359e700 1 --2- 172.21.15.112:0/4176219723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f40d08c0 0x7f06f415c2e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009290 tx=0x7f06dc016000 comp rx=0 tx=0).stop 2023-10-06T04:40:38.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.210+0000 7f06f2d9d700 1 -- 172.21.15.112:0/4176219723 reap_dead start 2023-10-06T04:40:38.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.210+0000 7f06f359e700 1 -- 172.21.15.112:0/4176219723 shutdown_connections 2023-10-06T04:40:38.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.210+0000 7f06f359e700 1 -- 172.21.15.112:0/4176219723 >> 172.21.15.112:0/4176219723 conn(0x7f06f406c7d0 msgr2=0x7f06f40d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:38.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.210+0000 7f06f359e700 1 -- 172.21.15.112:0/4176219723 shutdown_connections 2023-10-06T04:40:38.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.210+0000 7f06f359e700 1 -- 172.21.15.112:0/4176219723 wait complete. 2023-10-06T04:40:38.223 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T04:40:38.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.337+0000 7fd5799ad700 1 Processor -- start 2023-10-06T04:40:38.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.337+0000 7fd5799ad700 1 -- start start 2023-10-06T04:40:38.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.338+0000 7fd5799ad700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd57415cd20 0x7fd5740ad870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.338+0000 7fd5799ad700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5740cf2c0 con 0x7fd5740d0350 2023-10-06T04:40:38.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.338+0000 7fd5799ad700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5740cbd70 con 0x7fd5740d1410 2023-10-06T04:40:38.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.338+0000 7fd5799ad700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5740cecb0 con 0x7fd57415cd20 2023-10-06T04:40:38.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.338+0000 7fd572ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd57415cd20 0x7fd5740ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.338+0000 7fd572ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd57415cd20 0x7fd5740ad870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59620/0 (socket says 172.21.15.112:59620) 2023-10-06T04:40:38.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.338+0000 7fd5737fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd5740d0350 0x7fd57415d0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33788/0 (socket says 172.21.15.112:33788) 2023-10-06T04:40:38.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.338+0000 7fd572ffd700 1 -- 172.21.15.112:0/3351665044 learned_addr learned my addr 172.21.15.112:0/3351665044 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:38.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.339+0000 7fd572ffd700 1 -- 172.21.15.112:0/3351665044 >> v1:172.21.15.179:6789/0 conn(0x7fd5740d1410 legacy=0x7fd5740cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.339+0000 7fd572ffd700 1 -- 172.21.15.112:0/3351665044 >> v1:172.21.15.112:6789/0 conn(0x7fd5740d0350 legacy=0x7fd57415d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.339+0000 7fd572ffd700 1 -- 172.21.15.112:0/3351665044 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5740cbfc0 con 0x7fd57415cd20 2023-10-06T04:40:38.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.339+0000 7fd572ffd700 1 --2- 172.21.15.112:0/3351665044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd57415cd20 0x7fd5740ad870 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd5640099b0 tx=0x7fd564009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715095627dbe5273 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:38.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.339+0000 7fd5727fc700 1 -- 172.21.15.112:0/3351665044 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56400b860 con 0x7fd57415cd20 2023-10-06T04:40:38.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.339+0000 7fd5727fc700 1 -- 172.21.15.112:0/3351665044 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56400b9c0 con 0x7fd57415cd20 2023-10-06T04:40:38.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.339+0000 7fd5727fc700 1 -- 172.21.15.112:0/3351665044 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56400bd80 con 0x7fd57415cd20 2023-10-06T04:40:38.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.339+0000 7fd5799ad700 1 -- 172.21.15.112:0/3351665044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd57415cd20 msgr2=0x7fd5740ad870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.339+0000 7fd5799ad700 1 --2- 172.21.15.112:0/3351665044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd57415cd20 0x7fd5740ad870 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd5640099b0 tx=0x7fd564009250 comp rx=0 tx=0).stop 2023-10-06T04:40:38.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.339+0000 7fd5799ad700 1 -- 172.21.15.112:0/3351665044 shutdown_connections 2023-10-06T04:40:38.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.339+0000 7fd5799ad700 1 --2- 172.21.15.112:0/3351665044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd57415cd20 0x7fd5740ad870 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.339+0000 7fd5799ad700 1 -- 172.21.15.112:0/3351665044 >> 172.21.15.112:0/3351665044 conn(0x7fd57406cfb0 msgr2=0x7fd5740d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:38.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.339+0000 7fd5799ad700 1 -- 172.21.15.112:0/3351665044 shutdown_connections 2023-10-06T04:40:38.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.339+0000 7fd5799ad700 1 -- 172.21.15.112:0/3351665044 wait complete. 2023-10-06T04:40:38.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.341+0000 7fd5799ad700 1 Processor -- start 2023-10-06T04:40:38.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.341+0000 7fd5799ad700 1 -- start start 2023-10-06T04:40:38.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.341+0000 7fd5799ad700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5740d0350 0x7fd5740b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.341+0000 7fd5799ad700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5740d1410 0x7fd57414a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.341+0000 7fd5799ad700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd57415cd20 0x7fd57416d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.341+0000 7fd5799ad700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd574158dd0 con 0x7fd5740d1410 2023-10-06T04:40:38.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.341+0000 7fd5799ad700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd574150630 con 0x7fd57415cd20 2023-10-06T04:40:38.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.341+0000 7fd5799ad700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5741584a0 con 0x7fd5740d0350 2023-10-06T04:40:38.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.341+0000 7fd56a7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5740d1410 0x7fd57414a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.341+0000 7fd56a7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5740d1410 0x7fd57414a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59624/0 (socket says 172.21.15.112:59624) 2023-10-06T04:40:38.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.341+0000 7fd56a7fc700 1 -- 172.21.15.112:0/778198660 learned_addr learned my addr 172.21.15.112:0/778198660 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:38.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.342+0000 7fd572ffd700 1 --2- 172.21.15.112:0/778198660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5740d0350 0x7fd5740b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.342+0000 7fd5737fe700 1 --2- 172.21.15.112:0/778198660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd57415cd20 0x7fd57416d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.342+0000 7fd56a7fc700 1 -- 172.21.15.112:0/778198660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5740d0350 msgr2=0x7fd5740b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.342+0000 7fd56a7fc700 1 --2- 172.21.15.112:0/778198660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5740d0350 0x7fd5740b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.342+0000 7fd56a7fc700 1 -- 172.21.15.112:0/778198660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd57415cd20 msgr2=0x7fd57416d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.342+0000 7fd56a7fc700 1 --2- 172.21.15.112:0/778198660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd57415cd20 0x7fd57416d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.342+0000 7fd56a7fc700 1 -- 172.21.15.112:0/778198660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5640094f0 con 0x7fd5740d1410 2023-10-06T04:40:38.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.342+0000 7fd5737fe700 1 --2- 172.21.15.112:0/778198660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd57415cd20 0x7fd57416d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:38.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.342+0000 7fd56a7fc700 1 --2- 172.21.15.112:0/778198660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5740d1410 0x7fd57414a5a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd55c00c590 tx=0x7fd55c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:38.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.342+0000 7fd56b7fe700 1 -- 172.21.15.112:0/778198660 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c011590 con 0x7fd5740d1410 2023-10-06T04:40:38.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.342+0000 7fd56b7fe700 1 -- 172.21.15.112:0/778198660 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55c011710 con 0x7fd5740d1410 2023-10-06T04:40:38.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.342+0000 7fd5799ad700 1 -- 172.21.15.112:0/778198660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd574158780 con 0x7fd5740d1410 2023-10-06T04:40:38.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.342+0000 7fd56b7fe700 1 -- 172.21.15.112:0/778198660 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c011ad0 con 0x7fd5740d1410 2023-10-06T04:40:38.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.342+0000 7fd5799ad700 1 -- 172.21.15.112:0/778198660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd57414aae0 con 0x7fd5740d1410 2023-10-06T04:40:38.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.343+0000 7fd5799ad700 1 -- 172.21.15.112:0/778198660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd57405f230 con 0x7fd5740d1410 2023-10-06T04:40:38.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.343+0000 7fd56b7fe700 1 -- 172.21.15.112:0/778198660 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fd55c01b3b0 con 0x7fd5740d1410 2023-10-06T04:40:38.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.344+0000 7fd56b7fe700 1 --2- 172.21.15.112:0/778198660 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd5540670e0 0x7fd554069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.344+0000 7fd56b7fe700 1 -- 172.21.15.112:0/778198660 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fd55c083b60 con 0x7fd5740d1410 2023-10-06T04:40:38.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.344+0000 7fd572ffd700 1 --2- 172.21.15.112:0/778198660 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd5540670e0 0x7fd554069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.344+0000 7fd572ffd700 1 --2- 172.21.15.112:0/778198660 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd5540670e0 0x7fd554069590 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd5640099b0 tx=0x7fd564017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:38.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.348+0000 7fd56b7fe700 1 -- 172.21.15.112:0/778198660 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd55c050cf0 con 0x7fd5740d1410 2023-10-06T04:40:38.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.529+0000 7fd5799ad700 1 -- 172.21.15.112:0/778198660 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5740cef50 con 0x7fd5540670e0 2023-10-06T04:40:38.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.529+0000 7fd56b7fe700 1 -- 172.21.15.112:0/778198660 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd5740cef50 con 0x7fd5540670e0 2023-10-06T04:40:38.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.531+0000 7fd5799ad700 1 -- 172.21.15.112:0/778198660 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd5540670e0 msgr2=0x7fd554069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.531+0000 7fd5799ad700 1 --2- 172.21.15.112:0/778198660 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd5540670e0 0x7fd554069590 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd5640099b0 tx=0x7fd564017000 comp rx=0 tx=0).stop 2023-10-06T04:40:38.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.531+0000 7fd5799ad700 1 -- 172.21.15.112:0/778198660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5740d1410 msgr2=0x7fd57414a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.531+0000 7fd5799ad700 1 --2- 172.21.15.112:0/778198660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5740d1410 0x7fd57414a5a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd55c00c590 tx=0x7fd55c00c8a0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.531+0000 7fd5799ad700 1 -- 172.21.15.112:0/778198660 shutdown_connections 2023-10-06T04:40:38.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.531+0000 7fd5799ad700 1 --2- 172.21.15.112:0/778198660 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fd5540670e0 0x7fd554069590 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.531+0000 7fd5799ad700 1 --2- 172.21.15.112:0/778198660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd57415cd20 0x7fd57416d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.531+0000 7fd5799ad700 1 --2- 172.21.15.112:0/778198660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5740d0350 0x7fd5740b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.531+0000 7fd5799ad700 1 --2- 172.21.15.112:0/778198660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5740d1410 0x7fd57414a5a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.531+0000 7fd5799ad700 1 -- 172.21.15.112:0/778198660 >> 172.21.15.112:0/778198660 conn(0x7fd57406cfb0 msgr2=0x7fd57415d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:38.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.531+0000 7fd5799ad700 1 -- 172.21.15.112:0/778198660 shutdown_connections 2023-10-06T04:40:38.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.531+0000 7fd5799ad700 1 -- 172.21.15.112:0/778198660 wait complete. 2023-10-06T04:40:38.536 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T04:40:38.546 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:40:38.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.658+0000 7f6cea291700 1 Processor -- start 2023-10-06T04:40:38.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.658+0000 7f6cea291700 1 -- start start 2023-10-06T04:40:38.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.659+0000 7f6cea291700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ce415aa00 0x7f6ce41585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.659+0000 7f6cea291700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ce4067eb0 0x7f6ce4068320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.659+0000 7f6cea291700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce4068860 con 0x7f6ce4069690 2023-10-06T04:40:38.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.659+0000 7f6cea291700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce4158b30 con 0x7f6ce4067eb0 2023-10-06T04:40:38.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.659+0000 7f6cea291700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce415b500 con 0x7f6ce415aa00 2023-10-06T04:40:38.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.659+0000 7f6ce37fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ce4067eb0 0x7f6ce4068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.659+0000 7f6ce37fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ce4067eb0 0x7f6ce4068320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59630/0 (socket says 172.21.15.112:59630) 2023-10-06T04:40:38.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.659+0000 7f6ce37fe700 1 -- 172.21.15.112:0/244855018 learned_addr learned my addr 172.21.15.112:0/244855018 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:38.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.659+0000 7f6ce3fff700 1 --2- 172.21.15.112:0/244855018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ce415aa00 0x7f6ce41585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.660+0000 7f6ce37fe700 1 -- 172.21.15.112:0/244855018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ce415aa00 msgr2=0x7f6ce41585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:38.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.660+0000 7f6ce37fe700 1 --2- 172.21.15.112:0/244855018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ce415aa00 0x7f6ce41585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.660+0000 7f6ce37fe700 1 -- 172.21.15.112:0/244855018 >> v1:172.21.15.179:6789/0 conn(0x7f6ce4069690 legacy=0x7f6ce4069a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.660+0000 7f6ce37fe700 1 -- 172.21.15.112:0/244855018 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce415b7e0 con 0x7f6ce4067eb0 2023-10-06T04:40:38.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.660+0000 7f6ce37fe700 1 --2- 172.21.15.112:0/244855018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce4067eb0 0x7f6ce4068320 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6cd80099b0 tx=0x7f6cd8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f942f7e552f104 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:38.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.660+0000 7f6ce2ffd700 1 -- 172.21.15.112:0/244855018 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8009ea0 con 0x7f6ce4067eb0 2023-10-06T04:40:38.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.660+0000 7f6ce2ffd700 1 -- 172.21.15.112:0/244855018 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd800b860 con 0x7f6ce4067eb0 2023-10-06T04:40:38.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.660+0000 7f6ce2ffd700 1 -- 172.21.15.112:0/244855018 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd800bc00 con 0x7f6ce4067eb0 2023-10-06T04:40:38.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.661+0000 7f6cea291700 1 -- 172.21.15.112:0/244855018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce4067eb0 msgr2=0x7f6ce4068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.661+0000 7f6cea291700 1 --2- 172.21.15.112:0/244855018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce4067eb0 0x7f6ce4068320 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6cd80099b0 tx=0x7f6cd8009250 comp rx=0 tx=0).stop 2023-10-06T04:40:38.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.661+0000 7f6cea291700 1 -- 172.21.15.112:0/244855018 shutdown_connections 2023-10-06T04:40:38.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.661+0000 7f6cea291700 1 --2- 172.21.15.112:0/244855018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ce415aa00 0x7f6ce41585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.661+0000 7f6cea291700 1 --2- 172.21.15.112:0/244855018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce4067eb0 0x7f6ce4068320 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.661+0000 7f6cea291700 1 -- 172.21.15.112:0/244855018 >> 172.21.15.112:0/244855018 conn(0x7f6ce40ce5e0 msgr2=0x7f6ce40ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:38.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.661+0000 7f6cea291700 1 -- 172.21.15.112:0/244855018 shutdown_connections 2023-10-06T04:40:38.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.661+0000 7f6cea291700 1 -- 172.21.15.112:0/244855018 wait complete. 2023-10-06T04:40:38.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.662+0000 7f6cea291700 1 Processor -- start 2023-10-06T04:40:38.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.662+0000 7f6cea291700 1 -- start start 2023-10-06T04:40:38.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.663+0000 7f6cea291700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ce4067eb0 0x7f6ce41538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.663+0000 7f6cea291700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce4069690 0x7f6ce406e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.663+0000 7f6cea291700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ce415aa00 0x7f6ce416d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.663+0000 7f6cea291700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40c3580 con 0x7f6ce4069690 2023-10-06T04:40:38.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.663+0000 7f6cea291700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce406f140 con 0x7f6ce4067eb0 2023-10-06T04:40:38.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.663+0000 7f6cea291700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce406f420 con 0x7f6ce415aa00 2023-10-06T04:40:38.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.663+0000 7f6ce37fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce4069690 0x7f6ce406e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.663+0000 7f6ce37fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce4069690 0x7f6ce406e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59632/0 (socket says 172.21.15.112:59632) 2023-10-06T04:40:38.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.663+0000 7f6ce37fe700 1 -- 172.21.15.112:0/4271203358 learned_addr learned my addr 172.21.15.112:0/4271203358 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:38.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.663+0000 7f6ce882e700 1 --2- 172.21.15.112:0/4271203358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ce415aa00 0x7f6ce416d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.663+0000 7f6ce3fff700 1 --2- 172.21.15.112:0/4271203358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ce4067eb0 0x7f6ce41538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.663+0000 7f6ce37fe700 1 -- 172.21.15.112:0/4271203358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ce415aa00 msgr2=0x7f6ce416d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.663+0000 7f6ce37fe700 1 --2- 172.21.15.112:0/4271203358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ce415aa00 0x7f6ce416d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.663+0000 7f6ce37fe700 1 -- 172.21.15.112:0/4271203358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ce4067eb0 msgr2=0x7f6ce41538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.663+0000 7f6ce37fe700 1 --2- 172.21.15.112:0/4271203358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ce4067eb0 0x7f6ce41538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.663+0000 7f6ce37fe700 1 -- 172.21.15.112:0/4271203358 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd80094f0 con 0x7f6ce4069690 2023-10-06T04:40:38.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.663+0000 7f6ce37fe700 1 --2- 172.21.15.112:0/4271203358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce4069690 0x7f6ce406e6a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4071020 tx=0x7f6cd8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:38.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.663+0000 7f6ccbfff700 1 -- 172.21.15.112:0/4271203358 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8000d10 con 0x7f6ce4069690 2023-10-06T04:40:38.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.663+0000 7f6ccbfff700 1 -- 172.21.15.112:0/4271203358 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd800bbe0 con 0x7f6ce4069690 2023-10-06T04:40:38.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.663+0000 7f6ccbfff700 1 -- 172.21.15.112:0/4271203358 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8011670 con 0x7f6ce4069690 2023-10-06T04:40:38.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.663+0000 7f6cea291700 1 -- 172.21.15.112:0/4271203358 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce406f700 con 0x7f6ce4069690 2023-10-06T04:40:38.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.664+0000 7f6cea291700 1 -- 172.21.15.112:0/4271203358 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce416e1c0 con 0x7f6ce4069690 2023-10-06T04:40:38.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.664+0000 7f6cea291700 1 -- 172.21.15.112:0/4271203358 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce405f230 con 0x7f6ce4069690 2023-10-06T04:40:38.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.665+0000 7f6ccbfff700 1 -- 172.21.15.112:0/4271203358 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f6cd8011aa0 con 0x7f6ce4069690 2023-10-06T04:40:38.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.665+0000 7f6ccbfff700 1 --2- 172.21.15.112:0/4271203358 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6cd00670e0 0x7f6cd0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:38.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.665+0000 7f6ccbfff700 1 -- 172.21.15.112:0/4271203358 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f6cd8085b60 con 0x7f6ce4069690 2023-10-06T04:40:38.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.665+0000 7f6ce3fff700 1 --2- 172.21.15.112:0/4271203358 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6cd00670e0 0x7f6cd0069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:38.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.666+0000 7f6ce3fff700 1 --2- 172.21.15.112:0/4271203358 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6cd00670e0 0x7f6cd0069590 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009d10 tx=0x7f6cd40091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:38.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.669+0000 7f6ccbfff700 1 -- 172.21.15.112:0/4271203358 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cd8052cd0 con 0x7f6ce4069690 2023-10-06T04:40:38.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.847+0000 7f6cea291700 1 -- 172.21.15.112:0/4271203358 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ce415bac0 con 0x7f6cd00670e0 2023-10-06T04:40:38.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.849+0000 7f6ccbfff700 1 -- 172.21.15.112:0/4271203358 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73356 (secure 0 0 0) 0x7f6ce415bac0 con 0x7f6cd00670e0 2023-10-06T04:40:38.854 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:38.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.851+0000 7f6cea291700 1 -- 172.21.15.112:0/4271203358 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6cd00670e0 msgr2=0x7f6cd0069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.851+0000 7f6cea291700 1 --2- 172.21.15.112:0/4271203358 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6cd00670e0 0x7f6cd0069590 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009d10 tx=0x7f6cd40091a0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.851+0000 7f6cea291700 1 -- 172.21.15.112:0/4271203358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce4069690 msgr2=0x7f6ce406e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:38.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.851+0000 7f6cea291700 1 --2- 172.21.15.112:0/4271203358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce4069690 0x7f6ce406e6a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4071020 tx=0x7f6cd8017000 comp rx=0 tx=0).stop 2023-10-06T04:40:38.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.851+0000 7f6cea291700 1 -- 172.21.15.112:0/4271203358 shutdown_connections 2023-10-06T04:40:38.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.851+0000 7f6cea291700 1 --2- 172.21.15.112:0/4271203358 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f6cd00670e0 0x7f6cd0069590 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.852+0000 7f6cea291700 1 --2- 172.21.15.112:0/4271203358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ce415aa00 0x7f6ce416d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.852+0000 7f6cea291700 1 --2- 172.21.15.112:0/4271203358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ce4067eb0 0x7f6ce41538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.852+0000 7f6cea291700 1 --2- 172.21.15.112:0/4271203358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce4069690 0x7f6ce406e6a0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:38.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.852+0000 7f6cea291700 1 -- 172.21.15.112:0/4271203358 >> 172.21.15.112:0/4271203358 conn(0x7f6ce40ce5e0 msgr2=0x7f6ce4157460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:38.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.852+0000 7f6cea291700 1 -- 172.21.15.112:0/4271203358 shutdown_connections 2023-10-06T04:40:38.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:38.852+0000 7f6cea291700 1 -- 172.21.15.112:0/4271203358 wait complete. 2023-10-06T04:40:38.859 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-10-06T04:40:38.865 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-10-06T04:40:38.292998+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382532,"kb_used_data":4228,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592188,"statfs":{"total":773094113280,"available":770654400512,"internally_reserved":0,"allocated":4329472,"data_stored":2457839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.714629"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.579743+0000","last_change":"2023-10-06T04:39:16.067723+0000","last_active":"2023-10-06T04:40:26.579743+0000","last_peered":"2023-10-06T04:40:26.579743+0000","last_clean":"2023-10-06T04:40:26.579743+0000","last_became_active":"2023-10-06T04:39:16.067325+0000","last_became_peered":"2023-10-06T04:39:16.067325+0000","last_unstale":"2023-10-06T04:40:26.579743+0000","last_undegraded":"2023-10-06T04:40:26.579743+0000","last_fullsized":"2023-10-06T04:40:26.579743+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.888084+0000","last_change":"2023-10-06T04:39:15.592391+0000","last_active":"2023-10-06T04:40:26.888084+0000","last_peered":"2023-10-06T04:40:26.888084+0000","last_clean":"2023-10-06T04:40:26.888084+0000","last_became_active":"2023-10-06T04:39:15.592094+0000","last_became_peered":"2023-10-06T04:39:15.592094+0000","last_unstale":"2023-10-06T04:40:26.888084+0000","last_undegraded":"2023-10-06T04:40:26.888084+0000","last_fullsized":"2023-10-06T04:40:26.888084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.280766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.887209+0000","last_change":"2023-10-06T04:39:15.585112+0000","last_active":"2023-10-06T04:40:26.887209+0000","last_peered":"2023-10-06T04:40:26.887209+0000","last_clean":"2023-10-06T04:40:26.887209+0000","last_became_active":"2023-10-06T04:39:15.584853+0000","last_became_peered":"2023-10-06T04:39:15.584853+0000","last_unstale":"2023-10-06T04:40:26.887209+0000","last_undegraded":"2023-10-06T04:40:26.887209+0000","last_fullsized":"2023-10-06T04:40:26.887209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.888595+0000","last_change":"2023-10-06T04:39:15.588017+0000","last_active":"2023-10-06T04:40:26.888595+0000","last_peered":"2023-10-06T04:40:26.888595+0000","last_clean":"2023-10-06T04:40:26.888595+0000","last_became_active":"2023-10-06T04:39:15.586771+0000","last_became_peered":"2023-10-06T04:39:15.586771+0000","last_unstale":"2023-10-06T04:40:26.888595+0000","last_undegraded":"2023-10-06T04:40:26.888595+0000","last_fullsized":"2023-10-06T04:40:26.888595+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:35.225282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.888672+0000","last_change":"2023-10-06T04:39:16.252521+0000","last_active":"2023-10-06T04:40:26.888672+0000","last_peered":"2023-10-06T04:40:26.888672+0000","last_clean":"2023-10-06T04:40:26.888672+0000","last_became_active":"2023-10-06T04:39:16.252245+0000","last_became_peered":"2023-10-06T04:39:16.252245+0000","last_unstale":"2023-10-06T04:40:26.888672+0000","last_undegraded":"2023-10-06T04:40:26.888672+0000","last_fullsized":"2023-10-06T04:40:26.888672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:17.694713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.888541+0000","last_change":"2023-10-06T04:39:16.252493+0000","last_active":"2023-10-06T04:40:26.888541+0000","last_peered":"2023-10-06T04:40:26.888541+0000","last_clean":"2023-10-06T04:40:26.888541+0000","last_became_active":"2023-10-06T04:39:16.252190+0000","last_became_peered":"2023-10-06T04:39:16.252190+0000","last_unstale":"2023-10-06T04:40:26.888541+0000","last_undegraded":"2023-10-06T04:40:26.888541+0000","last_fullsized":"2023-10-06T04:40:26.888541+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:59.554724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.889435+0000","last_change":"2023-10-06T04:39:16.252554+0000","last_active":"2023-10-06T04:40:26.889435+0000","last_peered":"2023-10-06T04:40:26.889435+0000","last_clean":"2023-10-06T04:40:26.889435+0000","last_became_active":"2023-10-06T04:39:16.252225+0000","last_became_peered":"2023-10-06T04:39:16.252225+0000","last_unstale":"2023-10-06T04:40:26.889435+0000","last_undegraded":"2023-10-06T04:40:26.889435+0000","last_fullsized":"2023-10-06T04:40:26.889435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.280766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.889301+0000","last_change":"2023-10-06T04:39:16.253021+0000","last_active":"2023-10-06T04:40:26.889301+0000","last_peered":"2023-10-06T04:40:26.889301+0000","last_clean":"2023-10-06T04:40:26.889301+0000","last_became_active":"2023-10-06T04:39:16.252478+0000","last_became_peered":"2023-10-06T04:39:16.252478+0000","last_unstale":"2023-10-06T04:40:26.889301+0000","last_undegraded":"2023-10-06T04:40:26.889301+0000","last_fullsized":"2023-10-06T04:40:26.889301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:07.439434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:40:26.889151+0000","last_change":"2023-10-06T04:39:15.587681+0000","last_active":"2023-10-06T04:40:26.889151+0000","last_peered":"2023-10-06T04:40:26.889151+0000","last_clean":"2023-10-06T04:40:26.889151+0000","last_became_active":"2023-10-06T04:39:15.587313+0000","last_became_peered":"2023-10-06T04:39:15.587313+0000","last_unstale":"2023-10-06T04:40:26.889151+0000","last_undegraded":"2023-10-06T04:40:26.889151+0000","last_fullsized":"2023-10-06T04:40:26.889151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:39:14.569875+0000","last_clean_scrub_stamp":"2023-10-06T04:39:14.569875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.788561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298252,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073588,"statfs":{"total":96636764160,"available":96331354112,"internally_reserved":0,"allocated":987136,"data_stored":750175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.40400000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.36899999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.497},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.43099999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":0.60799999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.622},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":0.46600000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.4209999999999998,"5min":2.4209999999999998,"15min":2.4209999999999998},"last":0.56599999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":8.1910000000000007,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":0.36199999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.7910000000000004,"5min":7.7910000000000004,"15min":7.7910000000000004},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.621,"5min":2.621,"15min":2.621},"last":0.40200000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.851,"5min":2.851,"15min":2.851},"last":0.44}]},{"osd":3,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.9569999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.47299999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.50800000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.49399999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.48599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298252,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073588,"statfs":{"total":96636764160,"available":96331354112,"internally_reserved":0,"allocated":987136,"data_stored":750175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"last":0.38500000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"last":0.44700000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.501},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.55400000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.69699999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.754},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.76500000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.67900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.29899999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52100000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.502},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.59899999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.49199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.318},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.26300000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.34499999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.38900000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.441}]},{"osd":6,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.502}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.33500000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.371}]},{"osd":2,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.31},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.31900000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.56299999999999994}]},{"osd":7,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.53800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.42399999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.45100000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.5}]},{"osd":3,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51300000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57099999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.54900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":158454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.57799999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.718,"5min":4.718,"15min":4.718},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.374},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.60299999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.432}]},{"osd":7,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.504},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.47199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:40:38.871 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-10-06T04:39:14.569875+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=39, tm_sec=14, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=40, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:40:38.871 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-10-06T04:39:14.569875+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=39, tm_sec=14, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=40, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:40:38.871 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-10-06T04:39:14.569875+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=39, tm_sec=14, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=40, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:40:38.871 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T04:39:14.569875+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=39, tm_sec=14, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=40, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:40:38.872 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-10-06T04:39:14.569875+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=39, tm_sec=14, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=40, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:40:38.872 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T04:39:14.569875+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=39, tm_sec=14, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=40, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:40:38.872 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-10-06T04:39:14.569875+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=39, tm_sec=14, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=40, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:40:38.872 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-10-06T04:39:14.569875+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=39, tm_sec=14, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=40, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:40:38.872 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-10-06T04:39:14.569875+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=39, tm_sec=14, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=40, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:40:38.872 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T04:40:57.094 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:40:57.097 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:40:58.873 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:40:59.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:58.999+0000 7fa082291700 1 Processor -- start 2023-10-06T04:40:59.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:58.999+0000 7fa082291700 1 -- start start 2023-10-06T04:40:59.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:58.999+0000 7fa082291700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa07c0b0e70 0x7fa07c0b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:59.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:58.999+0000 7fa082291700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07c0cd740 con 0x7fa07c0b3040 2023-10-06T04:40:59.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:58.999+0000 7fa082291700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07c0b17d0 con 0x7fa07c159d50 2023-10-06T04:40:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:58.999+0000 7fa082291700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa07c0b3490 con 0x7fa07c0b0e70 2023-10-06T04:40:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.000+0000 7fa07b7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa07c0b3040 0x7fa07c0cdbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33414/0 (socket says 172.21.15.112:33414) 2023-10-06T04:40:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.000+0000 7fa07b7fe700 1 -- 172.21.15.112:0/3712147029 learned_addr learned my addr 172.21.15.112:0/3712147029 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.000+0000 7fa08082e700 1 --2- 172.21.15.112:0/3712147029 >> v2:172.21.15.179:3300/0 conn(0x7fa07c0b0e70 0x7fa07c0b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.000+0000 7fa07affd700 1 -- 172.21.15.112:0/3712147029 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880925755 0 0) 0x7fa07c0cd740 con 0x7fa07c0b3040 2023-10-06T04:40:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.000+0000 7fa07affd700 1 -- 172.21.15.112:0/3712147029 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa064003570 con 0x7fa07c0b3040 2023-10-06T04:40:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.000+0000 7fa08082e700 1 -- 172.21.15.112:0/3712147029 >> v1:172.21.15.179:6789/0 conn(0x7fa07c159d50 legacy=0x7fa07c15a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.000+0000 7fa08082e700 1 -- 172.21.15.112:0/3712147029 >> v1:172.21.15.112:6789/0 conn(0x7fa07c0b3040 legacy=0x7fa07c0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.000+0000 7fa08082e700 1 -- 172.21.15.112:0/3712147029 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c0ccb30 con 0x7fa07c0b0e70 2023-10-06T04:40:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.000+0000 7fa08082e700 1 --2- 172.21.15.112:0/3712147029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa07c0b0e70 0x7fa07c0b1290 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa074009e60 tx=0x7fa074009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=294af2d549eee4e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.000+0000 7fa07affd700 1 -- 172.21.15.112:0/3712147029 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07400e070 con 0x7fa07c0b0e70 2023-10-06T04:40:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.001+0000 7fa07affd700 1 -- 172.21.15.112:0/3712147029 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07400bb60 con 0x7fa07c0b0e70 2023-10-06T04:40:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.001+0000 7fa07affd700 1 -- 172.21.15.112:0/3712147029 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa074012430 con 0x7fa07c0b0e70 2023-10-06T04:40:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.001+0000 7fa082291700 1 -- 172.21.15.112:0/3712147029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa07c0b0e70 msgr2=0x7fa07c0b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.001+0000 7fa082291700 1 --2- 172.21.15.112:0/3712147029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa07c0b0e70 0x7fa07c0b1290 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa074009e60 tx=0x7fa074009780 comp rx=0 tx=0).stop 2023-10-06T04:40:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.001+0000 7fa082291700 1 -- 172.21.15.112:0/3712147029 shutdown_connections 2023-10-06T04:40:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.001+0000 7fa082291700 1 --2- 172.21.15.112:0/3712147029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa07c0b0e70 0x7fa07c0b1290 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.001+0000 7fa082291700 1 -- 172.21.15.112:0/3712147029 >> 172.21.15.112:0/3712147029 conn(0x7fa07c099b60 msgr2=0x7fa07c06cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.001+0000 7fa082291700 1 -- 172.21.15.112:0/3712147029 shutdown_connections 2023-10-06T04:40:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.001+0000 7fa082291700 1 -- 172.21.15.112:0/3712147029 wait complete. 2023-10-06T04:40:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.002+0000 7fa082291700 1 Processor -- start 2023-10-06T04:40:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.002+0000 7fa082291700 1 -- start start 2023-10-06T04:40:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.003+0000 7fa082291700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa07c0b0e70 0x7fa07c0b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.003+0000 7fa082291700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa07c0b3040 0x7fa07c0a11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.003+0000 7fa082291700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa07c159d50 0x7fa07c0cf760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.003+0000 7fa082291700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0b4a70 con 0x7fa07c0b3040 2023-10-06T04:40:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.003+0000 7fa082291700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0a1710 con 0x7fa07c159d50 2023-10-06T04:40:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.003+0000 7fa082291700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0b3e60 con 0x7fa07c0b0e70 2023-10-06T04:40:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.003+0000 7fa07b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa07c0b3040 0x7fa07c0a11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.003+0000 7fa07b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa07c0b3040 0x7fa07c0a11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46412/0 (socket says 172.21.15.112:46412) 2023-10-06T04:40:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.003+0000 7fa07b7fe700 1 -- 172.21.15.112:0/1751523074 learned_addr learned my addr 172.21.15.112:0/1751523074 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.003+0000 7fa07bfff700 1 --2- 172.21.15.112:0/1751523074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa07c0b0e70 0x7fa07c0b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.003+0000 7fa08082e700 1 --2- 172.21.15.112:0/1751523074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa07c159d50 0x7fa07c0cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.003+0000 7fa07b7fe700 1 -- 172.21.15.112:0/1751523074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa07c0b0e70 msgr2=0x7fa07c0b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.003+0000 7fa07b7fe700 1 --2- 172.21.15.112:0/1751523074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa07c0b0e70 0x7fa07c0b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.003+0000 7fa07b7fe700 1 -- 172.21.15.112:0/1751523074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa07c159d50 msgr2=0x7fa07c0cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.003+0000 7fa07b7fe700 1 --2- 172.21.15.112:0/1751523074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa07c159d50 0x7fa07c0cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.003+0000 7fa07b7fe700 1 -- 172.21.15.112:0/1751523074 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa074009a20 con 0x7fa07c0b3040 2023-10-06T04:40:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.003+0000 7fa07bfff700 1 --2- 172.21.15.112:0/1751523074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa07c0b0e70 0x7fa07c0b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.003+0000 7fa08082e700 1 --2- 172.21.15.112:0/1751523074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa07c159d50 0x7fa07c0cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.004+0000 7fa07b7fe700 1 --2- 172.21.15.112:0/1751523074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa07c0b3040 0x7fa07c0a11d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa07000c7f0 tx=0x7fa070007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.004+0000 7fa063fff700 1 -- 172.21.15.112:0/1751523074 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa070005b30 con 0x7fa07c0b3040 2023-10-06T04:40:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.004+0000 7fa063fff700 1 -- 172.21.15.112:0/1751523074 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa070005c90 con 0x7fa07c0b3040 2023-10-06T04:40:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.004+0000 7fa063fff700 1 -- 172.21.15.112:0/1751523074 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa070007340 con 0x7fa07c0b3040 2023-10-06T04:40:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.004+0000 7fa082291700 1 -- 172.21.15.112:0/1751523074 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07c0b4140 con 0x7fa07c0b3040 2023-10-06T04:40:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.004+0000 7fa082291700 1 -- 172.21.15.112:0/1751523074 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07c0b4700 con 0x7fa07c0b3040 2023-10-06T04:40:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.005+0000 7fa082291700 1 -- 172.21.15.112:0/1751523074 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07c05f230 con 0x7fa07c0b3040 2023-10-06T04:40:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.005+0000 7fa063fff700 1 -- 172.21.15.112:0/1751523074 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fa07001b400 con 0x7fa07c0b3040 2023-10-06T04:40:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.005+0000 7fa063fff700 1 --2- 172.21.15.112:0/1751523074 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa0680670e0 0x7fa068069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.006+0000 7fa063fff700 1 -- 172.21.15.112:0/1751523074 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fa070084240 con 0x7fa07c0b3040 2023-10-06T04:40:59.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.006+0000 7fa07bfff700 1 --2- 172.21.15.112:0/1751523074 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa0680670e0 0x7fa068069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:59.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.006+0000 7fa07bfff700 1 --2- 172.21.15.112:0/1751523074 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa0680670e0 0x7fa068069590 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa06c007fd0 tx=0x7fa06c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:59.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.010+0000 7fa063fff700 1 -- 172.21.15.112:0/1751523074 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa070051460 con 0x7fa07c0b3040 2023-10-06T04:40:59.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.189+0000 7fa082291700 1 -- 172.21.15.112:0/1751523074 --> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa07c15c350 con 0x7fa0680670e0 2023-10-06T04:40:59.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.192+0000 7fa063fff700 1 -- 172.21.15.112:0/1751523074 <== mgr.4105 v2:172.21.15.112:6832/90409 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73467 (secure 0 0 0) 0x7fa07c15c350 con 0x7fa0680670e0 2023-10-06T04:40:59.195 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:59.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.194+0000 7fa082291700 1 -- 172.21.15.112:0/1751523074 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa0680670e0 msgr2=0x7fa068069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:59.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.194+0000 7fa082291700 1 --2- 172.21.15.112:0/1751523074 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa0680670e0 0x7fa068069590 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa06c007fd0 tx=0x7fa06c009040 comp rx=0 tx=0).stop 2023-10-06T04:40:59.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.194+0000 7fa082291700 1 -- 172.21.15.112:0/1751523074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa07c0b3040 msgr2=0x7fa07c0a11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:59.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.194+0000 7fa082291700 1 --2- 172.21.15.112:0/1751523074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa07c0b3040 0x7fa07c0a11d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa07000c7f0 tx=0x7fa070007e00 comp rx=0 tx=0).stop 2023-10-06T04:40:59.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.194+0000 7fa082291700 1 -- 172.21.15.112:0/1751523074 shutdown_connections 2023-10-06T04:40:59.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.194+0000 7fa082291700 1 --2- 172.21.15.112:0/1751523074 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fa0680670e0 0x7fa068069590 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.194+0000 7fa082291700 1 --2- 172.21.15.112:0/1751523074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa07c159d50 0x7fa07c0cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.194+0000 7fa082291700 1 --2- 172.21.15.112:0/1751523074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa07c0b0e70 0x7fa07c0b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.194+0000 7fa082291700 1 --2- 172.21.15.112:0/1751523074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa07c0b3040 0x7fa07c0a11d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.194+0000 7fa082291700 1 -- 172.21.15.112:0/1751523074 >> 172.21.15.112:0/1751523074 conn(0x7fa07c099b60 msgr2=0x7fa07c06f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:59.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.194+0000 7fa082291700 1 -- 172.21.15.112:0/1751523074 shutdown_connections 2023-10-06T04:40:59.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.194+0000 7fa082291700 1 -- 172.21.15.112:0/1751523074 wait complete. 2023-10-06T04:40:59.198 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-10-06T04:40:59.208 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2023-10-06T04:40:58.297439+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382532,"kb_used_data":4228,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592188,"statfs":{"total":773094113280,"available":770654400512,"internally_reserved":0,"allocated":4329472,"data_stored":2457839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002597"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T04:40:41.951353+0000","last_change":"2023-10-06T04:40:41.951301+0000","last_active":"2023-10-06T04:40:41.951353+0000","last_peered":"2023-10-06T04:40:41.951353+0000","last_clean":"2023-10-06T04:40:41.951353+0000","last_became_active":"2023-10-06T04:39:16.067325+0000","last_became_peered":"2023-10-06T04:39:16.067325+0000","last_unstale":"2023-10-06T04:40:41.951353+0000","last_undegraded":"2023-10-06T04:40:41.951353+0000","last_fullsized":"2023-10-06T04:40:41.951353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:41.951165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:41.951165+0000","last_clean_scrub_stamp":"2023-10-06T04:40:41.951165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:53:21.868405+0000","scrub_duration":0.0023762980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T04:40:37.070293+0000","last_change":"2023-10-06T04:40:37.070272+0000","last_active":"2023-10-06T04:40:37.070293+0000","last_peered":"2023-10-06T04:40:37.070293+0000","last_clean":"2023-10-06T04:40:37.070293+0000","last_became_active":"2023-10-06T04:39:15.592094+0000","last_became_peered":"2023-10-06T04:39:15.592094+0000","last_unstale":"2023-10-06T04:40:37.070293+0000","last_undegraded":"2023-10-06T04:40:37.070293+0000","last_fullsized":"2023-10-06T04:40:37.070293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:37.070187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:37.070187+0000","last_clean_scrub_stamp":"2023-10-06T04:40:37.070187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:33:39.518611+0000","scrub_duration":0.001861033,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T04:40:36.091937+0000","last_change":"2023-10-06T04:40:36.091916+0000","last_active":"2023-10-06T04:40:36.091937+0000","last_peered":"2023-10-06T04:40:36.091937+0000","last_clean":"2023-10-06T04:40:36.091937+0000","last_became_active":"2023-10-06T04:39:15.584853+0000","last_became_peered":"2023-10-06T04:39:15.584853+0000","last_unstale":"2023-10-06T04:40:36.091937+0000","last_undegraded":"2023-10-06T04:40:36.091937+0000","last_fullsized":"2023-10-06T04:40:36.091937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:36.091822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:36.091822+0000","last_clean_scrub_stamp":"2023-10-06T04:40:36.091822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:17.674126+0000","scrub_duration":0.0019321399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"34'119","reported_seq":186,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T04:40:43.327895+0000","last_change":"2023-10-06T04:40:43.327866+0000","last_active":"2023-10-06T04:40:43.327895+0000","last_peered":"2023-10-06T04:40:43.327895+0000","last_clean":"2023-10-06T04:40:43.327895+0000","last_became_active":"2023-10-06T04:39:15.586771+0000","last_became_peered":"2023-10-06T04:39:15.586771+0000","last_unstale":"2023-10-06T04:40:43.327895+0000","last_undegraded":"2023-10-06T04:40:43.327895+0000","last_fullsized":"2023-10-06T04:40:43.327895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2023-10-06T04:40:43.327764+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2023-10-06T04:40:43.327764+0000","last_clean_scrub_stamp":"2023-10-06T04:40:43.327764+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:15.447776+0000","scrub_duration":0.007500451,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T04:40:41.360522+0000","last_change":"2023-10-06T04:40:41.360476+0000","last_active":"2023-10-06T04:40:41.360522+0000","last_peered":"2023-10-06T04:40:41.360522+0000","last_clean":"2023-10-06T04:40:41.360522+0000","last_became_active":"2023-10-06T04:39:16.252245+0000","last_became_peered":"2023-10-06T04:39:16.252245+0000","last_unstale":"2023-10-06T04:40:41.360522+0000","last_undegraded":"2023-10-06T04:40:41.360522+0000","last_fullsized":"2023-10-06T04:40:41.360522+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:41.360359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:41.360359+0000","last_clean_scrub_stamp":"2023-10-06T04:40:41.360359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:36.586200+0000","scrub_duration":0.001866138,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T04:40:40.357334+0000","last_change":"2023-10-06T04:40:40.357304+0000","last_active":"2023-10-06T04:40:40.357334+0000","last_peered":"2023-10-06T04:40:40.357334+0000","last_clean":"2023-10-06T04:40:40.357334+0000","last_became_active":"2023-10-06T04:39:16.252190+0000","last_became_peered":"2023-10-06T04:39:16.252190+0000","last_unstale":"2023-10-06T04:40:40.357334+0000","last_undegraded":"2023-10-06T04:40:40.357334+0000","last_fullsized":"2023-10-06T04:40:40.357334+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:40.357191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:40.357191+0000","last_clean_scrub_stamp":"2023-10-06T04:40:40.357191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:33:42.805615+0000","scrub_duration":0.001876569,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T04:40:39.485263+0000","last_change":"2023-10-06T04:40:39.485235+0000","last_active":"2023-10-06T04:40:39.485263+0000","last_peered":"2023-10-06T04:40:39.485263+0000","last_clean":"2023-10-06T04:40:39.485263+0000","last_became_active":"2023-10-06T04:39:16.252225+0000","last_became_peered":"2023-10-06T04:39:16.252225+0000","last_unstale":"2023-10-06T04:40:39.485263+0000","last_undegraded":"2023-10-06T04:40:39.485263+0000","last_fullsized":"2023-10-06T04:40:39.485263+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:39.485115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:39.485115+0000","last_clean_scrub_stamp":"2023-10-06T04:40:39.485115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:33:41.933539+0000","scrub_duration":0.001702863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T04:40:38.869654+0000","last_change":"2023-10-06T04:40:38.869629+0000","last_active":"2023-10-06T04:40:38.869654+0000","last_peered":"2023-10-06T04:40:38.869654+0000","last_clean":"2023-10-06T04:40:38.869654+0000","last_became_active":"2023-10-06T04:39:16.252478+0000","last_became_peered":"2023-10-06T04:39:16.252478+0000","last_unstale":"2023-10-06T04:40:38.869654+0000","last_undegraded":"2023-10-06T04:40:38.869654+0000","last_fullsized":"2023-10-06T04:40:38.869654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:38.869509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:38.869509+0000","last_clean_scrub_stamp":"2023-10-06T04:40:38.869509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:49.038729+0000","scrub_duration":0.0016121270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T04:40:40.813761+0000","last_change":"2023-10-06T04:40:40.813734+0000","last_active":"2023-10-06T04:40:40.813761+0000","last_peered":"2023-10-06T04:40:40.813761+0000","last_clean":"2023-10-06T04:40:40.813761+0000","last_became_active":"2023-10-06T04:39:15.587313+0000","last_became_peered":"2023-10-06T04:39:15.587313+0000","last_unstale":"2023-10-06T04:40:40.813761+0000","last_undegraded":"2023-10-06T04:40:40.813761+0000","last_fullsized":"2023-10-06T04:40:40.813761+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:40:40.813613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:40:40.813613+0000","last_clean_scrub_stamp":"2023-10-06T04:40:40.813613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:31.827098+0000","scrub_duration":0.0016500519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298252,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073588,"statfs":{"total":96636764160,"available":96331354112,"internally_reserved":0,"allocated":987136,"data_stored":750175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.621}]},{"osd":1,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.61099999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.65600000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.64300000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":0.46999999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":0.44700000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.4209999999999998,"5min":2.4209999999999998,"15min":2.4209999999999998},"last":0.40999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":8.1910000000000007,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.623},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.7910000000000004,"5min":7.7910000000000004,"15min":7.7910000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.621,"5min":2.621,"15min":2.621},"last":0.58199999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.851,"5min":2.851,"15min":2.851},"last":0.51800000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.9569999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.63500000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.441}]},{"osd":7,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.496},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.57099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298252,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073588,"statfs":{"total":96636764160,"available":96331354112,"internally_reserved":0,"allocated":987136,"data_stored":750175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"last":0.60499999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"last":0.65200000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.56999999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.80900000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.79700000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.75}]},{"osd":7,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.78300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"last":0.376},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.47399999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"last":0.443},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.498},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.51800000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.81000000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.72499999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.70699999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.35199999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.313},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.375}]},{"osd":3,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.46800000000000003}]},{"osd":4,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.495}]},{"osd":5,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.48199999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.50800000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.56499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.502}]},{"osd":1,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.629}]},{"osd":5,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.68899999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.77900000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.68000000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":159807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.378}]},{"osd":1,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.35699999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.441}]},{"osd":3,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.53200000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:40:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.498},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.56299999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":158454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.57099999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.718,"5min":4.718,"15min":4.718},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.59099999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":0.52300000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.40500000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:40:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.372},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.45900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:40:59.211 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T04:40:59.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.322+0000 7fcce64f1700 1 Processor -- start 2023-10-06T04:40:59.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.322+0000 7fcce64f1700 1 -- start start 2023-10-06T04:40:59.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.323+0000 7fcce64f1700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcce006db30 0x7fcce01614d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:59.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.323+0000 7fcce64f1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce00af340 con 0x7fcce00bf290 2023-10-06T04:40:59.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.323+0000 7fcce64f1700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce006aca0 con 0x7fcce00c36f0 2023-10-06T04:40:59.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.323+0000 7fcce64f1700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce006af80 con 0x7fcce006db30 2023-10-06T04:40:59.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.323+0000 7fcce54ef700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fcce00bf290 0x7fcce00aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33420/0 (socket says 172.21.15.112:33420) 2023-10-06T04:40:59.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.323+0000 7fcce54ef700 1 -- 172.21.15.112:0/4242769801 learned_addr learned my addr 172.21.15.112:0/4242769801 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-10-06T04:40:59.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.323+0000 7fcce5cf0700 1 --2- 172.21.15.112:0/4242769801 >> v2:172.21.15.179:3300/0 conn(0x7fcce006db30 0x7fcce01614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:59.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fccd7fff700 1 -- 172.21.15.112:0/4242769801 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591469768 0 0) 0x7fcce00af340 con 0x7fcce00bf290 2023-10-06T04:40:59.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fccd7fff700 1 -- 172.21.15.112:0/4242769801 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcccc003570 con 0x7fcce00bf290 2023-10-06T04:40:59.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fccd7fff700 1 -- 172.21.15.112:0/4242769801 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1133135469 0 0) 0x7fcccc003570 con 0x7fcce00bf290 2023-10-06T04:40:59.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fccd7fff700 1 -- 172.21.15.112:0/4242769801 >> v2:172.21.15.179:3300/0 conn(0x7fcce006db30 msgr2=0x7fcce01614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:59.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fccd7fff700 1 --2- 172.21.15.112:0/4242769801 >> v2:172.21.15.179:3300/0 conn(0x7fcce006db30 0x7fcce01614d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fccd7fff700 1 -- 172.21.15.112:0/4242769801 >> v1:172.21.15.179:6789/0 conn(0x7fcce00c36f0 legacy=0x7fcce0159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:59.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fccd7fff700 1 -- 172.21.15.112:0/4242769801 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce006b260 con 0x7fcce00bf290 2023-10-06T04:40:59.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fccd7fff700 1 -- 172.21.15.112:0/4242769801 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3532042052 0 0) 0x7fccdc001470 con 0x7fcce00bf290 2023-10-06T04:40:59.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fccd7fff700 1 -- 172.21.15.112:0/4242769801 >> v1:172.21.15.112:6789/0 conn(0x7fcce00bf290 legacy=0x7fcce00aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:59.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fccd7fff700 1 --2- 172.21.15.112:0/4242769801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcccc003a60 0x7fcccc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:59.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fccd7fff700 1 --2- 172.21.15.112:0/4242769801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcccc004810 0x7fcccc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:59.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fccd7fff700 1 --2- 172.21.15.112:0/4242769801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcccc0051c0 0x7fcccc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:59.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fccd7fff700 1 -- 172.21.15.112:0/4242769801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce006af80 con 0x7fcccc003a60 2023-10-06T04:40:59.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fccd7fff700 1 -- 172.21.15.112:0/4242769801 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcccc00c0d0 con 0x7fcccc004810 2023-10-06T04:40:59.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fccd7fff700 1 -- 172.21.15.112:0/4242769801 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcccc00e4a0 con 0x7fcccc0051c0 2023-10-06T04:40:59.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fcce54ef700 1 --2- 172.21.15.112:0/4242769801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcccc003a60 0x7fcccc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:59.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fcce4cee700 1 --2- 172.21.15.112:0/4242769801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcccc004810 0x7fcccc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:59.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fcce5cf0700 1 --2- 172.21.15.112:0/4242769801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcccc0051c0 0x7fcccc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:59.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fcce54ef700 1 -- 172.21.15.112:0/4242769801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcccc0051c0 msgr2=0x7fcccc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:59.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fcce54ef700 1 --2- 172.21.15.112:0/4242769801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcccc0051c0 0x7fcccc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fcce54ef700 1 -- 172.21.15.112:0/4242769801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcccc004810 msgr2=0x7fcccc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:59.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fcce54ef700 1 --2- 172.21.15.112:0/4242769801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcccc004810 0x7fcccc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fcce54ef700 1 -- 172.21.15.112:0/4242769801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcccc003570 con 0x7fcccc003a60 2023-10-06T04:40:59.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fcce5cf0700 1 --2- 172.21.15.112:0/4242769801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcccc0051c0 0x7fcccc00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:40:59.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fcce5cf0700 1 -- 172.21.15.112:0/4242769801 reap_dead start 2023-10-06T04:40:59.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.324+0000 7fcce54ef700 1 --2- 172.21.15.112:0/4242769801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcccc003a60 0x7fcccc003e70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00c390 tx=0x7fcce006c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6a76367147e44e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:59.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.325+0000 7fccd7fff700 1 -- 172.21.15.112:0/4242769801 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc00cc60 con 0x7fcccc003a60 2023-10-06T04:40:59.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.325+0000 7fccd7fff700 1 -- 172.21.15.112:0/4242769801 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc00cdc0 con 0x7fcccc003a60 2023-10-06T04:40:59.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.325+0000 7fccd7fff700 1 -- 172.21.15.112:0/4242769801 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc005b70 con 0x7fcccc003a60 2023-10-06T04:40:59.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.325+0000 7fcce64f1700 1 -- 172.21.15.112:0/4242769801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcccc003a60 msgr2=0x7fcccc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:59.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.325+0000 7fcce64f1700 1 --2- 172.21.15.112:0/4242769801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcccc003a60 0x7fcccc003e70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00c390 tx=0x7fcce006c7d0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.325+0000 7fcce64f1700 1 -- 172.21.15.112:0/4242769801 shutdown_connections 2023-10-06T04:40:59.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.325+0000 7fcce64f1700 1 --2- 172.21.15.112:0/4242769801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcccc003a60 0x7fcccc003e70 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.325+0000 7fcce64f1700 1 -- 172.21.15.112:0/4242769801 >> 172.21.15.112:0/4242769801 conn(0x7fcce00c94f0 msgr2=0x7fcce00c98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:59.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.325+0000 7fcce64f1700 1 -- 172.21.15.112:0/4242769801 shutdown_connections 2023-10-06T04:40:59.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.325+0000 7fcce64f1700 1 -- 172.21.15.112:0/4242769801 wait complete. 2023-10-06T04:40:59.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.326+0000 7fcce64f1700 1 Processor -- start 2023-10-06T04:40:59.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.326+0000 7fcce64f1700 1 -- start start 2023-10-06T04:40:59.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.327+0000 7fcce64f1700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcccc003a60 0x7fcce00cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:59.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.327+0000 7fcce64f1700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce01513f0 0x7fcce0151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:59.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.327+0000 7fcce64f1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce00c0f90 0x7fcce00c1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:59.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.327+0000 7fcce64f1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce01521a0 con 0x7fcce00c0f90 2023-10-06T04:40:59.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.327+0000 7fcce64f1700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce0152700 con 0x7fcce01513f0 2023-10-06T04:40:59.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.327+0000 7fcce64f1700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce0151da0 con 0x7fcccc003a60 2023-10-06T04:40:59.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.327+0000 7fcce5cf0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce00c0f90 0x7fcce00c1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:59.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.327+0000 7fcce5cf0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce00c0f90 0x7fcce00c1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46424/0 (socket says 172.21.15.112:46424) 2023-10-06T04:40:59.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.327+0000 7fcce5cf0700 1 -- 172.21.15.112:0/2856739864 learned_addr learned my addr 172.21.15.112:0/2856739864 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:59.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.327+0000 7fcce54ef700 1 --2- 172.21.15.112:0/2856739864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcccc003a60 0x7fcce00cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:59.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.328+0000 7fcce4cee700 1 --2- 172.21.15.112:0/2856739864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce01513f0 0x7fcce0151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:59.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.328+0000 7fcce5cf0700 1 -- 172.21.15.112:0/2856739864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcccc003a60 msgr2=0x7fcce00cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:59.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.328+0000 7fcce5cf0700 1 --2- 172.21.15.112:0/2856739864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcccc003a60 0x7fcce00cadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.328+0000 7fcce5cf0700 1 -- 172.21.15.112:0/2856739864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce01513f0 msgr2=0x7fcce0151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:59.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.328+0000 7fcce5cf0700 1 --2- 172.21.15.112:0/2856739864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce01513f0 0x7fcce0151860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.328+0000 7fcce5cf0700 1 -- 172.21.15.112:0/2856739864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce00c1d30 con 0x7fcce00c0f90 2023-10-06T04:40:59.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.328+0000 7fcce54ef700 1 --2- 172.21.15.112:0/2856739864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcccc003a60 0x7fcce00cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:40:59.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.328+0000 7fcce5cf0700 1 --2- 172.21.15.112:0/2856739864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce00c0f90 0x7fcce00c1430 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fcce0071aa0 tx=0x7fccd800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:59.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.328+0000 7fccd57fa700 1 -- 172.21.15.112:0/2856739864 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd801b070 con 0x7fcce00c0f90 2023-10-06T04:40:59.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.328+0000 7fccd57fa700 1 -- 172.21.15.112:0/2856739864 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd800f040 con 0x7fcce00c0f90 2023-10-06T04:40:59.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.328+0000 7fcce64f1700 1 -- 172.21.15.112:0/2856739864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce00c2010 con 0x7fcce00c0f90 2023-10-06T04:40:59.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.328+0000 7fccd57fa700 1 -- 172.21.15.112:0/2856739864 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd800e050 con 0x7fcce00c0f90 2023-10-06T04:40:59.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.328+0000 7fcce64f1700 1 -- 172.21.15.112:0/2856739864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce00c22f0 con 0x7fcce00c0f90 2023-10-06T04:40:59.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.329+0000 7fcce64f1700 1 -- 172.21.15.112:0/2856739864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce0152870 con 0x7fcce00c0f90 2023-10-06T04:40:59.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.329+0000 7fccd57fa700 1 -- 172.21.15.112:0/2856739864 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fccd8003020 con 0x7fcce00c0f90 2023-10-06T04:40:59.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.329+0000 7fccd57fa700 1 --2- 172.21.15.112:0/2856739864 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fccc40670e0 0x7fccc4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:59.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.330+0000 7fccd57fa700 1 -- 172.21.15.112:0/2856739864 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fccd8084c80 con 0x7fcce00c0f90 2023-10-06T04:40:59.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.330+0000 7fcce54ef700 1 --2- 172.21.15.112:0/2856739864 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fccc40670e0 0x7fccc4069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:59.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.330+0000 7fcce54ef700 1 --2- 172.21.15.112:0/2856739864 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fccc40670e0 0x7fccc4069590 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00c390 tx=0x7fccdc015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:59.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.334+0000 7fccd57fa700 1 -- 172.21.15.112:0/2856739864 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fccd8051d00 con 0x7fcce00c0f90 2023-10-06T04:40:59.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.518+0000 7fcce64f1700 1 -- 172.21.15.112:0/2856739864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fcce005f230 con 0x7fcce00c0f90 2023-10-06T04:40:59.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.523+0000 7fccd57fa700 1 -- 172.21.15.112:0/2856739864 <== mon.0 v2:172.21.15.112:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fccd8051d00 con 0x7fcce00c0f90 2023-10-06T04:40:59.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.523+0000 7fccd57fa700 1 -- 172.21.15.112:0/2856739864 <== mon.0 v2:172.21.15.112:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7fccd8010ea0 con 0x7fcce00c0f90 2023-10-06T04:40:59.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.525+0000 7fcce64f1700 1 -- 172.21.15.112:0/2856739864 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fccc40670e0 msgr2=0x7fccc4069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:59.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.525+0000 7fcce64f1700 1 --2- 172.21.15.112:0/2856739864 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fccc40670e0 0x7fccc4069590 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00c390 tx=0x7fccdc015000 comp rx=0 tx=0).stop 2023-10-06T04:40:59.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.525+0000 7fcce64f1700 1 -- 172.21.15.112:0/2856739864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce00c0f90 msgr2=0x7fcce00c1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:59.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.525+0000 7fcce64f1700 1 --2- 172.21.15.112:0/2856739864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce00c0f90 0x7fcce00c1430 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fcce0071aa0 tx=0x7fccd800b040 comp rx=0 tx=0).stop 2023-10-06T04:40:59.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.525+0000 7fcce64f1700 1 -- 172.21.15.112:0/2856739864 shutdown_connections 2023-10-06T04:40:59.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.525+0000 7fcce64f1700 1 --2- 172.21.15.112:0/2856739864 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7fccc40670e0 0x7fccc4069590 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.525+0000 7fcce64f1700 1 --2- 172.21.15.112:0/2856739864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce00c0f90 0x7fcce00c1430 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.525+0000 7fcce64f1700 1 --2- 172.21.15.112:0/2856739864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcccc003a60 0x7fcce00cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.525+0000 7fcce64f1700 1 --2- 172.21.15.112:0/2856739864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce01513f0 0x7fcce0151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.525+0000 7fcce64f1700 1 -- 172.21.15.112:0/2856739864 >> 172.21.15.112:0/2856739864 conn(0x7fcce00c94f0 msgr2=0x7fcce00aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:59.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.526+0000 7fcce64f1700 1 -- 172.21.15.112:0/2856739864 shutdown_connections 2023-10-06T04:40:59.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.526+0000 7fcce64f1700 1 -- 172.21.15.112:0/2856739864 wait complete. 2023-10-06T04:40:59.540 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:40:59.540 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:40:59.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.652+0000 7f4f14f5a700 1 Processor -- start 2023-10-06T04:40:59.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.652+0000 7f4f14f5a700 1 -- start start 2023-10-06T04:40:59.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.653+0000 7f4f14f5a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4f10157490 0x7f4f100688f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:59.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.653+0000 7f4f14f5a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4f100ccbf0 0x7f4f10069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:59.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.653+0000 7f4f14f5a700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f10158e60 con 0x7f4f10069720 2023-10-06T04:40:59.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.653+0000 7f4f14f5a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f100cd000 con 0x7f4f100ccbf0 2023-10-06T04:40:59.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.653+0000 7f4f14f5a700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1006a100 con 0x7f4f10157490 2023-10-06T04:40:59.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.653+0000 7f4f0ed9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4f100ccbf0 0x7f4f10069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:59.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.653+0000 7f4f0ed9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4f100ccbf0 0x7f4f10069bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46432/0 (socket says 172.21.15.112:46432) 2023-10-06T04:40:59.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.653+0000 7f4f0ed9d700 1 -- 172.21.15.112:0/453605409 learned_addr learned my addr 172.21.15.112:0/453605409 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:59.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.653+0000 7f4f0e59c700 1 --2- 172.21.15.112:0/453605409 >> v2:172.21.15.179:3300/0 conn(0x7f4f10157490 0x7f4f100688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:59.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.653+0000 7f4f0ed9d700 1 -- 172.21.15.112:0/453605409 >> v2:172.21.15.179:3300/0 conn(0x7f4f10157490 msgr2=0x7f4f100688f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:59.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.653+0000 7f4f0ed9d700 1 --2- 172.21.15.112:0/453605409 >> v2:172.21.15.179:3300/0 conn(0x7f4f10157490 0x7f4f100688f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.653+0000 7f4f0ed9d700 1 -- 172.21.15.112:0/453605409 >> v1:172.21.15.179:6789/0 conn(0x7f4f10069720 legacy=0x7f4f100cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:40:59.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.653+0000 7f4f0ed9d700 1 -- 172.21.15.112:0/453605409 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f10068460 con 0x7f4f100ccbf0 2023-10-06T04:40:59.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.653+0000 7f4f0ed9d700 1 --2- 172.21.15.112:0/453605409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f100ccbf0 0x7f4f10069bc0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4f1006b7c0 tx=0x7f4f08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45132158c1d370c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:59.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.654+0000 7f4f0d59a700 1 -- 172.21.15.112:0/453605409 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0800e070 con 0x7f4f100ccbf0 2023-10-06T04:40:59.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.654+0000 7f4f0d59a700 1 -- 172.21.15.112:0/453605409 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4f0800ba00 con 0x7f4f100ccbf0 2023-10-06T04:40:59.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.654+0000 7f4f0d59a700 1 -- 172.21.15.112:0/453605409 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f080092e0 con 0x7f4f100ccbf0 2023-10-06T04:40:59.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.654+0000 7f4f14f5a700 1 -- 172.21.15.112:0/453605409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f100ccbf0 msgr2=0x7f4f10069bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:59.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.654+0000 7f4f14f5a700 1 --2- 172.21.15.112:0/453605409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f100ccbf0 0x7f4f10069bc0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4f1006b7c0 tx=0x7f4f08009840 comp rx=0 tx=0).stop 2023-10-06T04:40:59.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.654+0000 7f4f14f5a700 1 -- 172.21.15.112:0/453605409 shutdown_connections 2023-10-06T04:40:59.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.654+0000 7f4f14f5a700 1 --2- 172.21.15.112:0/453605409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f100ccbf0 0x7f4f10069bc0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.654+0000 7f4f14f5a700 1 --2- 172.21.15.112:0/453605409 >> v2:172.21.15.179:3300/0 conn(0x7f4f10157490 0x7f4f100688f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.654+0000 7f4f14f5a700 1 -- 172.21.15.112:0/453605409 >> 172.21.15.112:0/453605409 conn(0x7f4f100ce630 msgr2=0x7f4f100cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:59.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.654+0000 7f4f14f5a700 1 -- 172.21.15.112:0/453605409 shutdown_connections 2023-10-06T04:40:59.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.654+0000 7f4f14f5a700 1 -- 172.21.15.112:0/453605409 wait complete. 2023-10-06T04:40:59.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.655+0000 7f4f14f5a700 1 Processor -- start 2023-10-06T04:40:59.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.655+0000 7f4f14f5a700 1 -- start start 2023-10-06T04:40:59.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.656+0000 7f4f14f5a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f10069720 0x7f4f100ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:59.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.656+0000 7f4f14f5a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f100ccbf0 0x7f4f100c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:59.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.656+0000 7f4f14f5a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f10157490 0x7f4f100af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:59.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.656+0000 7f4f14f5a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f100ad360 con 0x7f4f10157490 2023-10-06T04:40:59.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.656+0000 7f4f14f5a700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f10154c20 con 0x7f4f100ccbf0 2023-10-06T04:40:59.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.656+0000 7f4f14f5a700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f100c5ac0 con 0x7f4f10069720 2023-10-06T04:40:59.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.656+0000 7f4f0ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f10157490 0x7f4f100af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:59.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.656+0000 7f4f0ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f10157490 0x7f4f100af0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46446/0 (socket says 172.21.15.112:46446) 2023-10-06T04:40:59.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.656+0000 7f4f0ed9d700 1 -- 172.21.15.112:0/4091377864 learned_addr learned my addr 172.21.15.112:0/4091377864 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-10-06T04:40:59.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.656+0000 7f4f0e59c700 1 --2- 172.21.15.112:0/4091377864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f10069720 0x7f4f100ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:59.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.656+0000 7f4f0dd9b700 1 --2- 172.21.15.112:0/4091377864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f100ccbf0 0x7f4f100c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:59.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.657+0000 7f4f0ed9d700 1 -- 172.21.15.112:0/4091377864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f10069720 msgr2=0x7f4f100ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:59.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.657+0000 7f4f0ed9d700 1 --2- 172.21.15.112:0/4091377864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f10069720 0x7f4f100ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.657+0000 7f4f0ed9d700 1 -- 172.21.15.112:0/4091377864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f100ccbf0 msgr2=0x7f4f100c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:59.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.657+0000 7f4f0ed9d700 1 --2- 172.21.15.112:0/4091377864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f100ccbf0 0x7f4f100c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.657+0000 7f4f0ed9d700 1 -- 172.21.15.112:0/4091377864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f08009ae0 con 0x7f4f10157490 2023-10-06T04:40:59.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.657+0000 7f4f0ed9d700 1 --2- 172.21.15.112:0/4091377864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f10157490 0x7f4f100af0f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4f1006b410 tx=0x7f4f08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:59.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.657+0000 7f4efe7fc700 1 -- 172.21.15.112:0/4091377864 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f080094e0 con 0x7f4f10157490 2023-10-06T04:40:59.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.657+0000 7f4efe7fc700 1 -- 172.21.15.112:0/4091377864 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4f080092e0 con 0x7f4f10157490 2023-10-06T04:40:59.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.657+0000 7f4f14f5a700 1 -- 172.21.15.112:0/4091377864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f100c5da0 con 0x7f4f10157490 2023-10-06T04:40:59.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.657+0000 7f4efe7fc700 1 -- 172.21.15.112:0/4091377864 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0801d420 con 0x7f4f10157490 2023-10-06T04:40:59.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.657+0000 7f4f14f5a700 1 -- 172.21.15.112:0/4091377864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f100c6360 con 0x7f4f10157490 2023-10-06T04:40:59.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.658+0000 7f4f14f5a700 1 -- 172.21.15.112:0/4091377864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1005f230 con 0x7f4f10157490 2023-10-06T04:40:59.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.658+0000 7f4efe7fc700 1 -- 172.21.15.112:0/4091377864 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 6) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f4f0801d850 con 0x7f4f10157490 2023-10-06T04:40:59.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.658+0000 7f4efe7fc700 1 --2- 172.21.15.112:0/4091377864 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4ef00670e0 0x7f4ef0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:40:59.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.659+0000 7f4efe7fc700 1 -- 172.21.15.112:0/4091377864 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f4f08085c50 con 0x7f4f10157490 2023-10-06T04:40:59.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.659+0000 7f4f0e59c700 1 --2- 172.21.15.112:0/4091377864 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4ef00670e0 0x7f4ef0069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:40:59.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.659+0000 7f4f0e59c700 1 --2- 172.21.15.112:0/4091377864 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4ef00670e0 0x7f4ef0069590 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4f100b0060 tx=0x7f4f00008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:40:59.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.663+0000 7f4efe7fc700 1 -- 172.21.15.112:0/4091377864 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f0808b020 con 0x7f4f10157490 2023-10-06T04:40:59.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.886+0000 7f4f14f5a700 1 -- 172.21.15.112:0/4091377864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f10158e60 con 0x7f4f10157490 2023-10-06T04:40:59.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.886+0000 7f4efe7fc700 1 -- 172.21.15.112:0/4091377864 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f4f0802adf0 con 0x7f4f10157490 2023-10-06T04:40:59.889 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-10-06T04:40:59.889 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1053109253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1053109253},{"type":"v1","addr":"172.21.15.179:6835","nonce":1053109253}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4829,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3201763535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3201763535},{"type":"v1","addr":"172.21.15.179:6834","nonce":3201763535}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4974,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3563478163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3563478163},{"type":"v1","addr":"172.21.15.112:6836","nonce":3563478163}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4977,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/925043938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":925043938},{"type":"v1","addr":"172.21.15.112:6837","nonce":925043938}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-10-06T04:40:59.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.888+0000 7f4f14f5a700 1 -- 172.21.15.112:0/4091377864 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4ef00670e0 msgr2=0x7f4ef0069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:59.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.888+0000 7f4f14f5a700 1 --2- 172.21.15.112:0/4091377864 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4ef00670e0 0x7f4ef0069590 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4f100b0060 tx=0x7f4f00008040 comp rx=0 tx=0).stop 2023-10-06T04:40:59.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.888+0000 7f4f14f5a700 1 -- 172.21.15.112:0/4091377864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f10157490 msgr2=0x7f4f100af0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:40:59.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.888+0000 7f4f14f5a700 1 --2- 172.21.15.112:0/4091377864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f10157490 0x7f4f100af0f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4f1006b410 tx=0x7f4f08009840 comp rx=0 tx=0).stop 2023-10-06T04:40:59.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.888+0000 7f4f14f5a700 1 -- 172.21.15.112:0/4091377864 shutdown_connections 2023-10-06T04:40:59.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.888+0000 7f4f14f5a700 1 --2- 172.21.15.112:0/4091377864 >> [v2:172.21.15.112:6832/90409,v1:172.21.15.112:6833/90409] conn(0x7f4ef00670e0 0x7f4ef0069590 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.888+0000 7f4f14f5a700 1 --2- 172.21.15.112:0/4091377864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f10157490 0x7f4f100af0f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.888+0000 7f4f14f5a700 1 --2- 172.21.15.112:0/4091377864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f10069720 0x7f4f100ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.888+0000 7f4f14f5a700 1 --2- 172.21.15.112:0/4091377864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f100ccbf0 0x7f4f100c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:40:59.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.888+0000 7f4f14f5a700 1 -- 172.21.15.112:0/4091377864 >> 172.21.15.112:0/4091377864 conn(0x7f4f100ce630 msgr2=0x7f4f100688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:40:59.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.888+0000 7f4f14f5a700 1 -- 172.21.15.112:0/4091377864 shutdown_connections 2023-10-06T04:40:59.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-10-06T04:40:59.888+0000 7f4f14f5a700 1 -- 172.21.15.112:0/4091377864 wait complete. 2023-10-06T04:40:59.892 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 18 2023-10-06T04:40:59.902 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T04:40:59.903 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T04:40:59.903 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T04:40:59.903 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:40:59.912 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T04:40:59.912 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T04:40:59.912 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:40:59.961 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T04:40:59.961 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T04:40:59.961 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:40:59.971 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T04:40:59.972 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T04:40:59.972 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:41:00.022 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T04:41:00.023 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T04:41:00.023 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T04:41:00.023 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:41:00.049 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T04:41:00.049 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T04:41:00.049 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:41:00.114 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T04:41:00.114 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T04:41:00.115 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:41:00.178 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T04:41:00.178 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T04:41:00.179 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:41:00.243 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T04:41:00.244 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T04:41:00.244 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:41:00.272 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T04:41:00.273 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T04:41:00.273 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:41:00.346 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T04:41:00.347 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T04:41:00.347 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:41:00.415 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T04:41:00.416 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T04:41:00.416 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:41:00.490 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T04:41:00.491 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T04:41:00.491 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T04:41:00.491 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:41:00.516 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T04:41:00.516 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T04:41:00.516 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:41:00.557 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T04:41:00.557 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T04:41:00.558 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T04:41:00.558 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:41:00.568 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T04:41:00.569 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T04:41:00.569 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:41:00.610 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T04:41:00.610 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T04:41:00.610 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:41:00.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-10-06T04:41:00.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-10-06T04:41:00.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-06T04:41:00.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-10-06T04:41:00.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-10-06T04:41:00.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-10-06T04:41:00.662 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T04:41:00.662 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T04:41:00.663 DEBUG:teuthology.orchestra.run.smithi112:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-10-06T04:41:00.692 INFO:teuthology.orchestra.run.smithi112.stdout:1696567160.6174414 mon.a (mon.0) 208 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T04:41:00.693 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T04:41:00.693 DEBUG:teuthology.orchestra.run.smithi112:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-10-06T04:41:00.762 DEBUG:teuthology.orchestra.run.smithi112:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-10-06T04:41:00.832 DEBUG:teuthology.orchestra.run.smithi112:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-10-06T04:41:00.900 INFO:teuthology.orchestra.run.smithi112.stdout:1696567160.6174414 mon.a (mon.0) 208 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T04:41:00.901 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi112.front.sepia.ceph.com 2023-10-06T04:41:00.901 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T04:41:01.216 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi112.front.sepia.ceph.com 2023-10-06T04:41:01.217 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T04:41:01.298 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi112.front.sepia.ceph.com 2023-10-06T04:41:01.299 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T04:41:01.358 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi112.front.sepia.ceph.com 2023-10-06T04:41:01.359 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T04:41:01.438 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-06T04:41:01.439 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T04:41:01.620 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-06T04:41:01.620 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T04:41:01.689 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-06T04:41:01.689 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T04:41:01.761 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-06T04:41:01.761 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T04:41:01.842 INFO:tasks.ceph:Archiving mon data... 2023-10-06T04:41:01.843 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412285/data/mon.a.tgz 2023-10-06T04:41:01.843 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2023-10-06T04:41:01.858 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.XvZ88RnhFL 2023-10-06T04:41:01.858 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.XvZ88RnhFL 2023-10-06T04:41:01.979 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.XvZ88RnhFL 2023-10-06T04:41:02.061 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.XvZ88RnhFL is 300KB 2023-10-06T04:41:02.155 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.XvZ88RnhFL 2023-10-06T04:41:02.169 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412285/data/mon.b.tgz 2023-10-06T04:41:02.169 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2023-10-06T04:41:02.185 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.dOi5xoMD8j 2023-10-06T04:41:02.186 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.dOi5xoMD8j 2023-10-06T04:41:02.353 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.dOi5xoMD8j 2023-10-06T04:41:02.434 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.dOi5xoMD8j is 404KB 2023-10-06T04:41:02.529 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.dOi5xoMD8j 2023-10-06T04:41:02.543 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412285/data/mon.c.tgz 2023-10-06T04:41:02.543 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2023-10-06T04:41:02.596 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.H66QXZwYH6 2023-10-06T04:41:02.596 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.H66QXZwYH6 2023-10-06T04:41:02.730 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.H66QXZwYH6 2023-10-06T04:41:02.811 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.H66QXZwYH6 is 404KB 2023-10-06T04:41:02.907 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.H66QXZwYH6 2023-10-06T04:41:02.921 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T04:41:02.921 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T04:41:02.923 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T04:41:02.984 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T04:41:02.985 DEBUG:teuthology.orchestra.run.smithi112:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T04:41:02.988 DEBUG:teuthology.orchestra.run.smithi179:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T04:41:03.012 INFO:teuthology.orchestra.run.smithi112.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T04:41:03.050 INFO:teuthology.orchestra.run.smithi179.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T04:41:03.055 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T04:41:03.057 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412285/remote/smithi112/crash 2023-10-06T04:41:03.058 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T04:41:03.082 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412285/remote/smithi179/crash 2023-10-06T04:41:03.083 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T04:41:03.119 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T04:41:03.119 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:41:03.126 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:41:03.200 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T04:41:03.225 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T04:41:03.264 INFO:tasks.ceph:Compressing logs... 2023-10-06T04:41:03.264 DEBUG:teuthology.orchestra.run.smithi112:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:41:03.267 DEBUG:teuthology.orchestra.run.smithi179:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:41:04.015 INFO:tasks.ceph:Archiving logs... 2023-10-06T04:41:04.015 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412285/remote/smithi112/log 2023-10-06T04:41:04.016 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T04:41:04.305 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412285/remote/smithi179/log 2023-10-06T04:41:04.306 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T04:41:04.437 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T04:41:04.452 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T04:41:04.452 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T04:41:04.454 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T04:41:04.529 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T04:41:04.539 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T04:41:04.540 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:41:04.542 DEBUG:teuthology.orchestra.run.smithi179:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:41:04.553 INFO:teuthology.orchestra.run.smithi112.stderr:bash: ntpq: command not found 2023-10-06T04:41:04.555 INFO:teuthology.orchestra.run.smithi179.stderr:bash: ntpq: command not found 2023-10-06T04:41:04.556 INFO:teuthology.orchestra.run.smithi112.stdout:210 Number of sources = 4 2023-10-06T04:41:04.556 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:41:04.556 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2023-10-06T04:41:04.556 INFO:teuthology.orchestra.run.smithi112.stdout:^* hv01.front.sepia.ceph.com 2 6 377 13 +471us[ +472us] +/- 78ms 2023-10-06T04:41:04.556 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 15 -411us[ -410us] +/- 54ms 2023-10-06T04:41:04.556 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 +130us[ +131us] +/- 89ms 2023-10-06T04:41:04.557 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:41:04.558 INFO:teuthology.orchestra.run.smithi179.stdout:210 Number of sources = 4 2023-10-06T04:41:04.558 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:41:04.559 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2023-10-06T04:41:04.559 INFO:teuthology.orchestra.run.smithi179.stdout:^* hv01.front.sepia.ceph.com 2 6 377 14 +469us[ +471us] +/- 78ms 2023-10-06T04:41:04.559 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 13 -400us[ -400us] +/- 54ms 2023-10-06T04:41:04.559 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 +145us[ +145us] +/- 89ms 2023-10-06T04:41:04.559 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:41:04.559 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T04:41:04.569 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T04:41:04.569 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T04:41:04.605 DEBUG:teuthology.orchestra.run.smithi112:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T04:41:04.698 DEBUG:teuthology.orchestra.run.smithi179:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T04:41:04.787 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:41:04.817 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:41:04.817 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:41:04.846 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:41:04.847 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T04:41:04.857 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T04:41:04.879 INFO:teuthology.task.internal:Duration was 779.517788 seconds 2023-10-06T04:41:04.880 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T04:41:04.890 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T04:41:04.890 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T04:41:04.893 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T04:41:04.933 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:41:04.936 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:41:05.183 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T04:41:05.198 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2023-10-06T04:41:05.198 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T04:41:05.241 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi179.front.sepia.ceph.com 2023-10-06T04:41:05.242 DEBUG:teuthology.orchestra.run.smithi179:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T04:41:05.261 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T04:41:05.261 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:41:05.285 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:41:05.340 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T04:41:05.340 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T04:41:05.364 DEBUG:teuthology.orchestra.run.smithi179:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T04:41:05.453 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T04:41:05.463 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T04:41:05.464 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T04:41:05.490 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T04:41:05.514 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T04:41:05.525 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:41:05.532 DEBUG:teuthology.orchestra.run.smithi179:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:41:05.553 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2023-10-06T04:41:05.578 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = core 2023-10-06T04:41:05.591 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:41:05.620 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:41:05.622 DEBUG:teuthology.orchestra.run.smithi179:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:41:05.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:41:05.645 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T04:41:05.656 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T04:41:05.657 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412285/remote/smithi112 2023-10-06T04:41:05.657 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T04:41:05.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-10-06T04:41:05.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-10-06T04:41:05.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-10-06T04:41:05.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-10-06T04:41:05.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-10-06T04:41:05.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-10-06T04:41:05.700 DEBUG:teuthology.misc:Transferring archived files from smithi179:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412285/remote/smithi179 2023-10-06T04:41:05.700 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T04:41:05.735 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T04:41:05.735 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T04:41:05.737 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T04:41:05.784 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T04:41:05.794 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T04:41:05.794 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T04:41:05.814 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T04:41:05.814 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T04:41:05.817 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T04:41:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: 263007 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 04:41 /home/ubuntu/cephtest 2023-10-06T04:41:05.838 INFO:teuthology.orchestra.run.smithi179.stdout: 262944 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 04:41 /home/ubuntu/cephtest 2023-10-06T04:41:05.840 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T04:41:05.867 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T04:41:05.893 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T04:41:05.917 DEBUG:teuthology.nuke:shortname: smithi112 2023-10-06T04:41:05.917 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T04:41:05.937 DEBUG:teuthology.nuke:shortname: smithi179 2023-10-06T04:41:05.938 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T04:41:05.943 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412285', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:21:03.894112', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJsRpR60QY6/djFjGFx1U1QUBPfvDNOFoTsg8aYq7v/ox/m17tCw0bAhX2Xt+g7F/+kKgoscICYAM24k9irbb+U='} 2023-10-06T04:41:05.959 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412285', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:21:03.892699', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDzZEoCEQEHA5sl0fCfjXNw2SJAIjF9UHBJtEiPDjyFy3v9wiesRUT0oqBTmLJUlZOM/ExDMn/Vpt8k2DNXW11o='} 2023-10-06T04:41:05.988 INFO:teuthology.orchestra.console.smithi112:Power off 2023-10-06T04:41:05.988 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T04:41:06.007 INFO:teuthology.orchestra.console.smithi179:Power off 2023-10-06T04:41:06.008 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T04:41:06.019 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-10-06T04:41:06.019 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:41:06.032 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-10-06T04:41:06.033 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:41:06.043 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-10-06T04:41:06.057 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-10-06T04:41:10.045 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:41:10.058 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:41:10.155 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-10-06T04:41:10.167 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-10-06T04:41:14.158 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:41:14.171 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:41:14.273 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-10-06T04:41:14.282 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-10-06T04:41:14.383 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-10-06T04:41:18.276 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:41:18.387 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-10-06T04:41:18.487 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-10-06T04:41:18.592 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} duration: 779.517787694931 failure_reason: '"1696567160.6174414 mon.a (mon.0) 208 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T04:41:18.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T04:41:18.668 INFO:teuthology.run:FAIL